Nov 01 12:14:17 devstack cinder-volume[75499]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 01 12:14:17 devstack cinder-volume[75499]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 01 12:14:17 devstack cinder-volume[75499]: we strongly recommend against using it for new projects. Nov 01 12:14:17 devstack cinder-volume[75499]: If you are already using Eventlet, we recommend migrating to a different Nov 01 12:14:17 devstack cinder-volume[75499]: framework. For more detail see Nov 01 12:14:17 devstack cinder-volume[75499]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 01 12:14:17 devstack cinder-volume[75499]: import eventlet # noqa Nov 01 12:14:19 devstack cinder-volume[75499]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=75499) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 01 12:14:19 devstack cinder-volume[75499]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=75499) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 01 12:14:19 devstack cinder-volume[75499]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=75499) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 01 12:14:20 devstack cinder-volume[75499]: INFO dbcounter [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] Registered counter for database cinder Nov 01 12:14:20 devstack cinder-volume[75499]: DEBUG oslo_db.sqlalchemy.engines [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75499) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 01 12:14:21 devstack cinder-volume[75499]: DEBUG dbcounter [-] [75499] Writer thread running {{(pid=75499) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 01 12:14:21 devstack cinder-volume[75499]: INFO cinder.rpc [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 01 12:14:21 devstack cinder-volume[75499]: INFO cinder.rpc [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 01 12:14:21 devstack cinder-volume[75499]: DEBUG oslo_db.sqlalchemy.engines [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75499) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 01 12:14:21 devstack cinder-volume[75499]: INFO cinder.volume.manager [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] Determined volume DB was empty at startup. Nov 01 12:14:21 devstack cinder-volume[75499]: DEBUG cinder.volume.manager [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] Cinder Volume DB check: vol_db_empty=True {{(pid=75499) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 01 12:14:21 devstack cinder-volume[75499]: INFO cinder.volume.manager [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 01 12:14:21 devstack cinder-volume[75499]: WARNING stevedore.named [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 01 12:14:21 devstack cinder-volume[75499]: WARNING castellan.key_manager [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 01 12:14:21 devstack cinder-volume[75499]: WARNING cinder.keymgr.conf_key_mgr [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 01 12:14:21 devstack cinder-volume[75499]: DEBUG cinder.volume.drivers.lvm [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=75499) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:109}} Nov 01 12:14:21 devstack cinder-volume[75499]: DEBUG oslo_concurrency.processutils [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=75499) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:21 devstack cinder-volume[75499]: DEBUG oslo_concurrency.processutils [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] CMD "cinder-rtstool verify" returned: 0 in 0.469s {{(pid=75499) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_db.sqlalchemy.engines [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75499) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 01 12:14:22 devstack cinder-volume[75499]: INFO cinder.rpc [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] Automatically selected cinder-volume objects version 1.39 as minimum service version. Nov 01 12:14:22 devstack cinder-volume[75499]: INFO cinder.rpc [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version. Nov 01 12:14:22 devstack cinder-volume[75499]: WARNING stevedore.named [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 01 12:14:22 devstack cinder-volume[75499]: WARNING castellan.key_manager [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 01 12:14:22 devstack cinder-volume[75499]: INFO cinder.volume.manager [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] Image-volume cache enabled for host devstack@lvmdriver-1. Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_db.sqlalchemy.engines [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75499) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 01 12:14:22 devstack cinder-volume[75499]: INFO oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] Starting 1 workers Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] Started child 75654 {{(pid=75499) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] Full set of CONF: {{(pid=75499) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] ******************************************************************************** {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] Configuration options gathered from: {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] ================================================================================ {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 01 12:14:22 devstack cinder-volume[75654]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] allow_availability_zone_fallback = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] allow_compression_on_image_upload = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] allowed_direct_url_schemes = [] {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] api_rate_limit = True {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] auth_strategy = keystone {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] az_cache_duration = 3600 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_availability_zone = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_host = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_name = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_stats_polling_interval = 60 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backup_api_class = cinder.backup.api.API {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backup_name_template = backup-%s {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backup_use_same_host = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backup_use_temp_snapshot = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] chap_password = **** {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] chap_username = {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] cinder_internal_tenant_project_id = 3284b3c9dbe2488992ca897e28f0aaa0 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] cinder_internal_tenant_user_id = 43e618bbd979401d996616b44e913181 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] cloned_volume_same_az = True {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] cluster = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] compression_format = gzip {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] compute_api_class = cinder.compute.nova.API {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] config_dir = [] {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] config_source = [] {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] control_exchange = openstack {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] debug = True {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] default_availability_zone = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] default_group_type = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] default_volume_type = lvmdriver-1 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] disk_geometry = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] driver_client_cert = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] driver_client_cert_key = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] driver_data_namespace = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] driver_ssl_cert_path = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] driver_ssl_cert_verify = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] driver_use_ssl = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] enable_force_upload = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] enable_new_services = True {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] enable_unsupported_driver = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] enabled_backends = ['lvmdriver-1'] {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] enforce_multipath_for_image_xfer = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] filter_function = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] glance_api_insecure = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] glance_api_servers = ['http://192.168.122.20/image'] {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] glance_api_ssl_compression = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] glance_ca_certificates_file = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] glance_catalog_info = image:glance:publicURL {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] glance_certfile = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] glance_keyfile = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] glance_num_retries = 3 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75654]: INFO cinder.volume.manager [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] Starting volume driver LVMVolumeDriver (3.0.0) Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] glance_request_timeout = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] goodness_function = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] graceful_shutdown_timeout = 5 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] group_api_class = cinder.group.api.API {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] host = devstack {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] image_compress_on_upload = True {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] image_conversion_address_space_limit = 1 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] image_conversion_cpu_limit = 60 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] image_conversion_disable = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] image_introspection_address_space_limit = 1 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] image_introspection_cpu_limit = 60 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] image_upload_use_cinder_backend = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] image_upload_use_internal_tenant = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] image_volume_cache_enabled = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] image_volume_cache_max_count = 0 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] image_volume_cache_max_size_gb = 0 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] init_host_max_objects_retrieval = 0 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] instance_format = [instance: %(uuid)s] {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] iscsi_target_flags = {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] iscsi_write_cache = on {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] iser_helper = tgtadm {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] iser_ip_address = 192.168.122.20 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] iser_port = 3260 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] log_color = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] log_config_append = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] log_dir = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] log_file = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] log_options = True {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] log_rotate_interval = 1 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] log_rotate_interval_type = days {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] log_rotation_type = none {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] max_age = 0 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] max_logfile_count = 30 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] max_logfile_size_mb = 200 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] max_over_subscription_ratio = 20.0 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] message_reap_interval = 86400 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] message_ttl = 2592000 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] migration_create_volume_timeout_secs = 300 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] monkey_patch = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] monkey_patch_modules = [] {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] my_ip = 192.168.122.20 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] no_snapshot_gb_quota = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] num_iser_scan_tries = 3 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] num_shell_tries = 3 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] num_volume_device_scan_tries = 3 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] nvmeof_conn_info_version = 1 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] nvmet_ns_id = 10 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] nvmet_port_id = 1 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] osapi_max_limit = 1000 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] osapi_volume_ext_list = [] {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] osapi_volume_listen = 0.0.0.0 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] osapi_volume_listen_port = 8776 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] osapi_volume_use_ssl = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] osapi_volume_workers = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] per_volume_size_limit = -1 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] periodic_fuzzy_delay = 60 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] periodic_interval = 60 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] project_id_regex = [0-9a-f\-]+ {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] public_endpoint = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] publish_errors = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] quota_backup_gigabytes = 1000 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] quota_backups = 10 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.044s {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] quota_gigabytes = 1000 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] quota_groups = 10 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] quota_snapshots = 10 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] quota_volumes = 10 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] rate_limit_burst = 0 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] rate_limit_except_level = CRITICAL {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] rate_limit_interval = 0 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] reinit_driver_count = 3 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] replication_device = **** {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] report_discard_supported = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] report_interval = 120 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] reservation_clean_interval = 86400 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] reservation_expire = 86400 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] reserved_image_namespaces = [] {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] reserved_percentage = 0 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] rpc_response_timeout = 120 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] run_external_periodic_tasks = True {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] scst_target_driver = iscsi {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] scst_target_iqn_name = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] service_down_time = 720 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] shell_completion = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] snapshot_name_template = snapshot-%s {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] snapshot_same_host = True {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] split_loggers = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] state_path = /opt/stack/data/cinder {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] storage_availability_zone = nova {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] storage_protocol = iSCSI {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] syslog_log_facility = LOG_USER {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] target_helper = lioadm {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] target_ip_address = 192.168.122.20 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] target_port = 3260 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] target_protocol = iscsi {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] target_secondary_ip_addresses = [] {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] trace_flags = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] transfer_api_class = cinder.transfer.api.API {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] transport_url = **** {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] until_refresh = 0 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] use_chap_auth = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] use_default_quota_class = True {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] use_journal = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] use_json = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] use_multipath_for_image_xfer = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] use_stderr = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] use_syslog = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] verify_glance_signatures = enabled {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] volume_api_class = cinder.volume.api.API {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] volume_backend_name = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] volume_clear = zero {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] volume_clear_ionice = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] volume_clear_size = 0 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] volume_copy_bps_limit = 0 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] volume_dd_blocksize = 1M {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.034s {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:22 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] volume_name_template = volume-%s {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] volume_service_inithost_offload = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] volume_usage_audit_period = month {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] zoning_mode = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_concurrency.disable_process_locking = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] os_brick.lightos_discovery_client_address = localhost {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] os_brick.wait_mpath_device_interval = 1 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] keystone_authtoken.auth_section = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] keystone_authtoken.auth_type = password {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] keystone_authtoken.auth_version = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] keystone_authtoken.cache = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] keystone_authtoken.certfile = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] keystone_authtoken.delay_auth_decision = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] keystone_authtoken.http_connect_timeout = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] keystone_authtoken.include_service_catalog = True {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] keystone_authtoken.insecure = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] keystone_authtoken.interface = public {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] keystone_authtoken.keyfile = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] keystone_authtoken.memcache_password = **** {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] keystone_authtoken.memcache_secret_key = **** {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] keystone_authtoken.memcache_security_strategy = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] keystone_authtoken.memcache_username = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] keystone_authtoken.region_name = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] keystone_authtoken.service_token_roles_required = True {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] keystone_authtoken.service_type = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] keystone_authtoken.token_cache_time = 300 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.20/identity {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] cache.backend = dogpile.cache.null {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] cache.backend_argument = **** {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] cache.backend_expiration_time = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] cache.config_prefix = cache.oslo {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] cache.debug_cache_backend = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] cache.enable_retry_client = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] cache.enable_socket_keepalive = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] cache.enabled = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] cache.expiration_time = 600 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] cache.hashclient_dead_timeout = 60.0 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack sudo[75661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] cache.hashclient_retry_attempts = 2 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] cache.hashclient_retry_timeout = 1.0 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] cache.memcache_dead_retry = 300 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] cache.memcache_pool_maxsize = 10 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] cache.memcache_pool_unused_timeout = 60 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack sudo[75661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] cache.memcache_sasl_enabled = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] cache.memcache_servers = ['localhost:11211'] {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] cache.password = **** {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] cache.proxies = [] {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] cache.redis_db = 0 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] cache.redis_sentinel_service_name = mymaster {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] cache.redis_server = localhost:6379 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] cache.retry_attempts = 2 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] cache.retry_delay = 0.0 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] cache.socket_keepalive_count = 1 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] cache.socket_keepalive_idle = 1 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] cache.socket_keepalive_interval = 1 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] cache.socket_timeout = 1.0 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] cache.tls_allowed_ciphers = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] cache.tls_cafile = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] cache.tls_certfile = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] cache.tls_enabled = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] cache.tls_keyfile = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] cache.username = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] coordination.backend_url = **** {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] database.asyncio_connection = **** {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] database.asyncio_slave_connection = **** {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] database.backend = sqlalchemy {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] database.connection = **** {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] database.connection_debug = 0 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] database.connection_parameters = {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] database.connection_recycle_time = 3600 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] database.connection_trace = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] database.db_inc_retry_interval = True {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] database.db_max_retries = 20 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] database.db_max_retry_interval = 10 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] database.db_retry_interval = 1 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] database.max_overflow = 50 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] database.max_pool_size = 5 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] database.max_retries = 10 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] database.mysql_sql_mode = TRADITIONAL {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] database.mysql_wsrep_sync_wait = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] database.pool_timeout = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] database.retry_interval = 10 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] database.slave_connection = **** {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] database.sqlite_synchronous = True {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] database.synchronous_reader = True {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] database.use_db_reconnect = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_messaging_metrics.metrics_process_name = {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_messaging_tracing.insecure = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] profiler.connection_string = messaging:// {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] profiler.enabled = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] profiler.es_doc_type = notification {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] profiler.es_scroll_size = 10000 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] profiler.es_scroll_time = 2m {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] profiler.filter_error_trace = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] profiler.hmac_keys = **** {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] profiler.sentinel_service_name = mymaster {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] profiler.socket_timeout = 0.1 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] profiler.trace_requests = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] profiler.trace_sqlalchemy = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] profiler_jaeger.process_tags = {} {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] profiler_jaeger.service_name_prefix = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] profiler_otlp.service_name_prefix = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_policy.enforce_new_defaults = True {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_policy.policy_default_rule = default {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_policy.policy_file = policy.yaml {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_policy.remote_timeout = 60.0 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] privsep_osbrick.capabilities = [21, 2] {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] privsep_osbrick.group = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] privsep_osbrick.helper_command = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] privsep_osbrick.log_daemon_traceback = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] privsep_osbrick.thread_pool_size = 4 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] privsep_osbrick.user = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] cinder_sys_admin.group = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] cinder_sys_admin.helper_command = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] cinder_sys_admin.user = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] service_user.auth_section = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] service_user.auth_type = password {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] service_user.cafile = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] service_user.certfile = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] service_user.collect_timing = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] service_user.insecure = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] service_user.keyfile = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] service_user.send_service_user_token = True {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] service_user.split_loggers = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] service_user.timeout = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] service_user.tls_ciphers = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] service_user.tls_min_version = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] glance.auth_section = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] glance.auth_type = password {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] glance.certfile = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] glance.collect_timing = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] glance.insecure = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] glance.keyfile = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] glance.region_name = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] glance.split_loggers = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] glance.timeout = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] glance.tls_ciphers = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] glance.tls_min_version = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.backend_availability_zone = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.chap_password = **** {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.chap_username = {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.disk_geometry = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.driver_client_cert = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.driver_client_cert_key = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.driver_data_namespace = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.driver_ssl_cert_path = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.driver_use_ssl = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.enable_unsupported_driver = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.extra_capabilities = {} {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.filter_function = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.goodness_function = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.image_volume_cache_enabled = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.iscsi_target_flags = {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.iscsi_write_cache = on {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.iser_helper = tgtadm {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.iser_ip_address = 192.168.122.20 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.iser_port = 3260 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.lvm_mirrors = 0 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.lvm_share_target = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.lvm_type = auto {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.num_shell_tries = 3 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.nvmet_ns_id = 10 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.nvmet_port_id = 1 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.replication_device = **** {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.report_discard_supported = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.reserved_percentage = 0 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.scst_target_driver = iscsi {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.scst_target_iqn_name = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.storage_protocol = iSCSI {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.target_helper = tgtadm {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.target_ip_address = 192.168.122.20 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.target_port = 3260 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.target_protocol = iscsi {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.trace_flags = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.unique_fqdn_network = True {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.use_chap_auth = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.volume_backend_name = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.volume_clear = zero {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.volume_clear_ionice = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.volume_clear_size = 0 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.volume_group = cinder-volumes {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_reports.file_event_handler = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_reports.file_event_handler_interval = 1 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_reports.log_dir = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.backend_availability_zone = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.backend_host = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.chap_password = **** {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.chap_username = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.chiscsi_conf = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.disk_geometry = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.driver_client_cert = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.driver_client_cert_key = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.driver_data_namespace = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.driver_use_ssl = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.extra_capabilities = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.filter_function = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.goodness_function = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.iscsi_target_flags = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.iscsi_write_cache = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.iser_helper = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.iser_ip_address = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.iser_port = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.iser_target_prefix = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.lvm_conf_file = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.lvm_mirrors = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.lvm_share_target = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.lvm_type = auto {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.num_shell_tries = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.nvmet_ns_id = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.nvmet_port_id = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.replication_device = **** {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.report_discard_supported = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.reserved_percentage = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.scst_target_driver = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.storage_protocol = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.target_helper = lioadm {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.target_ip_address = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.target_port = 3260 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.target_prefix = iqn.2010-10.org.openstack: {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.target_protocol = iscsi {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.trace_flags = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.unique_fqdn_network = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.use_chap_auth = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.volume_clear = zero {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.volume_clear_ionice = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.volume_clear_size = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.volume_group = stack-volumes-lvmdriver-1 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] lvmdriver-1.volumes_dir = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_messaging_rabbit.hostname = devstack {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_messaging_rabbit.ssl = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_messaging_rabbit.ssl_version = {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_messaging_notifications.driver = [] {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_messaging_notifications.retry = -1 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] oslo_messaging_notifications.transport_url = **** {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] key_manager.fixed_key = **** {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] barbican.barbican_api_version = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] barbican.barbican_endpoint = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] barbican.barbican_endpoint_type = public {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] barbican.barbican_region_name = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] barbican.cafile = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] barbican.certfile = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] barbican.collect_timing = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] barbican.insecure = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] barbican.keyfile = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] barbican.number_of_retries = 60 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] barbican.retry_delay = 1 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] barbican.send_service_user_token = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] barbican.split_loggers = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] barbican.timeout = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] barbican.tls_ciphers = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] barbican.tls_min_version = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] barbican.verify_ssl = True {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] barbican.verify_ssl_path = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] barbican_service_user.auth_section = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] barbican_service_user.auth_type = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] barbican_service_user.cafile = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] barbican_service_user.certfile = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] barbican_service_user.collect_timing = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] barbican_service_user.insecure = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] barbican_service_user.keyfile = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] barbican_service_user.split_loggers = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] barbican_service_user.timeout = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] barbican_service_user.tls_ciphers = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] barbican_service_user.tls_min_version = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] vault.approle_role_id = **** {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] vault.approle_secret_id = **** {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] vault.auth_method = approle {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] vault.auth_path = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] vault.kv_mountpoint = secret {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] vault.kv_path = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] vault.kv_version = 2 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] vault.namespace = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] vault.root_token_id = **** {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] vault.ssl_ca_crt_file = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] vault.timeout = 60.0 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] vault.token_file = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] vault.token_role = None {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] vault.use_ssl = False {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:14:22 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] ******************************************************************************** {{(pid=75499) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 01 12:14:22 devstack sudo[75661]: pam_unix(sudo:session): session closed for user root Nov 01 12:14:22 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 0.425s {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:22 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:22 devstack sudo[75776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 01 12:14:22 devstack sudo[75776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:14:23 devstack sudo[75776]: pam_unix(sudo:session): session closed for user root Nov 01 12:14:23 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 0.265s {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:23 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 12:14:23 devstack cinder-volume[75654]: INFO cinder.brick.local_dev.lvm [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool Nov 01 12:14:23 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:23 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.020s {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:23 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:23 devstack sudo[75881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 01 12:14:23 devstack sudo[75881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:14:23 devstack sudo[75881]: pam_unix(sudo:session): session closed for user root Nov 01 12:14:23 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:23 devstack cinder-volume[75654]: DEBUG cinder.brick.local_dev.lvm [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=75654) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:567}} Nov 01 12:14:23 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:23 devstack sudo[75973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 01 12:14:23 devstack sudo[75973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:14:24 devstack sudo[75973]: pam_unix(sudo:session): session closed for user root Nov 01 12:14:24 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.566s {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:24 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:24 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.022s {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:24 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:24 devstack sudo[76184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 01 12:14:24 devstack sudo[76184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:14:24 devstack sudo[76184]: pam_unix(sudo:session): session closed for user root Nov 01 12:14:24 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.325s {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:24 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:24 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.018s {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:24 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:24 devstack sudo[76303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster Nov 01 12:14:24 devstack sudo[76303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:14:24 devstack sudo[76303]: pam_unix(sudo:session): session closed for user root Nov 01 12:14:24 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 0.279s {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:24 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:24 devstack sudo[76306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 01 12:14:24 devstack sudo[76306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:14:25 devstack sudo[76306]: pam_unix(sudo:session): session closed for user root Nov 01 12:14:25 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.336s {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:25 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:25 devstack sudo[76390]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 01 12:14:25 devstack sudo[76390]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:14:25 devstack sudo[76390]: pam_unix(sudo:session): session closed for user root Nov 01 12:14:25 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.263s {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:25 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:25 devstack sudo[76393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 12:14:25 devstack sudo[76393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:14:25 devstack sudo[76393]: pam_unix(sudo:session): session closed for user root Nov 01 12:14:25 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.313s {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:25 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:25 devstack sudo[76456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 01 12:14:25 devstack sudo[76456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:14:25 devstack sudo[76456]: pam_unix(sudo:session): session closed for user root Nov 01 12:14:25 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.294s {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:25 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:25 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:25 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:25 devstack sudo[76486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 01 12:14:25 devstack sudo[76486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:14:26 devstack sudo[76486]: pam_unix(sudo:session): session closed for user root Nov 01 12:14:26 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.246s {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:26 devstack cinder-volume[75654]: INFO cinder.volume.drivers.lvm [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] Enabling LVM thin provisioning by default because a thin pool exists. Nov 01 12:14:26 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:26 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.017s {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:26 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:26 devstack sudo[76496]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 01 12:14:26 devstack sudo[76496]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:14:26 devstack sudo[76496]: pam_unix(sudo:session): session closed for user root Nov 01 12:14:26 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.272s {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:26 devstack cinder-volume[75654]: DEBUG cinder.volume.drivers.lvm [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] Updating volume stats {{(pid=75654) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 01 12:14:26 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:26 devstack sudo[76499]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 01 12:14:26 devstack sudo[76499]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:14:26 devstack sudo[76499]: pam_unix(sudo:session): session closed for user root Nov 01 12:14:26 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:26 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:26 devstack sudo[76502]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 12:14:26 devstack sudo[76502]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:14:26 devstack sudo[76502]: pam_unix(sudo:session): session closed for user root Nov 01 12:14:26 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:26 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:26 devstack sudo[76505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 01 12:14:26 devstack sudo[76505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:14:27 devstack sudo[76505]: pam_unix(sudo:session): session closed for user root Nov 01 12:14:27 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.273s {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:27 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:27 devstack sudo[76509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 12:14:27 devstack sudo[76509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:14:27 devstack sudo[76509]: pam_unix(sudo:session): session closed for user root Nov 01 12:14:27 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.245s {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:27 devstack cinder-volume[75654]: INFO cinder.volume.driver [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] Driver hasn't implemented _init_vendor_properties() Nov 01 12:14:27 devstack cinder-volume[75654]: DEBUG cinder.volume.driver [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=75654) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 01 12:14:27 devstack cinder-volume[75654]: DEBUG oslo_db.sqlalchemy.engines [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=75654) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 01 12:14:27 devstack cinder-volume[75654]: DEBUG dbcounter [-] [75654] Writer thread running {{(pid=75654) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 01 12:14:27 devstack cinder-volume[75654]: DEBUG cinder.db.api [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] Building query based on filter {{(pid=75654) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 01 12:14:27 devstack cinder-volume[75654]: DEBUG cinder.image.image_utils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=75654) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 01 12:14:27 devstack cinder-volume[75654]: INFO cinder.keymgr.migration [None req-e446a94b-7087-446f-a146-625ab17a97e7 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 01 12:14:27 devstack cinder-volume[75654]: DEBUG cinder.volume.drivers.lvm [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] Updating volume stats {{(pid=75654) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 01 12:14:27 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:27 devstack sudo[76512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 01 12:14:27 devstack sudo[76512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:14:27 devstack sudo[76512]: pam_unix(sudo:session): session closed for user root Nov 01 12:14:27 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.261s {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:27 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:27 devstack sudo[76517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 12:14:27 devstack sudo[76517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:14:28 devstack sudo[76517]: pam_unix(sudo:session): session closed for user root Nov 01 12:14:28 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.275s {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:28 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:28 devstack sudo[76521]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 01 12:14:28 devstack sudo[76521]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:14:28 devstack sudo[76521]: pam_unix(sudo:session): session closed for user root Nov 01 12:14:28 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.269s {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:28 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:28 devstack sudo[76524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 12:14:28 devstack sudo[76524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:14:28 devstack sudo[76524]: pam_unix(sudo:session): session closed for user root Nov 01 12:14:28 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.258s {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:28 devstack cinder-volume[75654]: DEBUG cinder.manager [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] Notifying Schedulers of capabilities ... {{(pid=75654) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:14:28 devstack cinder-volume[75654]: INFO cinder.volume.manager [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] Driver initialization completed successfully. Nov 01 12:14:28 devstack cinder-volume[75654]: INFO cinder.manager [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] Initiating service 2 cleanup Nov 01 12:14:28 devstack cinder-volume[75654]: INFO cinder.manager [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] Service 2 cleanup completed. Nov 01 12:14:28 devstack cinder-volume[75654]: DEBUG cinder.service [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] Creating RPC server for service cinder-volume {{(pid=75654) start /opt/stack/cinder/cinder/service.py:231}} Nov 01 12:14:28 devstack cinder-volume[75654]: DEBUG cinder.service [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=75654) start /opt/stack/cinder/cinder/service.py:237}} Nov 01 12:14:28 devstack cinder-volume[75654]: INFO cinder.volume.manager [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0) Nov 01 12:14:28 devstack cinder-volume[75654]: DEBUG cinder.volume.drivers.lvm [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] Updating volume stats {{(pid=75654) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 01 12:14:28 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:28 devstack sudo[76527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 01 12:14:28 devstack sudo[76527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:14:29 devstack sudo[76527]: pam_unix(sudo:session): session closed for user root Nov 01 12:14:29 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.252s {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:29 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:29 devstack sudo[76532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 12:14:29 devstack sudo[76532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:14:29 devstack sudo[76532]: pam_unix(sudo:session): session closed for user root Nov 01 12:14:29 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.257s {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:29 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:29 devstack sudo[76538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 01 12:14:29 devstack sudo[76538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:14:29 devstack sudo[76538]: pam_unix(sudo:session): session closed for user root Nov 01 12:14:29 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.259s {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:29 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:14:29 devstack sudo[76541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 12:14:29 devstack sudo[76541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:14:29 devstack sudo[76541]: pam_unix(sudo:session): session closed for user root Nov 01 12:14:29 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:14:29 devstack cinder-volume[75654]: INFO cinder.volume.manager [None req-a36f9b3f-f5b2-4c2c-bf5e-8013e1746e49 None None] Driver post RPC initialization completed successfully. Nov 01 12:14:32 devstack cinder-volume[75499]: DEBUG dbcounter [-] [75499] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75499) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:14:38 devstack cinder-volume[75654]: DEBUG dbcounter [-] [75654] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=75654) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:14:39 devstack cinder-volume[75654]: DEBUG dbcounter [-] [75654] Writing DB stats cinder:SELECT=4,cinder:UPDATE=1 {{(pid=75654) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:15:22 devstack cinder-volume[75654]: DEBUG oslo_service.periodic_task [None req-4ac95e5e-3611-42b2-a3b0-a4e6bf8b213d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75654) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:15:22 devstack cinder-volume[75654]: DEBUG cinder.volume.drivers.lvm [None req-4ac95e5e-3611-42b2-a3b0-a4e6bf8b213d None None] Updating volume stats {{(pid=75654) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 01 12:15:22 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-4ac95e5e-3611-42b2-a3b0-a4e6bf8b213d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:15:22 devstack sudo[78411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 01 12:15:22 devstack sudo[78411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:15:23 devstack sudo[78411]: pam_unix(sudo:session): session closed for user root Nov 01 12:15:23 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-4ac95e5e-3611-42b2-a3b0-a4e6bf8b213d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:15:23 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-4ac95e5e-3611-42b2-a3b0-a4e6bf8b213d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:15:23 devstack sudo[78414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 12:15:23 devstack sudo[78414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:15:23 devstack sudo[78414]: pam_unix(sudo:session): session closed for user root Nov 01 12:15:23 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-4ac95e5e-3611-42b2-a3b0-a4e6bf8b213d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.268s {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:15:23 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-4ac95e5e-3611-42b2-a3b0-a4e6bf8b213d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:15:23 devstack sudo[78417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 01 12:15:23 devstack sudo[78417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:15:23 devstack sudo[78417]: pam_unix(sudo:session): session closed for user root Nov 01 12:15:23 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-4ac95e5e-3611-42b2-a3b0-a4e6bf8b213d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.247s {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:15:23 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-4ac95e5e-3611-42b2-a3b0-a4e6bf8b213d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:15:23 devstack sudo[78420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 12:15:23 devstack sudo[78420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:15:23 devstack sudo[78420]: pam_unix(sudo:session): session closed for user root Nov 01 12:15:23 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-4ac95e5e-3611-42b2-a3b0-a4e6bf8b213d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.255s {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:15:23 devstack cinder-volume[75654]: DEBUG cinder.manager [None req-4ac95e5e-3611-42b2-a3b0-a4e6bf8b213d None None] Notifying Schedulers of capabilities ... {{(pid=75654) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:15:23 devstack cinder-volume[75654]: DEBUG oslo_service.periodic_task [None req-4ac95e5e-3611-42b2-a3b0-a4e6bf8b213d None None] Running periodic task VolumeManager._thread_info {{(pid=75654) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:15:23 devstack cinder-volume[75654]: DEBUG cinder.volume.manager [None req-4ac95e5e-3611-42b2-a3b0-a4e6bf8b213d None None] thread count: 6 {{(pid=75654) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 12:15:23 devstack cinder-volume[75654]: DEBUG cinder.volume.manager [None req-4ac95e5e-3611-42b2-a3b0-a4e6bf8b213d None None] thread info: [<_MainThread(MainThread, started 131970562736256)>, , , , , ] {{(pid=75654) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 12:16:22 devstack cinder-volume[75654]: DEBUG oslo_service.periodic_task [None req-4ac95e5e-3611-42b2-a3b0-a4e6bf8b213d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75654) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:16:22 devstack cinder-volume[75654]: DEBUG cinder.volume.drivers.lvm [None req-4ac95e5e-3611-42b2-a3b0-a4e6bf8b213d None None] Updating volume stats {{(pid=75654) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 01 12:16:22 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-4ac95e5e-3611-42b2-a3b0-a4e6bf8b213d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:16:22 devstack sudo[81726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 01 12:16:22 devstack sudo[81726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:16:23 devstack sudo[81726]: pam_unix(sudo:session): session closed for user root Nov 01 12:16:23 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-4ac95e5e-3611-42b2-a3b0-a4e6bf8b213d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:16:23 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-4ac95e5e-3611-42b2-a3b0-a4e6bf8b213d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:16:23 devstack sudo[81729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 12:16:23 devstack sudo[81729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:16:23 devstack sudo[81729]: pam_unix(sudo:session): session closed for user root Nov 01 12:16:23 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-4ac95e5e-3611-42b2-a3b0-a4e6bf8b213d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.250s {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:16:23 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-4ac95e5e-3611-42b2-a3b0-a4e6bf8b213d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:16:23 devstack sudo[81732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 01 12:16:23 devstack sudo[81732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:16:23 devstack sudo[81732]: pam_unix(sudo:session): session closed for user root Nov 01 12:16:23 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-4ac95e5e-3611-42b2-a3b0-a4e6bf8b213d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.265s {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:16:23 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-4ac95e5e-3611-42b2-a3b0-a4e6bf8b213d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:16:23 devstack sudo[81736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 12:16:23 devstack sudo[81736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:16:23 devstack sudo[81736]: pam_unix(sudo:session): session closed for user root Nov 01 12:16:23 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-4ac95e5e-3611-42b2-a3b0-a4e6bf8b213d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.249s {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:16:23 devstack cinder-volume[75654]: DEBUG cinder.manager [None req-4ac95e5e-3611-42b2-a3b0-a4e6bf8b213d None None] Notifying Schedulers of capabilities ... {{(pid=75654) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:16:39 devstack cinder-volume[75654]: DEBUG dbcounter [-] [75654] Writing DB stats cinder:SELECT=1 {{(pid=75654) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:16:39 devstack cinder-volume[75654]: DEBUG dbcounter [-] [75654] Writing DB stats cinder:UPDATE=1 {{(pid=75654) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:17:22 devstack cinder-volume[75654]: DEBUG oslo_service.periodic_task [None req-4ac95e5e-3611-42b2-a3b0-a4e6bf8b213d None None] Running periodic task VolumeManager._thread_info {{(pid=75654) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:17:22 devstack cinder-volume[75654]: DEBUG cinder.volume.manager [None req-4ac95e5e-3611-42b2-a3b0-a4e6bf8b213d None None] thread count: 6 {{(pid=75654) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 12:17:22 devstack cinder-volume[75654]: DEBUG cinder.volume.manager [None req-4ac95e5e-3611-42b2-a3b0-a4e6bf8b213d None None] thread info: [<_MainThread(MainThread, started 131970562736256)>, , , , , ] {{(pid=75654) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 12:18:22 devstack cinder-volume[75654]: DEBUG oslo_service.periodic_task [None req-4ac95e5e-3611-42b2-a3b0-a4e6bf8b213d None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=75654) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:18:22 devstack cinder-volume[75654]: DEBUG cinder.volume.drivers.lvm [None req-4ac95e5e-3611-42b2-a3b0-a4e6bf8b213d None None] Updating volume stats {{(pid=75654) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:235}} Nov 01 12:18:22 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-4ac95e5e-3611-42b2-a3b0-a4e6bf8b213d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:18:22 devstack sudo[85111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 Nov 01 12:18:22 devstack sudo[85111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:18:23 devstack sudo[85111]: pam_unix(sudo:session): session closed for user root Nov 01 12:18:23 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-4ac95e5e-3611-42b2-a3b0-a4e6bf8b213d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:18:23 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-4ac95e5e-3611-42b2-a3b0-a4e6bf8b213d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:18:23 devstack sudo[85117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 12:18:23 devstack sudo[85117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:18:23 devstack sudo[85117]: pam_unix(sudo:session): session closed for user root Nov 01 12:18:23 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-4ac95e5e-3611-42b2-a3b0-a4e6bf8b213d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.251s {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:18:23 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-4ac95e5e-3611-42b2-a3b0-a4e6bf8b213d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:18:23 devstack sudo[85120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool Nov 01 12:18:23 devstack sudo[85120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:18:23 devstack sudo[85120]: pam_unix(sudo:session): session closed for user root Nov 01 12:18:23 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-4ac95e5e-3611-42b2-a3b0-a4e6bf8b213d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 0.250s {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:18:23 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-4ac95e5e-3611-42b2-a3b0-a4e6bf8b213d None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:18:23 devstack sudo[85124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 Nov 01 12:18:23 devstack sudo[85124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:18:23 devstack sudo[85124]: pam_unix(sudo:session): session closed for user root Nov 01 12:18:23 devstack cinder-volume[75654]: DEBUG oslo_concurrency.processutils [None req-4ac95e5e-3611-42b2-a3b0-a4e6bf8b213d None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 0.244s {{(pid=75654) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:18:23 devstack cinder-volume[75654]: DEBUG cinder.manager [None req-4ac95e5e-3611-42b2-a3b0-a4e6bf8b213d None None] Notifying Schedulers of capabilities ... {{(pid=75654) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:18:23 devstack cinder-volume[75654]: DEBUG oslo_service.periodic_task [None req-4ac95e5e-3611-42b2-a3b0-a4e6bf8b213d None None] Running periodic task VolumeManager._thread_info {{(pid=75654) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:18:23 devstack cinder-volume[75654]: DEBUG cinder.volume.manager [None req-4ac95e5e-3611-42b2-a3b0-a4e6bf8b213d None None] thread count: 6 {{(pid=75654) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 12:18:23 devstack cinder-volume[75654]: DEBUG cinder.volume.manager [None req-4ac95e5e-3611-42b2-a3b0-a4e6bf8b213d None None] thread info: [<_MainThread(MainThread, started 131970562736256)>, , , , , ] {{(pid=75654) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 12:18:39 devstack cinder-volume[75654]: DEBUG dbcounter [-] [75654] Writing DB stats cinder:SELECT=1 {{(pid=75654) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:18:39 devstack cinder-volume[75654]: DEBUG dbcounter [-] [75654] Writing DB stats cinder:UPDATE=1 {{(pid=75654) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:18:47 devstack cinder-volume[75499]: INFO oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] Caught SIGTERM, stopping children Nov 01 12:18:47 devstack cinder-volume[75499]: DEBUG oslo_concurrency.lockutils [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] Acquiring lock "singleton_lock" {{(pid=75499) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 01 12:18:47 devstack cinder-volume[75499]: DEBUG oslo_concurrency.lockutils [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] Acquired lock "singleton_lock" {{(pid=75499) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 01 12:18:47 devstack cinder-volume[75499]: DEBUG oslo_concurrency.lockutils [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] Releasing lock "singleton_lock" {{(pid=75499) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 01 12:18:47 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] Stop services. {{(pid=75499) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 01 12:18:47 devstack cinder-volume[75499]: DEBUG oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] Killing children. {{(pid=75499) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 01 12:18:47 devstack cinder-volume[75499]: INFO oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] Waiting on 1 children to exit Nov 01 12:18:48 devstack cinder-volume[75654]: DEBUG oslo_concurrency.lockutils [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] Acquiring lock "singleton_lock" {{(pid=75654) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 01 12:18:48 devstack cinder-volume[75654]: DEBUG oslo_concurrency.lockutils [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] Acquired lock "singleton_lock" {{(pid=75654) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 01 12:18:48 devstack cinder-volume[75654]: DEBUG oslo_concurrency.lockutils [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] Releasing lock "singleton_lock" {{(pid=75654) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 01 12:18:48 devstack cinder-volume[75654]: WARNING amqp [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 01 12:18:48 devstack cinder-volume[75654]: WARNING amqp [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 01 12:18:48 devstack cinder-volume[75499]: INFO oslo_service.backend._eventlet.service [None req-92af1f11-7744-4c92-ac71-7a5ce816b429 None None] Child 75654 exited with status 0 Nov 01 12:18:49 devstack cinder-volume[85730]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 01 12:18:49 devstack cinder-volume[85730]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 01 12:18:49 devstack cinder-volume[85730]: we strongly recommend against using it for new projects. Nov 01 12:18:49 devstack cinder-volume[85730]: If you are already using Eventlet, we recommend migrating to a different Nov 01 12:18:49 devstack cinder-volume[85730]: framework. For more detail see Nov 01 12:18:49 devstack cinder-volume[85730]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 01 12:18:49 devstack cinder-volume[85730]: import eventlet # noqa Nov 01 12:18:51 devstack cinder-volume[85730]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=85730) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 01 12:18:51 devstack cinder-volume[85730]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=85730) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 01 12:18:51 devstack cinder-volume[85730]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=85730) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 01 12:18:51 devstack cinder-volume[85730]: INFO dbcounter [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] Registered counter for database cinder Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_db.sqlalchemy.engines [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85730) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG dbcounter [-] [85730] Writer thread running {{(pid=85730) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 01 12:18:52 devstack cinder-volume[85730]: INFO cinder.rpc [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 01 12:18:52 devstack cinder-volume[85730]: INFO cinder.rpc [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_db.sqlalchemy.engines [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85730) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 01 12:18:52 devstack cinder-volume[85730]: INFO cinder.volume.manager [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] Determined volume DB was empty at startup. Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG cinder.volume.manager [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] Cinder Volume DB check: vol_db_empty=True {{(pid=85730) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 01 12:18:52 devstack cinder-volume[85730]: INFO cinder.volume.manager [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] Service not found for updating active_backend_id, assuming default for driver init. Nov 01 12:18:52 devstack cinder-volume[85730]: WARNING stevedore.named [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 01 12:18:52 devstack cinder-volume[85730]: WARNING castellan.key_manager [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 01 12:18:52 devstack cinder-volume[85730]: WARNING cinder.keymgr.conf_key_mgr [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 01 12:18:52 devstack cinder-volume[85730]: INFO cinder.volume.manager [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_db.sqlalchemy.engines [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85730) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 01 12:18:52 devstack cinder-volume[85730]: INFO oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] Starting 1 workers Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] Started child 85946 {{(pid=85730) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] Full set of CONF: {{(pid=85730) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] ******************************************************************************** {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] Configuration options gathered from: {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] ================================================================================ {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] allow_availability_zone_fallback = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85946]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] allow_compression_on_image_upload = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] allowed_direct_url_schemes = [] {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] api_rate_limit = True {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] auth_strategy = keystone {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_availability_zone = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_host = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_name = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_stats_polling_interval = 60 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backup_api_class = cinder.backup.api.API {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backup_name_template = backup-%s {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backup_use_same_host = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backup_use_temp_snapshot = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] chap_password = **** {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] chap_username = {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] cinder_internal_tenant_project_id = 3284b3c9dbe2488992ca897e28f0aaa0 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] cinder_internal_tenant_user_id = 43e618bbd979401d996616b44e913181 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] cluster = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] compression_format = gzip {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] compute_api_class = cinder.compute.nova.API {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] config_dir = [] {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] config_source = [] {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] control_exchange = openstack {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] debug = True {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] default_availability_zone = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] default_group_type = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] default_volume_type = QuobyteHD {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] disk_geometry = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] driver_client_cert = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] driver_client_cert_key = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] driver_data_namespace = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] driver_ssl_cert_path = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] driver_ssl_cert_verify = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] driver_use_ssl = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] enable_new_services = True {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] enable_unsupported_driver = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] enabled_backends = ['QuobyteHD'] {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] enforce_multipath_for_image_xfer = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] filter_function = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] glance_api_insecure = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] glance_api_servers = ['http://192.168.122.20/image'] {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] glance_api_ssl_compression = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] glance_ca_certificates_file = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] glance_catalog_info = image:glance:publicURL {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] glance_certfile = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] glance_keyfile = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] glance_num_retries = 3 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] glance_request_timeout = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] goodness_function = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] graceful_shutdown_timeout = 5 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] group_api_class = cinder.group.api.API {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] host = devstack {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] image_compress_on_upload = True {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] image_conversion_address_space_limit = 1 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] image_conversion_cpu_limit = 60 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] image_conversion_disable = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] image_introspection_address_space_limit = 1 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] image_introspection_cpu_limit = 60 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] image_upload_use_cinder_backend = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] image_upload_use_internal_tenant = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] image_volume_cache_enabled = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] image_volume_cache_max_count = 0 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] image_volume_cache_max_size_gb = 0 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] init_host_max_objects_retrieval = 0 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] instance_format = [instance: %(uuid)s] {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] iscsi_target_flags = {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] iscsi_write_cache = on {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] iser_helper = tgtadm {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] iser_ip_address = 192.168.122.20 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] iser_port = 3260 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] log_color = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] log_config_append = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] log_dir = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] log_file = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] log_options = True {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] log_rotate_interval = 1 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] log_rotate_interval_type = days {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] log_rotation_type = none {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85946]: INFO cinder.volume.manager [None req-2dec51b6-57aa-4613-ab8d-68b428013c65 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 01 12:18:52 devstack cinder-volume[85946]: DEBUG cinder.volume.drivers.remotefs [None req-2dec51b6-57aa-4613-ab8d-68b428013c65 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=85946) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] max_age = 0 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] max_logfile_count = 30 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] max_logfile_size_mb = 200 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] max_over_subscription_ratio = 20.0 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] message_reap_interval = 86400 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] message_ttl = 2592000 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] migration_create_volume_timeout_secs = 300 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] monkey_patch = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] monkey_patch_modules = [] {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] my_ip = 192.168.122.20 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] no_snapshot_gb_quota = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] num_iser_scan_tries = 3 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] num_shell_tries = 3 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] num_volume_device_scan_tries = 3 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] nvmeof_conn_info_version = 1 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] nvmet_ns_id = 10 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] nvmet_port_id = 1 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] osapi_max_limit = 1000 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] osapi_volume_ext_list = [] {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] osapi_volume_listen = 0.0.0.0 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] osapi_volume_listen_port = 8776 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] osapi_volume_use_ssl = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] osapi_volume_workers = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] per_volume_size_limit = -1 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] periodic_fuzzy_delay = 60 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] periodic_interval = 60 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] project_id_regex = [0-9a-f\-]+ {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] public_endpoint = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] publish_errors = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] quota_backup_gigabytes = 1000 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] quota_backups = 10 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] quota_gigabytes = 1000 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] quota_groups = 10 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] quota_snapshots = 10 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] quota_volumes = 10 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] rate_limit_burst = 0 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] rate_limit_except_level = CRITICAL {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] rate_limit_interval = 0 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] reinit_driver_count = 3 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] replication_device = **** {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] report_discard_supported = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] report_interval = 120 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] reservation_clean_interval = 86400 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] reservation_expire = 86400 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] reserved_image_namespaces = [] {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] reserved_percentage = 0 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] rpc_response_timeout = 120 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] run_external_periodic_tasks = True {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] scst_target_driver = iscsi {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] scst_target_iqn_name = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] service_down_time = 720 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] shell_completion = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] snapshot_name_template = snapshot-%s {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] split_loggers = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] state_path = /opt/stack/data/cinder {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] storage_availability_zone = nova {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] storage_protocol = iSCSI {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] syslog_log_facility = LOG_USER {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] target_helper = lioadm {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] target_ip_address = 192.168.122.20 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] target_port = 3260 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] target_protocol = iscsi {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] target_secondary_ip_addresses = [] {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] trace_flags = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] transfer_api_class = cinder.transfer.api.API {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] transport_url = **** {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] until_refresh = 0 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] use_chap_auth = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] use_default_quota_class = True {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] use_journal = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] use_json = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] use_multipath_for_image_xfer = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] use_stderr = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] use_syslog = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] verify_glance_signatures = enabled {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] volume_api_class = cinder.volume.api.API {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] volume_backend_name = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] volume_clear = zero {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] volume_clear_ionice = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] volume_clear_size = 0 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] volume_copy_bps_limit = 0 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] volume_dd_blocksize = 1M {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] volume_name_template = volume-%s {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] volume_service_inithost_offload = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] volume_usage_audit_period = month {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] zoning_mode = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_concurrency.disable_process_locking = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] os_brick.lightos_discovery_client_address = localhost {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] os_brick.wait_mpath_device_interval = 1 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] keystone_authtoken.auth_section = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] keystone_authtoken.auth_type = password {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] keystone_authtoken.auth_version = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] keystone_authtoken.cache = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] keystone_authtoken.certfile = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] keystone_authtoken.delay_auth_decision = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] keystone_authtoken.http_connect_timeout = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] keystone_authtoken.include_service_catalog = True {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] keystone_authtoken.insecure = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] keystone_authtoken.interface = public {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] keystone_authtoken.keyfile = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] keystone_authtoken.memcache_password = **** {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] keystone_authtoken.memcache_secret_key = **** {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] keystone_authtoken.memcache_security_strategy = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] keystone_authtoken.memcache_username = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] keystone_authtoken.region_name = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] keystone_authtoken.service_token_roles_required = True {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] keystone_authtoken.service_type = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] keystone_authtoken.token_cache_time = 300 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.20/identity {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] cache.backend = dogpile.cache.null {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] cache.backend_argument = **** {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] cache.backend_expiration_time = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] cache.config_prefix = cache.oslo {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] cache.debug_cache_backend = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] cache.enable_retry_client = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] cache.enable_socket_keepalive = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] cache.enabled = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] cache.expiration_time = 600 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] cache.hashclient_dead_timeout = 60.0 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] cache.hashclient_retry_attempts = 2 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] cache.hashclient_retry_timeout = 1.0 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] cache.memcache_dead_retry = 300 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] cache.memcache_pool_maxsize = 10 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] cache.memcache_pool_unused_timeout = 60 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] cache.memcache_sasl_enabled = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] cache.memcache_servers = ['localhost:11211'] {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] cache.password = **** {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] cache.proxies = [] {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] cache.redis_db = 0 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] cache.redis_sentinel_service_name = mymaster {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] cache.redis_server = localhost:6379 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] cache.retry_attempts = 2 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] cache.retry_delay = 0.0 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] cache.socket_keepalive_count = 1 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] cache.socket_keepalive_idle = 1 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] cache.socket_keepalive_interval = 1 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] cache.socket_timeout = 1.0 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] cache.tls_allowed_ciphers = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] cache.tls_cafile = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] cache.tls_certfile = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] cache.tls_enabled = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] cache.tls_keyfile = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] cache.username = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] coordination.backend_url = **** {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] database.asyncio_connection = **** {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] database.asyncio_slave_connection = **** {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] database.backend = sqlalchemy {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] database.connection = **** {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] database.connection_debug = 0 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] database.connection_parameters = {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] database.connection_recycle_time = 3600 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] database.connection_trace = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] database.db_inc_retry_interval = True {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] database.db_max_retries = 20 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] database.db_max_retry_interval = 10 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] database.db_retry_interval = 1 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] database.max_overflow = 50 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] database.max_pool_size = 5 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] database.max_retries = 10 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] database.mysql_sql_mode = TRADITIONAL {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] database.mysql_wsrep_sync_wait = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] database.pool_timeout = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85946]: DEBUG cinder.volume.drivers.quobyte [None req-2dec51b6-57aa-4613-ab8d-68b428013c65 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=85946) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] database.retry_interval = 10 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85946]: WARNING cinder.volume.drivers.quobyte [None req-2dec51b6-57aa-4613-ab8d-68b428013c65 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 01 12:18:52 devstack cinder-volume[85946]: WARNING cinder.volume.drivers.quobyte [None req-2dec51b6-57aa-4613-ab8d-68b428013c65 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] database.slave_connection = **** {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] database.sqlite_synchronous = True {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] database.synchronous_reader = True {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] database.use_db_reconnect = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_messaging_metrics.metrics_process_name = {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_messaging_tracing.insecure = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85946]: DEBUG oslo_concurrency.processutils [None req-2dec51b6-57aa-4613-ab8d-68b428013c65 None None] Running cmd (subprocess): mount.quobyte {{(pid=85946) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] profiler.connection_string = messaging:// {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] profiler.enabled = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] profiler.es_doc_type = notification {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] profiler.es_scroll_size = 10000 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] profiler.es_scroll_time = 2m {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] profiler.filter_error_trace = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] profiler.hmac_keys = **** {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] profiler.sentinel_service_name = mymaster {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] profiler.socket_timeout = 0.1 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] profiler.trace_requests = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] profiler.trace_sqlalchemy = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] profiler_jaeger.process_tags = {} {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] profiler_jaeger.service_name_prefix = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] profiler_otlp.service_name_prefix = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_policy.enforce_new_defaults = True {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_policy.policy_default_rule = default {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_policy.policy_file = policy.yaml {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_policy.remote_timeout = 60.0 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] privsep_osbrick.capabilities = [21, 2] {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] privsep_osbrick.group = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] privsep_osbrick.helper_command = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] privsep_osbrick.log_daemon_traceback = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] privsep_osbrick.thread_pool_size = 4 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] privsep_osbrick.user = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] cinder_sys_admin.group = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] cinder_sys_admin.helper_command = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] cinder_sys_admin.user = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] service_user.auth_section = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] service_user.auth_type = password {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] service_user.cafile = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] service_user.certfile = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] service_user.collect_timing = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] service_user.insecure = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] service_user.keyfile = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] service_user.send_service_user_token = True {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] service_user.split_loggers = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] service_user.timeout = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] service_user.tls_ciphers = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] service_user.tls_min_version = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] glance.auth_section = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] glance.auth_type = password {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:52 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] glance.certfile = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] glance.collect_timing = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] glance.insecure = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] glance.keyfile = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] glance.region_name = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] glance.split_loggers = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] glance.timeout = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] glance.tls_ciphers = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] glance.tls_min_version = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.backend_availability_zone = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.chap_password = **** {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.chap_username = {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.disk_geometry = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.driver_client_cert = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.driver_client_cert_key = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.driver_data_namespace = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.driver_ssl_cert_path = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.driver_use_ssl = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.enable_unsupported_driver = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.extra_capabilities = {} {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.filter_function = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.goodness_function = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.image_volume_cache_enabled = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.iscsi_target_flags = {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.iscsi_write_cache = on {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.iser_helper = tgtadm {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.iser_ip_address = 192.168.122.20 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.iser_port = 3260 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.nas_host = {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.nas_login = admin {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.nas_mount_options = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.nas_password = **** {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.nas_private_key = {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.nas_secure_file_operations = auto {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.nas_share_path = {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.nas_ssh_port = 22 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.nas_volume_prov_type = thin {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.num_shell_tries = 3 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.nvmet_ns_id = 10 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.nvmet_port_id = 1 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.quobyte_client_cfg = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.quobyte_volume_url = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.replication_device = **** {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.report_discard_supported = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.reserved_percentage = 0 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.scst_target_driver = iscsi {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.scst_target_iqn_name = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.storage_protocol = iSCSI {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.target_helper = tgtadm {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.target_ip_address = 192.168.122.20 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.target_port = 3260 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack quobyte-client[85947]: Reading configuration file: /etc/quobyte/client.cfg Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.target_protocol = iscsi {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.trace_flags = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.unique_fqdn_network = True {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack quobyte-client[85947]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.use_chap_auth = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.volume_backend_name = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.volume_clear = zero {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.volume_clear_ionice = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.volume_clear_size = 0 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85946]: DEBUG oslo_concurrency.processutils [None req-2dec51b6-57aa-4613-ab8d-68b428013c65 None None] CMD "mount.quobyte" returned: 1 in 0.149s {{(pid=85946) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:18:53 devstack cinder-volume[85946]: DEBUG oslo_concurrency.lockutils [None req-2dec51b6-57aa-4613-ab8d-68b428013c65 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85946) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:18:53 devstack cinder-volume[85946]: DEBUG oslo_concurrency.lockutils [None req-2dec51b6-57aa-4613-ab8d-68b428013c65 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85946) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:18:53 devstack cinder-volume[85946]: DEBUG cinder.volume.drivers.quobyte [None req-2dec51b6-57aa-4613-ab8d-68b428013c65 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=85946) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_reports.file_event_handler = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_reports.file_event_handler_interval = 1 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_reports.log_dir = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.backend_availability_zone = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85946]: INFO cinder.volume.drivers.quobyte [None req-2dec51b6-57aa-4613-ab8d-68b428013c65 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb ... Nov 01 12:18:53 devstack cinder-volume[85946]: DEBUG oslo_concurrency.processutils [None req-2dec51b6-57aa-4613-ab8d-68b428013c65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa -c /etc/quobyte/client-cinder.cfg {{(pid=85946) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.backend_host = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.chap_password = **** {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.chap_username = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.chiscsi_conf = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.disk_geometry = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.driver_client_cert = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.driver_client_cert_key = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.driver_data_namespace = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.driver_use_ssl = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.enable_unsupported_driver = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.extra_capabilities = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.filter_function = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.goodness_function = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.iscsi_target_flags = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.iscsi_write_cache = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.iser_helper = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.iser_ip_address = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.iser_port = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.iser_target_prefix = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.nas_host = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.nas_login = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.nas_mount_options = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.nas_password = **** {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.nas_private_key = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.nas_secure_file_operations = false {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.nas_share_path = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.nas_ssh_port = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.nas_volume_prov_type = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.num_iser_scan_tries = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.num_shell_tries = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.nvmet_ns_id = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.nvmet_port_id = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.replication_device = **** {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.report_discard_supported = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.reserved_percentage = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.scst_target_driver = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.scst_target_iqn_name = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.storage_protocol = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.target_helper = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.target_ip_address = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.target_port = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.target_prefix = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.target_protocol = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.trace_flags = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.unique_fqdn_network = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.use_chap_auth = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.volume_clear = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.volume_clear_ionice = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.volume_clear_size = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.volume_dd_blocksize = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] QuobyteHD.volumes_dir = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_messaging_rabbit.hostname = devstack {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack sudo[85952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa -c /etc/quobyte/client-cinder.cfg Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack sudo[85952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_messaging_rabbit.ssl = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_messaging_rabbit.ssl_version = {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_messaging_notifications.driver = [] {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_messaging_notifications.retry = -1 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] oslo_messaging_notifications.transport_url = **** {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] key_manager.fixed_key = **** {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] barbican.barbican_api_version = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] barbican.barbican_endpoint = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] barbican.barbican_endpoint_type = public {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] barbican.barbican_region_name = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] barbican.cafile = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] barbican.certfile = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] barbican.collect_timing = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] barbican.insecure = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] barbican.keyfile = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] barbican.number_of_retries = 60 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] barbican.retry_delay = 1 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] barbican.send_service_user_token = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] barbican.split_loggers = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] barbican.timeout = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] barbican.tls_ciphers = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] barbican.tls_min_version = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] barbican.verify_ssl = True {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] barbican.verify_ssl_path = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] barbican_service_user.auth_section = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] barbican_service_user.auth_type = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] barbican_service_user.cafile = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] barbican_service_user.certfile = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] barbican_service_user.collect_timing = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] barbican_service_user.insecure = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] barbican_service_user.keyfile = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] barbican_service_user.split_loggers = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] barbican_service_user.timeout = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] barbican_service_user.tls_ciphers = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] barbican_service_user.tls_min_version = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] vault.approle_role_id = **** {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] vault.approle_secret_id = **** {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] vault.auth_method = approle {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] vault.auth_path = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] vault.kv_mountpoint = secret {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] vault.kv_path = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] vault.kv_version = 2 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] vault.namespace = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] vault.root_token_id = **** {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] vault.ssl_ca_crt_file = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] vault.timeout = 60.0 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] vault.token_file = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] vault.token_role = None {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] vault.use_ssl = False {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:18:53 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] ******************************************************************************** {{(pid=85730) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 01 12:18:53 devstack sudo[85952]: pam_unix(sudo:session): session closed for user root Nov 01 12:18:53 devstack cinder-volume[85946]: DEBUG oslo_concurrency.processutils [None req-2dec51b6-57aa-4613-ab8d-68b428013c65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf mount.quobyte --disable-xattrs osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa -c /etc/quobyte/client-cinder.cfg" returned: 0 in 0.455s {{(pid=85946) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:18:53 devstack cinder-volume[85946]: INFO cinder.volume.drivers.quobyte [None req-2dec51b6-57aa-4613-ab8d-68b428013c65 None None] Mounting volume: osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb succeeded Nov 01 12:18:53 devstack cinder-volume[85946]: DEBUG cinder.volume.drivers.quobyte [None req-2dec51b6-57aa-4613-ab8d-68b428013c65 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=85946) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:18:53 devstack cinder-volume[85946]: DEBUG oslo_concurrency.lockutils [None req-2dec51b6-57aa-4613-ab8d-68b428013c65 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.472s {{(pid=85946) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:18:53 devstack cinder-volume[85946]: DEBUG oslo_concurrency.processutils [None req-2dec51b6-57aa-4613-ab8d-68b428013c65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=85946) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:18:53 devstack sudo[86054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:18:53 devstack sudo[86054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:18:53 devstack sudo[86054]: pam_unix(sudo:session): session closed for user root Nov 01 12:18:53 devstack cinder-volume[85946]: DEBUG oslo_concurrency.processutils [None req-2dec51b6-57aa-4613-ab8d-68b428013c65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.244s {{(pid=85946) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:18:53 devstack cinder-volume[85946]: INFO cinder.volume.driver [None req-2dec51b6-57aa-4613-ab8d-68b428013c65 None None] Driver hasn't implemented _init_vendor_properties() Nov 01 12:18:53 devstack cinder-volume[85946]: DEBUG cinder.volume.driver [None req-2dec51b6-57aa-4613-ab8d-68b428013c65 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.9067420959473, 'free_capacity_gb': 1773.9067420959473, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=85946) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 01 12:18:53 devstack cinder-volume[85946]: DEBUG oslo_db.sqlalchemy.engines [None req-2dec51b6-57aa-4613-ab8d-68b428013c65 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=85946) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 01 12:18:53 devstack cinder-volume[85946]: DEBUG dbcounter [-] [85946] Writer thread running {{(pid=85946) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 01 12:18:53 devstack cinder-volume[85946]: DEBUG cinder.db.api [None req-2dec51b6-57aa-4613-ab8d-68b428013c65 None None] Building query based on filter {{(pid=85946) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 01 12:18:53 devstack cinder-volume[85946]: DEBUG cinder.image.image_utils [None req-2dec51b6-57aa-4613-ab8d-68b428013c65 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=85946) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 01 12:18:53 devstack cinder-volume[85946]: INFO cinder.keymgr.migration [None req-0c840511-1323-46e1-876e-89ec400bf530 None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 01 12:18:53 devstack cinder-volume[85946]: DEBUG oslo_concurrency.lockutils [None req-2dec51b6-57aa-4613-ab8d-68b428013c65 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85946) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:18:53 devstack cinder-volume[85946]: DEBUG oslo_concurrency.lockutils [None req-2dec51b6-57aa-4613-ab8d-68b428013c65 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85946) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:18:53 devstack cinder-volume[85946]: DEBUG cinder.volume.drivers.quobyte [None req-2dec51b6-57aa-4613-ab8d-68b428013c65 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=85946) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:18:53 devstack cinder-volume[85946]: DEBUG cinder.volume.drivers.quobyte [None req-2dec51b6-57aa-4613-ab8d-68b428013c65 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=85946) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:18:53 devstack cinder-volume[85946]: DEBUG oslo_concurrency.lockutils [None req-2dec51b6-57aa-4613-ab8d-68b428013c65 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=85946) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:18:53 devstack cinder-volume[85946]: DEBUG oslo_concurrency.processutils [None req-2dec51b6-57aa-4613-ab8d-68b428013c65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=85946) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:18:53 devstack sudo[86057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:18:53 devstack sudo[86057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:18:54 devstack sudo[86057]: pam_unix(sudo:session): session closed for user root Nov 01 12:18:54 devstack cinder-volume[85946]: DEBUG oslo_concurrency.processutils [None req-2dec51b6-57aa-4613-ab8d-68b428013c65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.229s {{(pid=85946) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:18:54 devstack cinder-volume[85946]: DEBUG cinder.manager [None req-2dec51b6-57aa-4613-ab8d-68b428013c65 None None] Notifying Schedulers of capabilities ... {{(pid=85946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:18:54 devstack cinder-volume[85946]: INFO cinder.volume.manager [None req-2dec51b6-57aa-4613-ab8d-68b428013c65 None None] Driver initialization completed successfully. Nov 01 12:18:54 devstack cinder-volume[85946]: INFO cinder.manager [None req-2dec51b6-57aa-4613-ab8d-68b428013c65 None None] Initiating service 3 cleanup Nov 01 12:18:54 devstack cinder-volume[85946]: INFO cinder.manager [None req-2dec51b6-57aa-4613-ab8d-68b428013c65 None None] Service 3 cleanup completed. Nov 01 12:18:54 devstack cinder-volume[85946]: DEBUG cinder.service [None req-2dec51b6-57aa-4613-ab8d-68b428013c65 None None] Creating RPC server for service cinder-volume {{(pid=85946) start /opt/stack/cinder/cinder/service.py:231}} Nov 01 12:18:54 devstack cinder-volume[85946]: DEBUG cinder.service [None req-2dec51b6-57aa-4613-ab8d-68b428013c65 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=85946) start /opt/stack/cinder/cinder/service.py:237}} Nov 01 12:18:54 devstack cinder-volume[85946]: INFO cinder.volume.manager [None req-2dec51b6-57aa-4613-ab8d-68b428013c65 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 01 12:18:54 devstack cinder-volume[85946]: DEBUG oslo_concurrency.lockutils [None req-2dec51b6-57aa-4613-ab8d-68b428013c65 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85946) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:18:54 devstack cinder-volume[85946]: DEBUG oslo_concurrency.lockutils [None req-2dec51b6-57aa-4613-ab8d-68b428013c65 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=85946) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:18:54 devstack cinder-volume[85946]: DEBUG cinder.volume.drivers.quobyte [None req-2dec51b6-57aa-4613-ab8d-68b428013c65 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=85946) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:18:54 devstack cinder-volume[85946]: DEBUG cinder.volume.drivers.quobyte [None req-2dec51b6-57aa-4613-ab8d-68b428013c65 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=85946) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:18:54 devstack cinder-volume[85946]: DEBUG oslo_concurrency.lockutils [None req-2dec51b6-57aa-4613-ab8d-68b428013c65 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=85946) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:18:54 devstack cinder-volume[85946]: DEBUG oslo_concurrency.processutils [None req-2dec51b6-57aa-4613-ab8d-68b428013c65 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=85946) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:18:54 devstack sudo[86060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:18:54 devstack sudo[86060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:18:54 devstack sudo[86060]: pam_unix(sudo:session): session closed for user root Nov 01 12:18:54 devstack cinder-volume[85946]: DEBUG oslo_concurrency.processutils [None req-2dec51b6-57aa-4613-ab8d-68b428013c65 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.257s {{(pid=85946) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:18:54 devstack cinder-volume[85946]: INFO cinder.volume.manager [None req-2dec51b6-57aa-4613-ab8d-68b428013c65 None None] Driver post RPC initialization completed successfully. Nov 01 12:18:59 devstack cinder-volume[85946]: DEBUG oslo_concurrency.lockutils [None req-6283af6b-b3ca-4f2a-a018-c7c8939bb0c4 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=85946) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:18:59 devstack cinder-volume[85946]: DEBUG oslo_concurrency.lockutils [None req-6283af6b-b3ca-4f2a-a018-c7c8939bb0c4 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=85946) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:18:59 devstack cinder-volume[85946]: DEBUG cinder.volume.drivers.quobyte [None req-6283af6b-b3ca-4f2a-a018-c7c8939bb0c4 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=85946) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:18:59 devstack cinder-volume[85946]: DEBUG cinder.volume.drivers.quobyte [None req-6283af6b-b3ca-4f2a-a018-c7c8939bb0c4 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=85946) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:18:59 devstack cinder-volume[85946]: DEBUG oslo_concurrency.lockutils [None req-6283af6b-b3ca-4f2a-a018-c7c8939bb0c4 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=85946) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:18:59 devstack cinder-volume[85946]: DEBUG oslo_concurrency.processutils [None req-6283af6b-b3ca-4f2a-a018-c7c8939bb0c4 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=85946) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:18:59 devstack sudo[86211]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:18:59 devstack sudo[86211]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:18:59 devstack cinder-volume[85730]: INFO oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] Caught SIGTERM, stopping children Nov 01 12:18:59 devstack cinder-volume[85730]: DEBUG oslo_concurrency.lockutils [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] Acquiring lock "singleton_lock" {{(pid=85730) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 01 12:18:59 devstack cinder-volume[85730]: DEBUG oslo_concurrency.lockutils [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] Acquired lock "singleton_lock" {{(pid=85730) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 01 12:18:59 devstack cinder-volume[85730]: DEBUG oslo_concurrency.lockutils [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] Releasing lock "singleton_lock" {{(pid=85730) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 01 12:18:59 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] Stop services. {{(pid=85730) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:611}} Nov 01 12:18:59 devstack cinder-volume[85730]: DEBUG oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] Killing children. {{(pid=85730) stop /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:616}} Nov 01 12:18:59 devstack cinder-volume[85730]: INFO oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] Waiting on 1 children to exit Nov 01 12:18:59 devstack sudo[86211]: pam_unix(sudo:session): session closed for user root Nov 01 12:18:59 devstack cinder-volume[85946]: DEBUG oslo_concurrency.processutils [None req-6283af6b-b3ca-4f2a-a018-c7c8939bb0c4 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.285s {{(pid=85946) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:18:59 devstack cinder-volume[85946]: DEBUG cinder.manager [None req-6283af6b-b3ca-4f2a-a018-c7c8939bb0c4 None None] Notifying Schedulers of capabilities ... {{(pid=85946) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6283af6b-b3ca-4f2a-a018-c7c8939bb0c4 None None] Failed to publish message to topic 'cinder-scheduler_fanout': Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo.messaging._drivers.impl_rabbit [None req-6283af6b-b3ca-4f2a-a018-c7c8939bb0c4 None None] Unable to connect to AMQP server on 192.168.122.20:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/': amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server [None req-6283af6b-b3ca-4f2a-a018-c7c8939bb0c4 None None] Exception during message handling: oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.20:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1109, in ensure Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server ret, channel = autoretry_method() Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^ Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 558, in _ensured Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server return fun(*args, **kwargs) Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^ Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/connection.py", line 641, in __call__ Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server return fun(*args, channel=channels[0], **kwargs), channels[0] Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1098, in execute_method Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server method() Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1575, in _publish Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server self._producer.publish( Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 190, in publish Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server return _publish( Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server ^^^^^^^^^ Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/kombu/messaging.py", line 214, in _publish Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server return channel.basic_publish( Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 1820, in basic_publish_confirm Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server self.wait([spec.Basic.Ack, spec.Basic.Nack], Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 99, in wait Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server self.connection.drain_events(timeout=timeout) Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 526, in drain_events Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server while not self.blocking_read(timeout): Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 532, in blocking_read Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server return self.on_inbound_frame(frame) Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/method_framing.py", line 53, in on_frame Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server callback(channel, method_sig, buf, None) Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/connection.py", line 538, in on_inbound_method Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server return self.channels[channel_id].dispatch_method( Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/abstract_channel.py", line 156, in dispatch_method Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server listener(*args) Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/amqp/channel.py", line 293, in _on_close Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server raise error_for_code( Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server amqp.exceptions.NotFound: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server During handling of the above exception, another exception occurred: Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server Traceback (most recent call last): Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/server.py", line 176, in _process_incoming Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server res = self.dispatcher.dispatch(message) Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 309, in dispatch Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server return self._do_dispatch(endpoint, method, ctxt, args) Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/dispatcher.py", line 229, in _do_dispatch Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server result = func(ctxt, **new_args) Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^ Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/volume/manager.py", line 2906, in publish_service_capabilities Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server self._publish_service_capabilities(context) Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/manager.py", line 220, in _publish_service_capabilities Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server self.scheduler_rpcapi.update_service_capabilities( Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server File "/opt/stack/cinder/cinder/scheduler/rpcapi.py", line 222, in update_service_capabilities Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server cctxt.cast(ctxt, 'update_service_capabilities', **msg_args) Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/rpc/client.py", line 161, in cast Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server self.transport._send( Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/transport.py", line 123, in _send Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server return self._driver.send(target, ctxt, message, Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 824, in send Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server return self._send(target, ctxt, message, wait_for_reply, timeout, Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^ Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/amqpdriver.py", line 799, in _send Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server conn.fanout_send(target.topic, msg, retry=retry) Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1694, in fanout_send Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server self._ensure_publishing(self._publish, exchange, msg, retry=retry) Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1524, in _ensure_publishing Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server self.ensure(method, retry=retry, error_callback=_error_callback) Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server File "/opt/stack/data/venv/lib/python3.12/site-packages/oslo_messaging/_drivers/impl_rabbit.py", line 1135, in ensure Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server raise exceptions.MessageDeliveryFailure(msg) Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server oslo_messaging.exceptions.MessageDeliveryFailure: Unable to connect to AMQP server on 192.168.122.20:5672 after inf tries: Basic.publish: (404) NOT_FOUND - no exchange 'cinder-scheduler_fanout' in vhost '/' Nov 01 12:18:59 devstack cinder-volume[85946]: ERROR oslo_messaging.rpc.server Nov 01 12:19:02 devstack cinder-volume[85946]: DEBUG oslo_concurrency.lockutils [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] Acquiring lock "singleton_lock" {{(pid=85946) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 01 12:19:02 devstack cinder-volume[85946]: DEBUG oslo_concurrency.lockutils [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] Acquired lock "singleton_lock" {{(pid=85946) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 01 12:19:02 devstack cinder-volume[85946]: DEBUG oslo_concurrency.lockutils [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] Releasing lock "singleton_lock" {{(pid=85946) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 01 12:19:02 devstack cinder-volume[85946]: WARNING amqp [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 01 12:19:02 devstack cinder-volume[85946]: WARNING amqp [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] Received method (60, 30) during closing channel 1. This method will be ignored Nov 01 12:19:02 devstack cinder-volume[85730]: INFO oslo_service.backend._eventlet.service [None req-529a8d2b-3f88-489d-ad41-7b9f6a4bda4a None None] Child 85946 exited with status 0 Nov 01 12:19:03 devstack cinder-volume[86264]: /opt/stack/cinder/cinder/__init__.py:21: EventletDeprecationWarning: Nov 01 12:19:03 devstack cinder-volume[86264]: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 01 12:19:03 devstack cinder-volume[86264]: we strongly recommend against using it for new projects. Nov 01 12:19:03 devstack cinder-volume[86264]: If you are already using Eventlet, we recommend migrating to a different Nov 01 12:19:03 devstack cinder-volume[86264]: framework. For more detail see Nov 01 12:19:03 devstack cinder-volume[86264]: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 01 12:19:03 devstack cinder-volume[86264]: import eventlet # noqa Nov 01 12:19:06 devstack cinder-volume[86264]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=86264) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:396}} Nov 01 12:19:06 devstack cinder-volume[86264]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=86264) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:399}} Nov 01 12:19:06 devstack cinder-volume[86264]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=86264) lock /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:419}} Nov 01 12:19:07 devstack cinder-volume[86264]: INFO dbcounter [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] Registered counter for database cinder Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_db.sqlalchemy.engines [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86264) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG dbcounter [-] [86264] Writer thread running {{(pid=86264) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 01 12:19:07 devstack cinder-volume[86264]: INFO cinder.rpc [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version. Nov 01 12:19:07 devstack cinder-volume[86264]: INFO cinder.rpc [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version. Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_db.sqlalchemy.engines [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86264) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 01 12:19:07 devstack cinder-volume[86264]: INFO cinder.volume.manager [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] Determined volume DB was empty at startup. Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG cinder.volume.manager [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] Cinder Volume DB check: vol_db_empty=True {{(pid=86264) __init__ /opt/stack/cinder/cinder/volume/manager.py:289}} Nov 01 12:19:07 devstack cinder-volume[86264]: WARNING stevedore.named [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager Nov 01 12:19:07 devstack cinder-volume[86264]: WARNING castellan.key_manager [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 01 12:19:07 devstack cinder-volume[86264]: WARNING cinder.keymgr.conf_key_mgr [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager' Nov 01 12:19:07 devstack cinder-volume[86264]: INFO cinder.volume.manager [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] Image-volume cache disabled for host devstack@QuobyteHD. Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_db.sqlalchemy.engines [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86264) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 01 12:19:07 devstack cinder-volume[86264]: INFO oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] Starting 1 workers Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] Started child 86574 {{(pid=86264) _start_child /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:491}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] Full set of CONF: {{(pid=86264) wait /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/backend/_eventlet/service.py:565}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] ******************************************************************************** {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3533}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] Configuration options gathered from: {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3534}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3535}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3536}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] ================================================================================ {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3541}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] allow_availability_zone_fallback = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] allow_compression_on_image_upload = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] allowed_direct_url_schemes = [] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] api_rate_limit = True {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] auth_strategy = keystone {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_availability_zone = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_host = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_name = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_stats_polling_interval = 60 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backup_api_class = cinder.backup.api.API {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backup_manager = cinder.backup.manager.BackupManager {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backup_name_template = backup-%s {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backup_use_same_host = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86574]: INFO cinder.service [-] Starting cinder-volume node (version 29.0.1) Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backup_use_temp_snapshot = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] chap_password = **** {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] chap_username = {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] cinder_internal_tenant_project_id = 3284b3c9dbe2488992ca897e28f0aaa0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] cinder_internal_tenant_user_id = 43e618bbd979401d996616b44e913181 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] cluster = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] compression_format = gzip {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] compute_api_class = cinder.compute.nova.API {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] config_dir = [] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] config_file = ['/etc/cinder/cinder.conf'] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] config_source = [] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] consistencygroup_api_class = cinder.consistencygroup.api.API {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] control_exchange = openstack {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] debug = True {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] default_availability_zone = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] default_group_type = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] default_log_levels = ['amqp=WARN', 'boto=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] default_volume_type = QuobyteHD {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] disk_geometry = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] driver_client_cert = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] driver_client_cert_key = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] driver_data_namespace = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] driver_ssl_cert_path = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] driver_ssl_cert_verify = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] driver_use_ssl = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] enable_new_services = True {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] enable_unsupported_driver = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] enabled_backends = ['QuobyteHD'] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] enforce_multipath_for_image_xfer = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] filter_function = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] glance_api_insecure = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] glance_api_servers = ['http://192.168.122.20/image'] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] glance_api_ssl_compression = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] glance_ca_certificates_file = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] glance_catalog_info = image:glance:publicURL {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] glance_certfile = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] glance_core_properties = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] glance_keyfile = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] glance_num_retries = 3 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] glance_request_timeout = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] goodness_function = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] graceful_shutdown_timeout = 5 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] group_api_class = cinder.group.api.API {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] host = devstack {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] image_compress_on_upload = True {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] image_conversion_address_space_limit = 1 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] image_conversion_cpu_limit = 60 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] image_conversion_dir = /opt/stack/data/cinder/conversion {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] image_conversion_disable = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] image_introspection_address_space_limit = 1 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] image_introspection_cpu_limit = 60 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] image_upload_use_cinder_backend = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] image_upload_use_internal_tenant = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] image_volume_cache_enabled = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] image_volume_cache_max_count = 0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] image_volume_cache_max_size_gb = 0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] init_host_max_objects_retrieval = 0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] instance_format = [instance: %(uuid)s] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] instance_uuid_format = [instance: %(uuid)s] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] iscsi_target_flags = {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] iscsi_write_cache = on {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] iser_helper = tgtadm {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] iser_ip_address = 192.168.122.20 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] iser_port = 3260 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] log_color = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] log_config_append = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] log_dir = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] log_file = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] log_options = True {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] log_rotate_interval = 1 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] log_rotate_interval_type = days {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] log_rotation_type = none {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] max_age = 0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] max_logfile_count = 30 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] max_logfile_size_mb = 200 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] max_over_subscription_ratio = 20.0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] message_reap_interval = 86400 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] message_ttl = 2592000 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] migration_create_volume_timeout_secs = 300 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] monkey_patch = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] monkey_patch_modules = [] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] my_ip = 192.168.122.20 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] no_snapshot_gb_quota = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] num_iser_scan_tries = 3 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] num_shell_tries = 3 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] num_volume_device_scan_tries = 3 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] nvmeof_conn_info_version = 1 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] nvmet_ns_id = 10 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] nvmet_port_id = 1 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] osapi_max_limit = 1000 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] osapi_volume_ext_list = [] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] osapi_volume_extension = ['cinder.api.contrib.standard_extensions'] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] osapi_volume_listen = 0.0.0.0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] osapi_volume_listen_port = 8776 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] osapi_volume_use_ssl = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] osapi_volume_workers = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] per_volume_size_limit = -1 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] periodic_fuzzy_delay = 60 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] periodic_interval = 60 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] project_id_regex = [0-9a-f\-]+ {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] public_endpoint = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] publish_errors = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] quota_backup_gigabytes = 1000 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] quota_backups = 10 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] quota_driver = cinder.quota.DbQuotaDriver {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] quota_gigabytes = 1000 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] quota_groups = 10 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] quota_snapshots = 10 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] quota_volumes = 10 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] rate_limit_burst = 0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] rate_limit_except_level = CRITICAL {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] rate_limit_interval = 0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] reinit_driver_count = 3 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-4a0a3c31-b607-40fa-b887-f40b8f8af140 None None] Starting volume driver QuobyteDriver (1.2.1) Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] replication_device = **** {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-4a0a3c31-b607-40fa-b887-f40b8f8af140 None None] NAS config: {'nas_secure_file_permissions': 'false', 'nas_secure_file_operations': 'false'} {{(pid=86574) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:225}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] report_discard_supported = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] report_interval = 120 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] reservation_clean_interval = 86400 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] reservation_expire = 86400 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] reserved_image_namespaces = [] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] reserved_percentage = 0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] resource_query_filters_file = /etc/cinder/resource_filters.json {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] rootwrap_config = /etc/cinder/rootwrap.conf {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] rpc_response_timeout = 120 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] run_external_periodic_tasks = True {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] scheduler_manager = cinder.scheduler.manager.SchedulerManager {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] scst_target_driver = iscsi {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] scst_target_iqn_name = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] service_down_time = 720 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] shell_completion = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] snapshot_name_template = snapshot-%s {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] split_loggers = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] state_path = /opt/stack/data/cinder {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] storage_availability_zone = nova {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] storage_protocol = iSCSI {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] syslog_log_facility = LOG_USER {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] target_helper = lioadm {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] target_ip_address = 192.168.122.20 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] target_port = 3260 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] target_prefix = iqn.2010-10.org.openstack: {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] target_protocol = iscsi {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] target_secondary_ip_addresses = [] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] trace_flags = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] transfer_api_class = cinder.transfer.api.API {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] transport_url = **** {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] until_refresh = 0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] use_chap_auth = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] use_default_quota_class = True {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] use_journal = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] use_json = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] use_multipath_for_image_xfer = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] use_stderr = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] use_syslog = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] verify_glance_signatures = enabled {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] vmdk_allowed_types = ['streamOptimized', 'monolithicSparse'] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] volume_api_class = cinder.volume.api.API {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] volume_backend_name = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] volume_clear = zero {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] volume_clear_ionice = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] volume_clear_size = 0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] volume_copy_bps_limit = 0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] volume_dd_blocksize = 1M {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] volume_manager = cinder.volume.manager.VolumeManager {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] volume_name_template = volume-%s {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] volume_service_inithost_offload = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] volume_usage_audit_period = month {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] zoning_mode = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3549}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_concurrency.disable_process_locking = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_concurrency.lock_path = /opt/stack/data/cinder {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] os_brick.lightos_discovery_client_address = localhost {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] os_brick.lightos_discovery_client_dir_path = /etc/discovery-client/discovery.d/ {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] os_brick.lightos_discovery_client_port = 6060 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] os_brick.lock_path = /opt/stack/data/os_brick {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] os_brick.wait_mpath_device_interval = 1 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] keystone_authtoken.auth_section = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] keystone_authtoken.auth_type = password {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] keystone_authtoken.auth_version = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] keystone_authtoken.cache = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] keystone_authtoken.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] keystone_authtoken.certfile = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] keystone_authtoken.delay_auth_decision = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-4a0a3c31-b607-40fa-b887-f40b8f8af140 None None] nas_secure_file_* settings are false (ownership) and false (permissions). {{(pid=86574) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:304}} Nov 01 12:19:07 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.quobyte [None req-4a0a3c31-b607-40fa-b887-f40b8f8af140 None None] The NAS file operations will be run as root, allowing root level access at the storage backend. Nov 01 12:19:07 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.quobyte [None req-4a0a3c31-b607-40fa-b887-f40b8f8af140 None None] The NAS file permissions mode will be 666 (allowing other/world read & write access). Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] keystone_authtoken.http_connect_timeout = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] keystone_authtoken.include_service_catalog = True {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] keystone_authtoken.insecure = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] keystone_authtoken.interface = public {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] keystone_authtoken.keyfile = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] keystone_authtoken.memcache_password = **** {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4a0a3c31-b607-40fa-b887-f40b8f8af140 None None] Running cmd (subprocess): mount.quobyte {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] keystone_authtoken.memcache_secret_key = **** {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] keystone_authtoken.memcache_security_strategy = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] keystone_authtoken.memcache_username = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] keystone_authtoken.region_name = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] keystone_authtoken.service_token_roles_required = True {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] keystone_authtoken.service_type = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] keystone_authtoken.token_cache_time = 300 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] keystone_authtoken.www_authenticate_uri = http://192.168.122.20/identity {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] cache.backend = dogpile.cache.null {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] cache.backend_argument = **** {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] cache.backend_expiration_time = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] cache.config_prefix = cache.oslo {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] cache.debug_cache_backend = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] cache.enable_retry_client = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] cache.enable_socket_keepalive = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] cache.enabled = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] cache.expiration_time = 600 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] cache.hashclient_dead_timeout = 60.0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] cache.hashclient_retry_attempts = 2 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] cache.hashclient_retry_timeout = 1.0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] cache.memcache_dead_retry = 300 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] cache.memcache_pool_maxsize = 10 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] cache.memcache_pool_unused_timeout = 60 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] cache.memcache_sasl_enabled = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] cache.memcache_servers = ['localhost:11211'] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] cache.password = **** {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] cache.proxies = [] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] cache.redis_db = 0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] cache.redis_sentinel_service_name = mymaster {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] cache.redis_sentinels = ['localhost:26379'] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] cache.redis_server = localhost:6379 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] cache.retry_attempts = 2 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] cache.retry_delay = 0.0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] cache.socket_keepalive_count = 1 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] cache.socket_keepalive_idle = 1 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] cache.socket_keepalive_interval = 1 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] cache.socket_timeout = 1.0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] cache.tls_allowed_ciphers = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] cache.tls_cafile = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] cache.tls_certfile = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] cache.tls_enabled = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] cache.tls_keyfile = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] cache.username = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] coordination.backend_url = **** {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] database.asyncio_connection = **** {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] database.asyncio_slave_connection = **** {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] database.backend = sqlalchemy {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] database.connection = **** {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] database.connection_debug = 0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] database.connection_parameters = {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] database.connection_recycle_time = 3600 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] database.connection_trace = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] database.db_inc_retry_interval = True {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] database.db_max_retries = 20 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] database.db_max_retry_interval = 10 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] database.db_retry_interval = 1 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] database.max_overflow = 50 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] database.max_pool_size = 5 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] database.max_retries = 10 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] database.mysql_sql_mode = TRADITIONAL {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] database.mysql_wsrep_sync_wait = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] database.pool_timeout = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] database.retry_interval = 10 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] database.slave_connection = **** {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] database.sqlite_synchronous = True {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] database.synchronous_reader = True {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] database.use_db_reconnect = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_messaging_metrics.metrics_process_name = {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_messaging_tracing.insecure = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_messaging_tracing.otel_exporter_otlp_endpoint = http://localhost:4318 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_messaging_tracing.otlp_protocol = http/protobuf {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_messaging_tracing.tracing_enabled = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_messaging_tracing.tracing_service_name = openstack {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] profiler.connection_string = messaging:// {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] profiler.enabled = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] profiler.es_doc_type = notification {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] profiler.es_scroll_size = 10000 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] profiler.es_scroll_time = 2m {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] profiler.filter_error_trace = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] profiler.hmac_keys = **** {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] profiler.sentinel_service_name = mymaster {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] profiler.socket_timeout = 0.1 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] profiler.trace_requests = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] profiler.trace_sqlalchemy = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] profiler_jaeger.process_tags = {} {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] profiler_jaeger.service_name_prefix = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] profiler_otlp.service_name_prefix = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_policy.enforce_new_defaults = True {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_policy.policy_default_rule = default {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_policy.policy_dirs = ['policy.d'] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_policy.policy_file = policy.yaml {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_policy.remote_timeout = 60.0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] privsep_osbrick.capabilities = [21, 2] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] privsep_osbrick.group = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] privsep_osbrick.helper_command = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] privsep_osbrick.log_daemon_traceback = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] privsep_osbrick.logger_name = brick_privsep_hide_output {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] privsep_osbrick.thread_pool_size = 4 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] privsep_osbrick.user = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] cinder_sys_admin.capabilities = [0, 1, 2, 3, 12, 21] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] cinder_sys_admin.group = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] cinder_sys_admin.helper_command = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] cinder_sys_admin.logger_name = oslo_privsep.daemon {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] cinder_sys_admin.thread_pool_size = 4 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] cinder_sys_admin.user = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] service_user.auth_section = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] service_user.auth_type = password {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] service_user.cafile = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] service_user.certfile = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] service_user.collect_timing = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] service_user.insecure = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] service_user.keyfile = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] service_user.send_service_user_token = True {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] service_user.split_loggers = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] service_user.timeout = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] service_user.tls_ciphers = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] service_user.tls_min_version = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] glance.auth_section = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] glance.auth_type = password {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] glance.cafile = /opt/stack/data/ca-bundle.pem {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] glance.certfile = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] glance.collect_timing = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] glance.insecure = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] glance.keyfile = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] glance.region_name = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] glance.split_loggers = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] glance.timeout = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] glance.tls_ciphers = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] glance.tls_min_version = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.backend_availability_zone = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.chap_password = **** {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.chap_username = {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.chiscsi_conf = /etc/chelsio-iscsi/chiscsi.conf {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.disk_geometry = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.driver_client_cert = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.driver_client_cert_key = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.driver_data_namespace = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.driver_ssl_cert_path = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.driver_use_ssl = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.enable_unsupported_driver = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.extra_capabilities = {} {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.filter_function = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.goodness_function = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.image_volume_cache_enabled = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.iscsi_target_flags = {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.iscsi_write_cache = on {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.iser_helper = tgtadm {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.iser_ip_address = 192.168.122.20 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.iser_port = 3260 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.nas_host = {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.nas_login = admin {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.nas_mount_options = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.nas_password = **** {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.nas_private_key = {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.nas_secure_file_operations = auto {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.nas_share_path = {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.nas_ssh_port = 22 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.nas_volume_prov_type = thin {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.num_shell_tries = 3 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.nvmet_ns_id = 10 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.nvmet_port_id = 1 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.quobyte_client_cfg = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.quobyte_volume_url = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.replication_device = **** {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.report_discard_supported = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.reserved_percentage = 0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.scst_target_driver = iscsi {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.scst_target_iqn_name = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.storage_protocol = iSCSI {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.target_helper = tgtadm {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.target_ip_address = 192.168.122.20 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.target_port = 3260 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.target_protocol = iscsi {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.trace_flags = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.unique_fqdn_network = True {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.use_chap_auth = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.volume_backend_name = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.volume_clear = zero {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.volume_clear_ionice = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.volume_clear_size = 0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack quobyte-client[86575]: Reading configuration file: /etc/quobyte/client.cfg Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack quobyte-client[86575]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log. Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4a0a3c31-b607-40fa-b887-f40b8f8af140 None None] CMD "mount.quobyte" returned: 1 in 0.093s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:19:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4a0a3c31-b607-40fa-b887-f40b8f8af140 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:19:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4a0a3c31-b607-40fa-b887-f40b8f8af140 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:19:07 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-4a0a3c31-b607-40fa-b887-f40b8f8af140 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] backend_defaults.volumes_dir = /opt/stack/data/cinder/volumes {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_reports.file_event_handler = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_reports.file_event_handler_interval = 1 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_reports.log_dir = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.backend_availability_zone = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.backend_host = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.chap_password = **** {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.chap_username = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.chiscsi_conf = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.disk_geometry = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.driver_client_cert = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.driver_client_cert_key = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.driver_data_namespace = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.driver_use_ssl = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.enable_unsupported_driver = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.extra_capabilities = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.filter_function = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.goodness_function = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.iscsi_target_flags = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.iscsi_write_cache = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.iser_helper = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.iser_ip_address = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.iser_port = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.iser_target_prefix = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.nas_host = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.nas_login = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.nas_mount_options = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.nas_password = **** {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-4a0a3c31-b607-40fa-b887-f40b8f8af140 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:19:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4a0a3c31-b607-40fa-b887-f40b8f8af140 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.nas_private_key = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4a0a3c31-b607-40fa-b887-f40b8f8af140 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.nas_secure_file_operations = false {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.nas_secure_file_permissions = false {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.nas_share_path = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.nas_ssh_port = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.nas_volume_prov_type = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.num_iser_scan_tries = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.num_shell_tries = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.nvmet_ns_id = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.nvmet_port_id = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.quobyte_client_cfg = /etc/quobyte/client-cinder.cfg {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.quobyte_volume_url = quobyte://osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.replication_device = **** {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.report_discard_supported = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.reserved_percentage = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.scst_target_driver = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.scst_target_iqn_name = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.storage_protocol = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.target_helper = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.target_ip_address = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.target_port = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.target_prefix = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.target_protocol = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.trace_flags = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.unique_fqdn_network = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.use_chap_auth = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.volume_backend_name = QuobyteHD {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.volume_clear = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.volume_clear_ionice = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.volume_clear_size = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.volume_dd_blocksize = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.volume_driver = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] QuobyteHD.volumes_dir = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_messaging_rabbit.hostname = devstack {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack sudo[86576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack sudo[86576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_messaging_rabbit.ssl = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_messaging_rabbit.ssl_ca_file = {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_messaging_rabbit.ssl_cert_file = {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_messaging_rabbit.ssl_enforce_hostname_verification = True {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_messaging_rabbit.ssl_key_file = {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_messaging_rabbit.ssl_version = {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_messaging_notifications.driver = [] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_messaging_notifications.retry = -1 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] oslo_messaging_notifications.transport_url = **** {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] key_manager.backend = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] key_manager.fixed_key = **** {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] barbican.barbican_api_version = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] barbican.barbican_endpoint = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] barbican.barbican_endpoint_type = public {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] barbican.barbican_region_name = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] barbican.cafile = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] barbican.certfile = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] barbican.collect_timing = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] barbican.insecure = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] barbican.keyfile = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] barbican.number_of_retries = 60 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] barbican.retry_delay = 1 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] barbican.send_service_user_token = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] barbican.split_loggers = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] barbican.timeout = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] barbican.tls_ciphers = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] barbican.tls_min_version = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] barbican.verify_ssl = True {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] barbican.verify_ssl_path = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] barbican_service_user.auth_section = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] barbican_service_user.auth_type = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] barbican_service_user.cafile = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] barbican_service_user.certfile = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] barbican_service_user.collect_timing = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] barbican_service_user.insecure = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] barbican_service_user.keyfile = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] barbican_service_user.split_loggers = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] barbican_service_user.timeout = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] barbican_service_user.tls_ciphers = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] barbican_service_user.tls_min_version = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] vault.approle_role_id = **** {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] vault.approle_secret_id = **** {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] vault.auth_method = approle {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] vault.auth_path = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] vault.kv_mountpoint = secret {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] vault.kv_path = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] vault.kv_version = 2 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] vault.namespace = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] vault.root_token_id = **** {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] vault.ssl_ca_crt_file = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] vault.timeout = 60.0 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] vault.token_file = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] vault.token_role = None {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] vault.use_ssl = False {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] vault.vault_url = http://127.0.0.1:8200 {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3560}} Nov 01 12:19:07 devstack cinder-volume[86264]: DEBUG oslo_service.backend._eventlet.service [None req-79f5f358-38f1-44e4-8136-7d414f11174b None None] ******************************************************************************** {{(pid=86264) log_opt_values /opt/stack/data/venv/lib/python3.12/site-packages/oslo_config/cfg.py:3567}} Nov 01 12:19:08 devstack sudo[86576]: pam_unix(sudo:session): session closed for user root Nov 01 12:19:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4a0a3c31-b607-40fa-b887-f40b8f8af140 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.237s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:19:08 devstack cinder-volume[86574]: INFO cinder.volume.driver [None req-4a0a3c31-b607-40fa-b887-f40b8f8af140 None None] Driver hasn't implemented _init_vendor_properties() Nov 01 12:19:08 devstack cinder-volume[86574]: DEBUG cinder.volume.driver [None req-4a0a3c31-b607-40fa-b887-f40b8f8af140 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.9067420959473, 'free_capacity_gb': 1773.9067420959473, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86574) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:878}} Nov 01 12:19:08 devstack cinder-volume[86574]: DEBUG oslo_db.sqlalchemy.engines [None req-4a0a3c31-b607-40fa-b887-f40b8f8af140 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=86574) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.12/site-packages/oslo_db/sqlalchemy/engines.py:325}} Nov 01 12:19:08 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writer thread running {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:102}} Nov 01 12:19:08 devstack cinder-volume[86574]: DEBUG cinder.db.api [None req-4a0a3c31-b607-40fa-b887-f40b8f8af140 None None] Building query based on filter {{(pid=86574) _process_snaps_filters /opt/stack/cinder/cinder/db/api.py:3942}} Nov 01 12:19:08 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-4a0a3c31-b607-40fa-b887-f40b8f8af140 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=86574) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1325}} Nov 01 12:19:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4a0a3c31-b607-40fa-b887-f40b8f8af140 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:19:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4a0a3c31-b607-40fa-b887-f40b8f8af140 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:19:08 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-4a0a3c31-b607-40fa-b887-f40b8f8af140 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:19:08 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-4a0a3c31-b607-40fa-b887-f40b8f8af140 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:19:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4a0a3c31-b607-40fa-b887-f40b8f8af140 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:19:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4a0a3c31-b607-40fa-b887-f40b8f8af140 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:19:08 devstack cinder-volume[86574]: INFO cinder.keymgr.migration [None req-859d0281-42a2-45d7-9a19-c81f7873596f None None] Not migrating encryption keys because the ConfKeyManager is still in use. Nov 01 12:19:08 devstack sudo[86587]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:19:08 devstack sudo[86587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:19:08 devstack sudo[86587]: pam_unix(sudo:session): session closed for user root Nov 01 12:19:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4a0a3c31-b607-40fa-b887-f40b8f8af140 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.237s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:19:08 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-4a0a3c31-b607-40fa-b887-f40b8f8af140 None None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:19:08 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-4a0a3c31-b607-40fa-b887-f40b8f8af140 None None] Driver initialization completed successfully. Nov 01 12:19:08 devstack cinder-volume[86574]: INFO cinder.manager [None req-4a0a3c31-b607-40fa-b887-f40b8f8af140 None None] Initiating service 3 cleanup Nov 01 12:19:08 devstack cinder-volume[86574]: INFO cinder.manager [None req-4a0a3c31-b607-40fa-b887-f40b8f8af140 None None] Service 3 cleanup completed. Nov 01 12:19:08 devstack cinder-volume[86574]: DEBUG cinder.service [None req-4a0a3c31-b607-40fa-b887-f40b8f8af140 None None] Creating RPC server for service cinder-volume {{(pid=86574) start /opt/stack/cinder/cinder/service.py:231}} Nov 01 12:19:08 devstack cinder-volume[86574]: DEBUG cinder.service [None req-4a0a3c31-b607-40fa-b887-f40b8f8af140 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=86574) start /opt/stack/cinder/cinder/service.py:237}} Nov 01 12:19:08 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-4a0a3c31-b607-40fa-b887-f40b8f8af140 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.2.1) Nov 01 12:19:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4a0a3c31-b607-40fa-b887-f40b8f8af140 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:19:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4a0a3c31-b607-40fa-b887-f40b8f8af140 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:19:08 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-4a0a3c31-b607-40fa-b887-f40b8f8af140 None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:19:08 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-4a0a3c31-b607-40fa-b887-f40b8f8af140 None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:19:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4a0a3c31-b607-40fa-b887-f40b8f8af140 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:19:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4a0a3c31-b607-40fa-b887-f40b8f8af140 None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:19:08 devstack sudo[86600]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:19:08 devstack sudo[86600]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:19:08 devstack sudo[86600]: pam_unix(sudo:session): session closed for user root Nov 01 12:19:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4a0a3c31-b607-40fa-b887-f40b8f8af140 None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.237s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:19:08 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-4a0a3c31-b607-40fa-b887-f40b8f8af140 None None] Driver post RPC initialization completed successfully. Nov 01 12:19:17 devstack cinder-volume[86264]: DEBUG dbcounter [-] [86264] Writing DB stats cinder:SELECT=5,cinder:UPDATE=1 {{(pid=86264) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:19:18 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:SELECT=6,cinder:UPDATE=1 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:19:18 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:SELECT=4 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:19:39 devstack cinder-volume[86574]: DEBUG oslo_service.periodic_task [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running periodic task VolumeManager._thread_info {{(pid=86574) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:19:39 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] thread count: 6 {{(pid=86574) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 12:19:39 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] thread info: [<_MainThread(MainThread, started 131331184930944)>, , , , , ] {{(pid=86574) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 12:20:33 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-e361bcc7-8159-46aa-953e-d5586e588286 tempest-DeleteServersTestJSON-154995912 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:20:33 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e361bcc7-8159-46aa-953e-d5586e588286 tempest-DeleteServersTestJSON-154995912 None] Flow 'volume_create_manager' (8d5f2d17-bbc3-404b-9129-208adf7e7c25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:20:33 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e361bcc7-8159-46aa-953e-d5586e588286 tempest-DeleteServersTestJSON-154995912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44bc6262-71fc-4d83-8578-98d6894ba936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:20:33 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e361bcc7-8159-46aa-953e-d5586e588286 tempest-DeleteServersTestJSON-154995912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (44bc6262-71fc-4d83-8578-98d6894ba936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1236511208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7af3b54-9094-40b4-8303-565f029cd167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c534cd70ca3946af887b063d9b7e8ebb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:20:33Z,use_quota=True,user_id='18152ee3333449b18759fcb775edc33f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:20:33 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e361bcc7-8159-46aa-953e-d5586e588286 tempest-DeleteServersTestJSON-154995912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2beaed85-0a50-493e-901a-eb2a56582518) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:20:33 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e361bcc7-8159-46aa-953e-d5586e588286 tempest-DeleteServersTestJSON-154995912 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2beaed85-0a50-493e-901a-eb2a56582518) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:20:33 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e361bcc7-8159-46aa-953e-d5586e588286 tempest-DeleteServersTestJSON-154995912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6835659a-c303-401a-8d08-96f500683c20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:20:33 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e361bcc7-8159-46aa-953e-d5586e588286 tempest-DeleteServersTestJSON-154995912 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6835659a-c303-401a-8d08-96f500683c20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b7af3b54-9094-40b4-8303-565f029cd167', 'volume_name': 'volume-b7af3b54-9094-40b4-8303-565f029cd167', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:20:33 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e361bcc7-8159-46aa-953e-d5586e588286 tempest-DeleteServersTestJSON-154995912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d85e419-823f-4c4a-a0ed-a4bdaab6544c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:20:33 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e361bcc7-8159-46aa-953e-d5586e588286 tempest-DeleteServersTestJSON-154995912 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7d85e419-823f-4c4a-a0ed-a4bdaab6544c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:20:33 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e361bcc7-8159-46aa-953e-d5586e588286 tempest-DeleteServersTestJSON-154995912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51519db8-a066-49d6-a7fc-29783d9f987a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:20:33 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-e361bcc7-8159-46aa-953e-d5586e588286 tempest-DeleteServersTestJSON-154995912 None] Volume b7af3b54-9094-40b4-8303-565f029cd167: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b7af3b54-9094-40b4-8303-565f029cd167', 'volume_size': 1} Nov 01 12:20:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e361bcc7-8159-46aa-953e-d5586e588286 tempest-DeleteServersTestJSON-154995912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:20:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e361bcc7-8159-46aa-953e-d5586e588286 tempest-DeleteServersTestJSON-154995912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:20:33 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e361bcc7-8159-46aa-953e-d5586e588286 tempest-DeleteServersTestJSON-154995912 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:20:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-1236511208',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b7af3b54-9094-40b4-8303-565f029cd167,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c534cd70ca3946af887b063d9b7e8ebb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:20:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:20:33Z,use_quota=True,user_id='18152ee3333449b18759fcb775edc33f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:20:33 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-e361bcc7-8159-46aa-953e-d5586e588286 tempest-DeleteServersTestJSON-154995912 None] Creating volume b7af3b54-9094-40b4-8303-565f029cd167 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:20:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e361bcc7-8159-46aa-953e-d5586e588286 tempest-DeleteServersTestJSON-154995912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:20:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e361bcc7-8159-46aa-953e-d5586e588286 tempest-DeleteServersTestJSON-154995912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:20:33 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e361bcc7-8159-46aa-953e-d5586e588286 tempest-DeleteServersTestJSON-154995912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:20:33 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e361bcc7-8159-46aa-953e-d5586e588286 tempest-DeleteServersTestJSON-154995912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:20:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e361bcc7-8159-46aa-953e-d5586e588286 tempest-DeleteServersTestJSON-154995912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:20:33 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e361bcc7-8159-46aa-953e-d5586e588286 tempest-DeleteServersTestJSON-154995912 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:20:33 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-e361bcc7-8159-46aa-953e-d5586e588286 tempest-DeleteServersTestJSON-154995912 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:20:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e361bcc7-8159-46aa-953e-d5586e588286 tempest-DeleteServersTestJSON-154995912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b7af3b54-9094-40b4-8303-565f029cd167 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:20:34 devstack sudo[87503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b7af3b54-9094-40b4-8303-565f029cd167 1073741824 Nov 01 12:20:34 devstack sudo[87503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:20:35 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-11e52906-0f9f-4857-90da-e720d9b8e53e tempest-VolumesAdminNegativeTest-1817923670 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:20:35 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-11e52906-0f9f-4857-90da-e720d9b8e53e tempest-VolumesAdminNegativeTest-1817923670 None] Flow 'volume_create_manager' (0779cbc2-e5b7-405d-b0c0-401f85be1c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:20:35 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-11e52906-0f9f-4857-90da-e720d9b8e53e tempest-VolumesAdminNegativeTest-1817923670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e16d6c4-2333-4fec-b95c-a5472fe375ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:20:35 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-11e52906-0f9f-4857-90da-e720d9b8e53e tempest-VolumesAdminNegativeTest-1817923670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6e16d6c4-2333-4fec-b95c-a5472fe375ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:20:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1301860131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c89636c-4236-4c27-afd1-4d6fe48e3cfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa428be2d4a94da8b0aae0b978e1f9c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:20:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:20:35Z,use_quota=True,user_id='f899337360d04584bd9bd826847b414d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:20:35 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-11e52906-0f9f-4857-90da-e720d9b8e53e tempest-VolumesAdminNegativeTest-1817923670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5726fe0e-eb25-4455-8208-c756b99ea1d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:20:35 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-11e52906-0f9f-4857-90da-e720d9b8e53e tempest-VolumesAdminNegativeTest-1817923670 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5726fe0e-eb25-4455-8208-c756b99ea1d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:20:35 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-11e52906-0f9f-4857-90da-e720d9b8e53e tempest-VolumesAdminNegativeTest-1817923670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a08303c-a599-4946-b792-edcf2486542f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:20:35 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-11e52906-0f9f-4857-90da-e720d9b8e53e tempest-VolumesAdminNegativeTest-1817923670 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9a08303c-a599-4946-b792-edcf2486542f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c89636c-4236-4c27-afd1-4d6fe48e3cfa', 'volume_name': 'volume-3c89636c-4236-4c27-afd1-4d6fe48e3cfa', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:20:35 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-11e52906-0f9f-4857-90da-e720d9b8e53e tempest-VolumesAdminNegativeTest-1817923670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0c432c0-ee9f-4fd1-a814-07da501ecdcd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:20:35 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-11e52906-0f9f-4857-90da-e720d9b8e53e tempest-VolumesAdminNegativeTest-1817923670 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0c432c0-ee9f-4fd1-a814-07da501ecdcd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:20:35 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-11e52906-0f9f-4857-90da-e720d9b8e53e tempest-VolumesAdminNegativeTest-1817923670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a777e70b-ab95-4536-a3cf-d8b51e390b9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:20:35 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-11e52906-0f9f-4857-90da-e720d9b8e53e tempest-VolumesAdminNegativeTest-1817923670 None] Volume 3c89636c-4236-4c27-afd1-4d6fe48e3cfa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c89636c-4236-4c27-afd1-4d6fe48e3cfa', 'volume_size': 1} Nov 01 12:20:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-11e52906-0f9f-4857-90da-e720d9b8e53e tempest-VolumesAdminNegativeTest-1817923670 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:20:35 devstack sudo[87503]: pam_unix(sudo:session): session closed for user root Nov 01 12:20:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e361bcc7-8159-46aa-953e-d5586e588286 tempest-DeleteServersTestJSON-154995912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b7af3b54-9094-40b4-8303-565f029cd167 1073741824" returned: 0 in 1.603s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:20:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e361bcc7-8159-46aa-953e-d5586e588286 tempest-DeleteServersTestJSON-154995912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b7af3b54-9094-40b4-8303-565f029cd167 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:20:35 devstack sudo[87824]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b7af3b54-9094-40b4-8303-565f029cd167 Nov 01 12:20:35 devstack sudo[87824]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:20:36 devstack sudo[87824]: pam_unix(sudo:session): session closed for user root Nov 01 12:20:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e361bcc7-8159-46aa-953e-d5586e588286 tempest-DeleteServersTestJSON-154995912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b7af3b54-9094-40b4-8303-565f029cd167" returned: 0 in 0.541s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:20:36 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e361bcc7-8159-46aa-953e-d5586e588286 tempest-DeleteServersTestJSON-154995912 None] <== create_volume: return (2315ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:20:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e361bcc7-8159-46aa-953e-d5586e588286 tempest-DeleteServersTestJSON-154995912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.318s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:20:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-11e52906-0f9f-4857-90da-e720d9b8e53e tempest-VolumesAdminNegativeTest-1817923670 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.868s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:20:36 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-11e52906-0f9f-4857-90da-e720d9b8e53e tempest-VolumesAdminNegativeTest-1817923670 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:20:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-1301860131',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c89636c-4236-4c27-afd1-4d6fe48e3cfa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aa428be2d4a94da8b0aae0b978e1f9c5',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:20:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:20:35Z,use_quota=True,user_id='f899337360d04584bd9bd826847b414d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:20:36 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-11e52906-0f9f-4857-90da-e720d9b8e53e tempest-VolumesAdminNegativeTest-1817923670 None] Creating volume 3c89636c-4236-4c27-afd1-4d6fe48e3cfa {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:20:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-11e52906-0f9f-4857-90da-e720d9b8e53e tempest-VolumesAdminNegativeTest-1817923670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:20:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-11e52906-0f9f-4857-90da-e720d9b8e53e tempest-VolumesAdminNegativeTest-1817923670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:20:36 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-11e52906-0f9f-4857-90da-e720d9b8e53e tempest-VolumesAdminNegativeTest-1817923670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:20:36 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-11e52906-0f9f-4857-90da-e720d9b8e53e tempest-VolumesAdminNegativeTest-1817923670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:20:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-11e52906-0f9f-4857-90da-e720d9b8e53e tempest-VolumesAdminNegativeTest-1817923670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:20:36 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-11e52906-0f9f-4857-90da-e720d9b8e53e tempest-VolumesAdminNegativeTest-1817923670 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:20:36 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-11e52906-0f9f-4857-90da-e720d9b8e53e tempest-VolumesAdminNegativeTest-1817923670 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:20:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-11e52906-0f9f-4857-90da-e720d9b8e53e tempest-VolumesAdminNegativeTest-1817923670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3c89636c-4236-4c27-afd1-4d6fe48e3cfa 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:20:36 devstack sudo[87827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3c89636c-4236-4c27-afd1-4d6fe48e3cfa 1073741824 Nov 01 12:20:36 devstack sudo[87827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:20:36 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e361bcc7-8159-46aa-953e-d5586e588286 tempest-DeleteServersTestJSON-154995912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (51519db8-a066-49d6-a7fc-29783d9f987a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b7af3b54-9094-40b4-8303-565f029cd167', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:20:36 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e361bcc7-8159-46aa-953e-d5586e588286 tempest-DeleteServersTestJSON-154995912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7852c567-cf37-4e49-9f2d-a0c38d5ae8f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:20:36 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-e361bcc7-8159-46aa-953e-d5586e588286 tempest-DeleteServersTestJSON-154995912 None] Volume volume-b7af3b54-9094-40b4-8303-565f029cd167 (b7af3b54-9094-40b4-8303-565f029cd167): created successfully Nov 01 12:20:36 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e361bcc7-8159-46aa-953e-d5586e588286 tempest-DeleteServersTestJSON-154995912 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7852c567-cf37-4e49-9f2d-a0c38d5ae8f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:20:36 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e361bcc7-8159-46aa-953e-d5586e588286 tempest-DeleteServersTestJSON-154995912 None] Flow 'volume_create_manager' (8d5f2d17-bbc3-404b-9129-208adf7e7c25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:20:36 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-e361bcc7-8159-46aa-953e-d5586e588286 tempest-DeleteServersTestJSON-154995912 None] Created volume successfully. Nov 01 12:20:37 devstack sudo[87827]: pam_unix(sudo:session): session closed for user root Nov 01 12:20:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-11e52906-0f9f-4857-90da-e720d9b8e53e tempest-VolumesAdminNegativeTest-1817923670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3c89636c-4236-4c27-afd1-4d6fe48e3cfa 1073741824" returned: 0 in 1.150s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:20:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-11e52906-0f9f-4857-90da-e720d9b8e53e tempest-VolumesAdminNegativeTest-1817923670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3c89636c-4236-4c27-afd1-4d6fe48e3cfa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:20:37 devstack sudo[87834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3c89636c-4236-4c27-afd1-4d6fe48e3cfa Nov 01 12:20:37 devstack sudo[87834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:20:37 devstack sudo[87834]: pam_unix(sudo:session): session closed for user root Nov 01 12:20:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-11e52906-0f9f-4857-90da-e720d9b8e53e tempest-VolumesAdminNegativeTest-1817923670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3c89636c-4236-4c27-afd1-4d6fe48e3cfa" returned: 0 in 0.452s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:20:37 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-11e52906-0f9f-4857-90da-e720d9b8e53e tempest-VolumesAdminNegativeTest-1817923670 None] <== create_volume: return (1709ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:20:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-11e52906-0f9f-4857-90da-e720d9b8e53e tempest-VolumesAdminNegativeTest-1817923670 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.711s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:20:37 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-11e52906-0f9f-4857-90da-e720d9b8e53e tempest-VolumesAdminNegativeTest-1817923670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a777e70b-ab95-4536-a3cf-d8b51e390b9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c89636c-4236-4c27-afd1-4d6fe48e3cfa', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:20:38 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-11e52906-0f9f-4857-90da-e720d9b8e53e tempest-VolumesAdminNegativeTest-1817923670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd498332-f667-437d-b704-179296aedcb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:20:38 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-11e52906-0f9f-4857-90da-e720d9b8e53e tempest-VolumesAdminNegativeTest-1817923670 None] Volume volume-3c89636c-4236-4c27-afd1-4d6fe48e3cfa (3c89636c-4236-4c27-afd1-4d6fe48e3cfa): created successfully Nov 01 12:20:38 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-11e52906-0f9f-4857-90da-e720d9b8e53e tempest-VolumesAdminNegativeTest-1817923670 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fd498332-f667-437d-b704-179296aedcb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:20:38 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-11e52906-0f9f-4857-90da-e720d9b8e53e tempest-VolumesAdminNegativeTest-1817923670 None] Flow 'volume_create_manager' (0779cbc2-e5b7-405d-b0c0-401f85be1c23) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:20:38 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-11e52906-0f9f-4857-90da-e720d9b8e53e tempest-VolumesAdminNegativeTest-1817923670 None] Created volume successfully. Nov 01 12:20:38 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-23e78529-f2b4-4588-adc5-054fd3747cc6 tempest-ServerRescueNegativeTestJSON-1777499268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:20:38 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-23e78529-f2b4-4588-adc5-054fd3747cc6 tempest-ServerRescueNegativeTestJSON-1777499268 None] Flow 'volume_create_manager' (150db232-f338-4637-82d1-6b533cfa044c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:20:38 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-23e78529-f2b4-4588-adc5-054fd3747cc6 tempest-ServerRescueNegativeTestJSON-1777499268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6714aee-4e3f-416b-a920-208dc8e40322) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:20:38 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-23e78529-f2b4-4588-adc5-054fd3747cc6 tempest-ServerRescueNegativeTestJSON-1777499268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b6714aee-4e3f-416b-a920-208dc8e40322) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2077329615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d39ac0f-06e5-4b93-9c59-1132cf3fcde4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a48b72a69c743adb7f24e49d989fa14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:20:38Z,use_quota=True,user_id='5795b12c2b5d4ab58f715488cabb0158',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:20:38 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-23e78529-f2b4-4588-adc5-054fd3747cc6 tempest-ServerRescueNegativeTestJSON-1777499268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f48f1548-e593-496d-8410-4dab5c3a894f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:20:38 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-23e78529-f2b4-4588-adc5-054fd3747cc6 tempest-ServerRescueNegativeTestJSON-1777499268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f48f1548-e593-496d-8410-4dab5c3a894f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:20:38 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-23e78529-f2b4-4588-adc5-054fd3747cc6 tempest-ServerRescueNegativeTestJSON-1777499268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e404d0f-1d3f-492c-87a3-78a464aaa9c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:20:38 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-23e78529-f2b4-4588-adc5-054fd3747cc6 tempest-ServerRescueNegativeTestJSON-1777499268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5e404d0f-1d3f-492c-87a3-78a464aaa9c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d39ac0f-06e5-4b93-9c59-1132cf3fcde4', 'volume_name': 'volume-6d39ac0f-06e5-4b93-9c59-1132cf3fcde4', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:20:38 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-23e78529-f2b4-4588-adc5-054fd3747cc6 tempest-ServerRescueNegativeTestJSON-1777499268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd1f4c55-82a7-46ae-baed-3042c67e7b80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:20:38 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-23e78529-f2b4-4588-adc5-054fd3747cc6 tempest-ServerRescueNegativeTestJSON-1777499268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bd1f4c55-82a7-46ae-baed-3042c67e7b80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:20:38 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-23e78529-f2b4-4588-adc5-054fd3747cc6 tempest-ServerRescueNegativeTestJSON-1777499268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6414789-6814-447a-8cdf-5b398bb191fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:20:38 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-23e78529-f2b4-4588-adc5-054fd3747cc6 tempest-ServerRescueNegativeTestJSON-1777499268 None] Volume 6d39ac0f-06e5-4b93-9c59-1132cf3fcde4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d39ac0f-06e5-4b93-9c59-1132cf3fcde4', 'volume_size': 1} Nov 01 12:20:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-23e78529-f2b4-4588-adc5-054fd3747cc6 tempest-ServerRescueNegativeTestJSON-1777499268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:20:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-23e78529-f2b4-4588-adc5-054fd3747cc6 tempest-ServerRescueNegativeTestJSON-1777499268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:20:38 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-23e78529-f2b4-4588-adc5-054fd3747cc6 tempest-ServerRescueNegativeTestJSON-1777499268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:20:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerRescueNegativeTestJSON-volume-2077329615',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d39ac0f-06e5-4b93-9c59-1132cf3fcde4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3a48b72a69c743adb7f24e49d989fa14',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:20:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:20:38Z,use_quota=True,user_id='5795b12c2b5d4ab58f715488cabb0158',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:20:38 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-23e78529-f2b4-4588-adc5-054fd3747cc6 tempest-ServerRescueNegativeTestJSON-1777499268 None] Creating volume 6d39ac0f-06e5-4b93-9c59-1132cf3fcde4 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:20:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-23e78529-f2b4-4588-adc5-054fd3747cc6 tempest-ServerRescueNegativeTestJSON-1777499268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:20:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-23e78529-f2b4-4588-adc5-054fd3747cc6 tempest-ServerRescueNegativeTestJSON-1777499268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:20:38 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-23e78529-f2b4-4588-adc5-054fd3747cc6 tempest-ServerRescueNegativeTestJSON-1777499268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:20:38 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-23e78529-f2b4-4588-adc5-054fd3747cc6 tempest-ServerRescueNegativeTestJSON-1777499268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:20:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-23e78529-f2b4-4588-adc5-054fd3747cc6 tempest-ServerRescueNegativeTestJSON-1777499268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:20:38 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-23e78529-f2b4-4588-adc5-054fd3747cc6 tempest-ServerRescueNegativeTestJSON-1777499268 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:20:38 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-23e78529-f2b4-4588-adc5-054fd3747cc6 tempest-ServerRescueNegativeTestJSON-1777499268 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:20:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-23e78529-f2b4-4588-adc5-054fd3747cc6 tempest-ServerRescueNegativeTestJSON-1777499268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6d39ac0f-06e5-4b93-9c59-1132cf3fcde4 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:20:38 devstack sudo[87847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6d39ac0f-06e5-4b93-9c59-1132cf3fcde4 1073741824 Nov 01 12:20:38 devstack sudo[87847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:20:39 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e703c839-72b0-4675-9bea-90eb7efeef8f tempest-VolumesAdminNegativeTest-1817923670 None] Acquiring lock "cinder-3c89636c-4236-4c27-afd1-4d6fe48e3cfa-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:20:39 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e703c839-72b0-4675-9bea-90eb7efeef8f tempest-VolumesAdminNegativeTest-1817923670 None] Lock "cinder-3c89636c-4236-4c27-afd1-4d6fe48e3cfa-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:20:39 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e703c839-72b0-4675-9bea-90eb7efeef8f tempest-VolumesAdminNegativeTest-1817923670 None] Acquiring lock "cinder-quobyte-3c89636c-4236-4c27-afd1-4d6fe48e3cfa" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:20:39 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e703c839-72b0-4675-9bea-90eb7efeef8f tempest-VolumesAdminNegativeTest-1817923670 None] Lock "cinder-quobyte-3c89636c-4236-4c27-afd1-4d6fe48e3cfa" acquired by "delete_volume" :: waited 0.064s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:20:39 devstack cinder-volume[86574]: INFO oslo.privsep.daemon [None req-e703c839-72b0-4675-9bea-90eb7efeef8f tempest-VolumesAdminNegativeTest-1817923670 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmp_rrm0jv_/privsep.sock'] Nov 01 12:20:39 devstack sudo[87852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmp_rrm0jv_/privsep.sock Nov 01 12:20:39 devstack sudo[87852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:20:39 devstack cinder-volume[86574]: DEBUG oslo_service.periodic_task [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86574) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:20:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:20:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:20:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:20:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:20:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:20:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:20:39 devstack sudo[87857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:20:39 devstack sudo[87857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:20:40 devstack sudo[87847]: pam_unix(sudo:session): session closed for user root Nov 01 12:20:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-23e78529-f2b4-4588-adc5-054fd3747cc6 tempest-ServerRescueNegativeTestJSON-1777499268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6d39ac0f-06e5-4b93-9c59-1132cf3fcde4 1073741824" returned: 0 in 1.543s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:20:40 devstack sudo[87857]: pam_unix(sudo:session): session closed for user root Nov 01 12:20:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.715s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:20:40 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:20:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-23e78529-f2b4-4588-adc5-054fd3747cc6 tempest-ServerRescueNegativeTestJSON-1777499268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6d39ac0f-06e5-4b93-9c59-1132cf3fcde4 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:20:40 devstack cinder-volume[86574]: DEBUG oslo_service.periodic_task [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running periodic task VolumeManager._thread_info {{(pid=86574) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:20:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] thread count: 7 {{(pid=86574) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 12:20:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] thread info: [<_MainThread(MainThread, started 131331184930944)>, , , , , , ] {{(pid=86574) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 12:20:40 devstack sudo[87861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6d39ac0f-06e5-4b93-9c59-1132cf3fcde4 Nov 01 12:20:40 devstack sudo[87861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:20:41 devstack sudo[87861]: pam_unix(sudo:session): session closed for user root Nov 01 12:20:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-23e78529-f2b4-4588-adc5-054fd3747cc6 tempest-ServerRescueNegativeTestJSON-1777499268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6d39ac0f-06e5-4b93-9c59-1132cf3fcde4" returned: 0 in 0.452s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:20:41 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-23e78529-f2b4-4588-adc5-054fd3747cc6 tempest-ServerRescueNegativeTestJSON-1777499268 None] <== create_volume: return (2166ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:20:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-23e78529-f2b4-4588-adc5-054fd3747cc6 tempest-ServerRescueNegativeTestJSON-1777499268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.174s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:20:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-23e78529-f2b4-4588-adc5-054fd3747cc6 tempest-ServerRescueNegativeTestJSON-1777499268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d6414789-6814-447a-8cdf-5b398bb191fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d39ac0f-06e5-4b93-9c59-1132cf3fcde4', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:20:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-23e78529-f2b4-4588-adc5-054fd3747cc6 tempest-ServerRescueNegativeTestJSON-1777499268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11a2f9c5-c824-4343-ae83-369cba8eca30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:20:41 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-23e78529-f2b4-4588-adc5-054fd3747cc6 tempest-ServerRescueNegativeTestJSON-1777499268 None] Volume volume-6d39ac0f-06e5-4b93-9c59-1132cf3fcde4 (6d39ac0f-06e5-4b93-9c59-1132cf3fcde4): created successfully Nov 01 12:20:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-23e78529-f2b4-4588-adc5-054fd3747cc6 tempest-ServerRescueNegativeTestJSON-1777499268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11a2f9c5-c824-4343-ae83-369cba8eca30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:20:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-23e78529-f2b4-4588-adc5-054fd3747cc6 tempest-ServerRescueNegativeTestJSON-1777499268 None] Flow 'volume_create_manager' (150db232-f338-4637-82d1-6b533cfa044c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:20:41 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-23e78529-f2b4-4588-adc5-054fd3747cc6 tempest-ServerRescueNegativeTestJSON-1777499268 None] Created volume successfully. Nov 01 12:20:41 devstack cinder-volume[86574]: WARNING oslo.privsep.daemon [-] privsep log: /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:105: EventletDeprecationWarning: Nov 01 12:20:41 devstack cinder-volume[86574]: WARNING oslo.privsep.daemon [-] privsep log: Eventlet is deprecated. It is currently being maintained in bugfix mode, and Nov 01 12:20:41 devstack cinder-volume[86574]: WARNING oslo.privsep.daemon [-] privsep log: we strongly recommend against using it for new projects. Nov 01 12:20:41 devstack cinder-volume[86574]: WARNING oslo.privsep.daemon [-] privsep log: Nov 01 12:20:41 devstack cinder-volume[86574]: WARNING oslo.privsep.daemon [-] privsep log: If you are already using Eventlet, we recommend migrating to a different Nov 01 12:20:41 devstack cinder-volume[86574]: WARNING oslo.privsep.daemon [-] privsep log: framework. For more detail see Nov 01 12:20:41 devstack cinder-volume[86574]: WARNING oslo.privsep.daemon [-] privsep log: https://eventlet.readthedocs.io/en/latest/asyncio/migration.html Nov 01 12:20:41 devstack cinder-volume[86574]: WARNING oslo.privsep.daemon [-] privsep log: Nov 01 12:20:41 devstack cinder-volume[86574]: WARNING oslo.privsep.daemon [-] privsep log: import eventlet Nov 01 12:20:42 devstack sudo[87852]: pam_unix(sudo:session): session closed for user root Nov 01 12:20:42 devstack cinder-volume[86574]: INFO oslo.privsep.daemon [None req-e703c839-72b0-4675-9bea-90eb7efeef8f tempest-VolumesAdminNegativeTest-1817923670 None] Spawned new privsep daemon via rootwrap Nov 01 12:20:42 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [None req-e703c839-72b0-4675-9bea-90eb7efeef8f tempest-VolumesAdminNegativeTest-1817923670 None] Accepted privsep connection to /tmp/tmp_rrm0jv_/privsep.sock {{(pid=86574) __init__ /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:425}} Nov 01 12:20:42 devstack cinder-volume[86574]: INFO oslo.privsep.daemon [-] privsep daemon starting Nov 01 12:20:42 devstack cinder-volume[86574]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0 Nov 01 12:20:42 devstack cinder-volume[86574]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none Nov 01 12:20:42 devstack cinder-volume[86574]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 87870 Nov 01 12:20:42 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[c5b36482-c33f-4bb1-8ea0-5cd094920ce1]: (2,) {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:20:42 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca81e92a-e60a-4668-ac81-69e14af08774]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:20:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e703c839-72b0-4675-9bea-90eb7efeef8f tempest-VolumesAdminNegativeTest-1817923670 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3c89636c-4236-4c27-afd1-4d6fe48e3cfa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:20:42 devstack sudo[87872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3c89636c-4236-4c27-afd1-4d6fe48e3cfa Nov 01 12:20:42 devstack sudo[87872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:20:43 devstack sudo[87872]: pam_unix(sudo:session): session closed for user root Nov 01 12:20:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e703c839-72b0-4675-9bea-90eb7efeef8f tempest-VolumesAdminNegativeTest-1817923670 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3c89636c-4236-4c27-afd1-4d6fe48e3cfa" returned: 0 in 1.017s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:20:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e703c839-72b0-4675-9bea-90eb7efeef8f tempest-VolumesAdminNegativeTest-1817923670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3c89636c-4236-4c27-afd1-4d6fe48e3cfa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:20:43 devstack sudo[87893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3c89636c-4236-4c27-afd1-4d6fe48e3cfa Nov 01 12:20:43 devstack sudo[87893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:20:44 devstack sudo[87893]: pam_unix(sudo:session): session closed for user root Nov 01 12:20:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e703c839-72b0-4675-9bea-90eb7efeef8f tempest-VolumesAdminNegativeTest-1817923670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3c89636c-4236-4c27-afd1-4d6fe48e3cfa" returned: 0 in 0.620s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:20:44 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e703c839-72b0-4675-9bea-90eb7efeef8f tempest-VolumesAdminNegativeTest-1817923670 None] Lock "cinder-quobyte-3c89636c-4236-4c27-afd1-4d6fe48e3cfa" released by "delete_volume" :: held 4.450s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:20:44 devstack cinder-volume[86574]: WARNING cinder.quota [None req-e703c839-72b0-4675-9bea-90eb7efeef8f tempest-VolumesAdminNegativeTest-1817923670 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:20:44 devstack cinder-volume[86574]: WARNING cinder.quota [None req-e703c839-72b0-4675-9bea-90eb7efeef8f tempest-VolumesAdminNegativeTest-1817923670 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:20:44 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-e703c839-72b0-4675-9bea-90eb7efeef8f tempest-VolumesAdminNegativeTest-1817923670 None] Created reservations ['15f2e234-3f02-4114-aecd-4b3014d31a51', '53498cb8-9b1e-447c-ab00-7d92cfdd5bbf', '88c3fb1c-bd44-4712-acf5-81fffa9110de', '123f46d3-950b-4073-9744-576f1eb6a875'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:20:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e703c839-72b0-4675-9bea-90eb7efeef8f tempest-VolumesAdminNegativeTest-1817923670 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:20:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e703c839-72b0-4675-9bea-90eb7efeef8f tempest-VolumesAdminNegativeTest-1817923670 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:20:44 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e703c839-72b0-4675-9bea-90eb7efeef8f tempest-VolumesAdminNegativeTest-1817923670 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:20:44 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e703c839-72b0-4675-9bea-90eb7efeef8f tempest-VolumesAdminNegativeTest-1817923670 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:20:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e703c839-72b0-4675-9bea-90eb7efeef8f tempest-VolumesAdminNegativeTest-1817923670 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:20:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e703c839-72b0-4675-9bea-90eb7efeef8f tempest-VolumesAdminNegativeTest-1817923670 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:20:44 devstack sudo[87907]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:20:44 devstack sudo[87907]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:20:45 devstack cinder-volume[86574]: WARNING py.warnings [req-2b3b90a0-a7a5-4514-a73c-e27773567005 req-0ef6e1ad-9139-43da-815d-ae36088172ef tempest-DeleteServersTestJSON-154995912 None] /opt/stack/cinder/cinder/db/api.py:2468: SAWarning: SELECT statement has a cartesian product between FROM element(s) "volumes_1", "volume_attachment" and FROM element "volumes". Apply join condition(s) between each element to resolve. Nov 01 12:20:45 devstack cinder-volume[86574]: .first() Nov 01 12:20:45 devstack cinder-volume[86574]: Nov 01 12:20:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-2b3b90a0-a7a5-4514-a73c-e27773567005 req-0ef6e1ad-9139-43da-815d-ae36088172ef tempest-DeleteServersTestJSON-154995912 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:20:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-2b3b90a0-a7a5-4514-a73c-e27773567005 req-0ef6e1ad-9139-43da-815d-ae36088172ef tempest-DeleteServersTestJSON-154995912 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:20:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-2b3b90a0-a7a5-4514-a73c-e27773567005 req-0ef6e1ad-9139-43da-815d-ae36088172ef tempest-DeleteServersTestJSON-154995912 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:20:45 devstack sudo[87907]: pam_unix(sudo:session): session closed for user root Nov 01 12:20:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e703c839-72b0-4675-9bea-90eb7efeef8f tempest-VolumesAdminNegativeTest-1817923670 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.912s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:20:45 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-e703c839-72b0-4675-9bea-90eb7efeef8f tempest-VolumesAdminNegativeTest-1817923670 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:20:45 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-e703c839-72b0-4675-9bea-90eb7efeef8f tempest-VolumesAdminNegativeTest-1817923670 None] Deleted volume successfully. Nov 01 12:20:45 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-2b3b90a0-a7a5-4514-a73c-e27773567005 req-0ef6e1ad-9139-43da-815d-ae36088172ef tempest-DeleteServersTestJSON-154995912 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb', 'name': 'volume-b7af3b54-9094-40b4-8303-565f029cd167', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '354a982a-dc43-46c1-8c4a-51986076d995', 'enforce_multipath': True} {{(pid=86574) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 12:20:45 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e703c839-72b0-4675-9bea-90eb7efeef8f tempest-VolumesAdminNegativeTest-1817923670 None] Lock "cinder-3c89636c-4236-4c27-afd1-4d6fe48e3cfa-delete_volume" released by "delete_volume" :: held 6.584s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:20:46 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-2b3b90a0-a7a5-4514-a73c-e27773567005 req-0ef6e1ad-9139-43da-815d-ae36088172ef tempest-DeleteServersTestJSON-154995912 None] attachment_update completed successfully. Nov 01 12:20:54 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-a651bc40-4e0a-4b4f-8170-4f41e11fd46a req-d9fc6fff-f297-4928-bb91-7f283ce6dabb tempest-DeleteServersTestJSON-154995912 None] Terminate volume connection completed successfully. Nov 01 12:20:54 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-a651bc40-4e0a-4b4f-8170-4f41e11fd46a req-d9fc6fff-f297-4928-bb91-7f283ce6dabb tempest-DeleteServersTestJSON-154995912 None] Deleting attachment 354a982a-dc43-46c1-8c4a-51986076d995. {{(pid=86574) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 12:20:56 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-59bf790f-c30a-483a-97c7-6bb7737bb16f tempest-ServerRescueNegativeTestJSON-1777499268 None] Acquiring lock "cinder-6d39ac0f-06e5-4b93-9c59-1132cf3fcde4-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:20:56 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:SELECT=19,cinder:UPDATE=16,cinder:DELETE=1,cinder:INSERT=3 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:20:56 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-59bf790f-c30a-483a-97c7-6bb7737bb16f tempest-ServerRescueNegativeTestJSON-1777499268 None] Lock "cinder-6d39ac0f-06e5-4b93-9c59-1132cf3fcde4-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:20:56 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-59bf790f-c30a-483a-97c7-6bb7737bb16f tempest-ServerRescueNegativeTestJSON-1777499268 None] Acquiring lock "cinder-quobyte-6d39ac0f-06e5-4b93-9c59-1132cf3fcde4" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:20:56 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-59bf790f-c30a-483a-97c7-6bb7737bb16f tempest-ServerRescueNegativeTestJSON-1777499268 None] Lock "cinder-quobyte-6d39ac0f-06e5-4b93-9c59-1132cf3fcde4" acquired by "delete_volume" :: waited 0.032s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:20:56 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f79b807-65c5-4cdd-a0e7-e589f6860331]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:20:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-59bf790f-c30a-483a-97c7-6bb7737bb16f tempest-ServerRescueNegativeTestJSON-1777499268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6d39ac0f-06e5-4b93-9c59-1132cf3fcde4 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:20:56 devstack sudo[88517]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6d39ac0f-06e5-4b93-9c59-1132cf3fcde4 Nov 01 12:20:56 devstack sudo[88517]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:20:56 devstack sudo[88517]: pam_unix(sudo:session): session closed for user root Nov 01 12:20:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-59bf790f-c30a-483a-97c7-6bb7737bb16f tempest-ServerRescueNegativeTestJSON-1777499268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6d39ac0f-06e5-4b93-9c59-1132cf3fcde4" returned: 0 in 0.606s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:20:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-59bf790f-c30a-483a-97c7-6bb7737bb16f tempest-ServerRescueNegativeTestJSON-1777499268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6d39ac0f-06e5-4b93-9c59-1132cf3fcde4 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:20:57 devstack sudo[88522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6d39ac0f-06e5-4b93-9c59-1132cf3fcde4 Nov 01 12:20:57 devstack sudo[88522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:20:57 devstack sudo[88522]: pam_unix(sudo:session): session closed for user root Nov 01 12:20:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-59bf790f-c30a-483a-97c7-6bb7737bb16f tempest-ServerRescueNegativeTestJSON-1777499268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6d39ac0f-06e5-4b93-9c59-1132cf3fcde4" returned: 0 in 0.447s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:20:57 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-59bf790f-c30a-483a-97c7-6bb7737bb16f tempest-ServerRescueNegativeTestJSON-1777499268 None] Lock "cinder-quobyte-6d39ac0f-06e5-4b93-9c59-1132cf3fcde4" released by "delete_volume" :: held 1.160s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:20:57 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-59bf790f-c30a-483a-97c7-6bb7737bb16f tempest-ServerRescueNegativeTestJSON-1777499268 None] Created reservations ['c88b582c-c721-4826-a4ce-b80202e1727e', '85228b5e-06f5-498d-9959-30539eb69270', 'e811a5c2-b09d-4726-ab85-dca2fc6b39a4', '7acee906-2c36-4b4e-8c42-2e7a7f0afb76'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:20:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-59bf790f-c30a-483a-97c7-6bb7737bb16f tempest-ServerRescueNegativeTestJSON-1777499268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:20:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-59bf790f-c30a-483a-97c7-6bb7737bb16f tempest-ServerRescueNegativeTestJSON-1777499268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:20:57 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-59bf790f-c30a-483a-97c7-6bb7737bb16f tempest-ServerRescueNegativeTestJSON-1777499268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:20:57 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-59bf790f-c30a-483a-97c7-6bb7737bb16f tempest-ServerRescueNegativeTestJSON-1777499268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:20:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-59bf790f-c30a-483a-97c7-6bb7737bb16f tempest-ServerRescueNegativeTestJSON-1777499268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:20:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-59bf790f-c30a-483a-97c7-6bb7737bb16f tempest-ServerRescueNegativeTestJSON-1777499268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:20:57 devstack sudo[88526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:20:57 devstack sudo[88526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:20:57 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-4b49809d-8c9e-406f-b77e-6cd5ebd3dbf1 tempest-DeleteServersTestJSON-154995912 None] Acquiring lock "cinder-b7af3b54-9094-40b4-8303-565f029cd167-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:20:57 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-4b49809d-8c9e-406f-b77e-6cd5ebd3dbf1 tempest-DeleteServersTestJSON-154995912 None] Lock "cinder-b7af3b54-9094-40b4-8303-565f029cd167-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:20:57 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-4b49809d-8c9e-406f-b77e-6cd5ebd3dbf1 tempest-DeleteServersTestJSON-154995912 None] Acquiring lock "cinder-quobyte-b7af3b54-9094-40b4-8303-565f029cd167" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:20:58 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-4b49809d-8c9e-406f-b77e-6cd5ebd3dbf1 tempest-DeleteServersTestJSON-154995912 None] Lock "cinder-quobyte-b7af3b54-9094-40b4-8303-565f029cd167" acquired by "delete_volume" :: waited 0.025s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:20:58 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[82b7190d-fd04-4d59-af4a-0c25eda01457]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:20:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4b49809d-8c9e-406f-b77e-6cd5ebd3dbf1 tempest-DeleteServersTestJSON-154995912 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b7af3b54-9094-40b4-8303-565f029cd167 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:20:58 devstack sudo[88526]: pam_unix(sudo:session): session closed for user root Nov 01 12:20:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-59bf790f-c30a-483a-97c7-6bb7737bb16f tempest-ServerRescueNegativeTestJSON-1777499268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.379s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:20:58 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-59bf790f-c30a-483a-97c7-6bb7737bb16f tempest-ServerRescueNegativeTestJSON-1777499268 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:20:58 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-59bf790f-c30a-483a-97c7-6bb7737bb16f tempest-ServerRescueNegativeTestJSON-1777499268 None] Deleted volume successfully. Nov 01 12:20:58 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-59bf790f-c30a-483a-97c7-6bb7737bb16f tempest-ServerRescueNegativeTestJSON-1777499268 None] Lock "cinder-6d39ac0f-06e5-4b93-9c59-1132cf3fcde4-delete_volume" released by "delete_volume" :: held 1.939s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:20:58 devstack sudo[88529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b7af3b54-9094-40b4-8303-565f029cd167 Nov 01 12:20:58 devstack sudo[88529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:20:58 devstack sudo[88529]: pam_unix(sudo:session): session closed for user root Nov 01 12:20:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4b49809d-8c9e-406f-b77e-6cd5ebd3dbf1 tempest-DeleteServersTestJSON-154995912 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b7af3b54-9094-40b4-8303-565f029cd167" returned: 0 in 0.514s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:20:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4b49809d-8c9e-406f-b77e-6cd5ebd3dbf1 tempest-DeleteServersTestJSON-154995912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b7af3b54-9094-40b4-8303-565f029cd167 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:20:58 devstack sudo[88534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b7af3b54-9094-40b4-8303-565f029cd167 Nov 01 12:20:58 devstack sudo[88534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:20:59 devstack sudo[88534]: pam_unix(sudo:session): session closed for user root Nov 01 12:20:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4b49809d-8c9e-406f-b77e-6cd5ebd3dbf1 tempest-DeleteServersTestJSON-154995912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b7af3b54-9094-40b4-8303-565f029cd167" returned: 0 in 0.498s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:20:59 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-4b49809d-8c9e-406f-b77e-6cd5ebd3dbf1 tempest-DeleteServersTestJSON-154995912 None] Lock "cinder-quobyte-b7af3b54-9094-40b4-8303-565f029cd167" released by "delete_volume" :: held 1.088s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:20:59 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-4b49809d-8c9e-406f-b77e-6cd5ebd3dbf1 tempest-DeleteServersTestJSON-154995912 None] Created reservations ['4be920f2-1d14-4f71-a418-c42597ad9cc7', '798d1f08-6e27-4911-9809-1fa930bb5692', '7fb30aa0-6091-43fd-9b53-833ee02463e5', 'ace2c9ad-7411-4cc2-8189-55e8cd9ca840'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:20:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4b49809d-8c9e-406f-b77e-6cd5ebd3dbf1 tempest-DeleteServersTestJSON-154995912 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:20:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4b49809d-8c9e-406f-b77e-6cd5ebd3dbf1 tempest-DeleteServersTestJSON-154995912 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:20:59 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-4b49809d-8c9e-406f-b77e-6cd5ebd3dbf1 tempest-DeleteServersTestJSON-154995912 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:20:59 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-4b49809d-8c9e-406f-b77e-6cd5ebd3dbf1 tempest-DeleteServersTestJSON-154995912 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:20:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4b49809d-8c9e-406f-b77e-6cd5ebd3dbf1 tempest-DeleteServersTestJSON-154995912 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:20:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4b49809d-8c9e-406f-b77e-6cd5ebd3dbf1 tempest-DeleteServersTestJSON-154995912 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:20:59 devstack sudo[88545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:20:59 devstack sudo[88545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:20:59 devstack sudo[88545]: pam_unix(sudo:session): session closed for user root Nov 01 12:20:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4b49809d-8c9e-406f-b77e-6cd5ebd3dbf1 tempest-DeleteServersTestJSON-154995912 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.457s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:20:59 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-4b49809d-8c9e-406f-b77e-6cd5ebd3dbf1 tempest-DeleteServersTestJSON-154995912 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:20:59 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-4b49809d-8c9e-406f-b77e-6cd5ebd3dbf1 tempest-DeleteServersTestJSON-154995912 None] Deleted volume successfully. Nov 01 12:20:59 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-4b49809d-8c9e-406f-b77e-6cd5ebd3dbf1 tempest-DeleteServersTestJSON-154995912 None] Lock "cinder-b7af3b54-9094-40b4-8303-565f029cd167-delete_volume" released by "delete_volume" :: held 1.899s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:21:18 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:UPDATE=15,cinder:SELECT=9,cinder:INSERT=3 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:21:18 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:UPDATE=39,cinder:SELECT=30,cinder:INSERT=9,cinder:DELETE=5 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:21:24 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [req-402e77bd-b79b-4aa6-8226-4864b18942d6 req-85ff1298-79e3-48e4-a1b6-52d07ea32471 tempest-VolumesSnapshotsTestJSON-707211424 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:21:24 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-402e77bd-b79b-4aa6-8226-4864b18942d6 req-85ff1298-79e3-48e4-a1b6-52d07ea32471 tempest-VolumesSnapshotsTestJSON-707211424 None] Flow 'volume_create_manager' (32b31a7e-ebb7-43b4-837c-96d8e8b8c44b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:21:24 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-402e77bd-b79b-4aa6-8226-4864b18942d6 req-85ff1298-79e3-48e4-a1b6-52d07ea32471 tempest-VolumesSnapshotsTestJSON-707211424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77e3883a-a6c4-46b0-81ad-efc531a188b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:21:24 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-402e77bd-b79b-4aa6-8226-4864b18942d6 req-85ff1298-79e3-48e4-a1b6-52d07ea32471 tempest-VolumesSnapshotsTestJSON-707211424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77e3883a-a6c4-46b0-81ad-efc531a188b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1473146339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08b0d3ef-b593-4398-b139-4a3c74e2eb71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec68436aa2054182a1e6f70f3141e104',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:21:25Z,use_quota=True,user_id='35ccbdc891464b98a7f90d4478719460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:21:24 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-402e77bd-b79b-4aa6-8226-4864b18942d6 req-85ff1298-79e3-48e4-a1b6-52d07ea32471 tempest-VolumesSnapshotsTestJSON-707211424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (070ee3a4-bf06-4274-b6af-90829e6774b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:21:24 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-402e77bd-b79b-4aa6-8226-4864b18942d6 req-85ff1298-79e3-48e4-a1b6-52d07ea32471 tempest-VolumesSnapshotsTestJSON-707211424 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (070ee3a4-bf06-4274-b6af-90829e6774b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:21:24 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-402e77bd-b79b-4aa6-8226-4864b18942d6 req-85ff1298-79e3-48e4-a1b6-52d07ea32471 tempest-VolumesSnapshotsTestJSON-707211424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfec0fd9-c732-4f47-b23c-21e60ad68386) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:21:24 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-402e77bd-b79b-4aa6-8226-4864b18942d6 req-85ff1298-79e3-48e4-a1b6-52d07ea32471 tempest-VolumesSnapshotsTestJSON-707211424 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bfec0fd9-c732-4f47-b23c-21e60ad68386) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '08b0d3ef-b593-4398-b139-4a3c74e2eb71', 'volume_name': 'volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:21:24 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-402e77bd-b79b-4aa6-8226-4864b18942d6 req-85ff1298-79e3-48e4-a1b6-52d07ea32471 tempest-VolumesSnapshotsTestJSON-707211424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e376a737-9e86-4ce5-8420-54ac597befe8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:21:24 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-402e77bd-b79b-4aa6-8226-4864b18942d6 req-85ff1298-79e3-48e4-a1b6-52d07ea32471 tempest-VolumesSnapshotsTestJSON-707211424 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e376a737-9e86-4ce5-8420-54ac597befe8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:21:24 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-402e77bd-b79b-4aa6-8226-4864b18942d6 req-85ff1298-79e3-48e4-a1b6-52d07ea32471 tempest-VolumesSnapshotsTestJSON-707211424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8bf121f-0415-4b62-9ece-2cab982ac393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:21:24 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [req-402e77bd-b79b-4aa6-8226-4864b18942d6 req-85ff1298-79e3-48e4-a1b6-52d07ea32471 tempest-VolumesSnapshotsTestJSON-707211424 None] Volume 08b0d3ef-b593-4398-b139-4a3c74e2eb71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71', 'volume_size': 1} Nov 01 12:21:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-402e77bd-b79b-4aa6-8226-4864b18942d6 req-85ff1298-79e3-48e4-a1b6-52d07ea32471 tempest-VolumesSnapshotsTestJSON-707211424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:21:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-402e77bd-b79b-4aa6-8226-4864b18942d6 req-85ff1298-79e3-48e4-a1b6-52d07ea32471 tempest-VolumesSnapshotsTestJSON-707211424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:21:24 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [req-402e77bd-b79b-4aa6-8226-4864b18942d6 req-85ff1298-79e3-48e4-a1b6-52d07ea32471 tempest-VolumesSnapshotsTestJSON-707211424 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:21:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-1473146339',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=08b0d3ef-b593-4398-b139-4a3c74e2eb71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec68436aa2054182a1e6f70f3141e104',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:21:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:21:25Z,use_quota=True,user_id='35ccbdc891464b98a7f90d4478719460',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:21:24 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [req-402e77bd-b79b-4aa6-8226-4864b18942d6 req-85ff1298-79e3-48e4-a1b6-52d07ea32471 tempest-VolumesSnapshotsTestJSON-707211424 None] Creating volume 08b0d3ef-b593-4398-b139-4a3c74e2eb71 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:21:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-402e77bd-b79b-4aa6-8226-4864b18942d6 req-85ff1298-79e3-48e4-a1b6-52d07ea32471 tempest-VolumesSnapshotsTestJSON-707211424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:21:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-402e77bd-b79b-4aa6-8226-4864b18942d6 req-85ff1298-79e3-48e4-a1b6-52d07ea32471 tempest-VolumesSnapshotsTestJSON-707211424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:21:24 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [req-402e77bd-b79b-4aa6-8226-4864b18942d6 req-85ff1298-79e3-48e4-a1b6-52d07ea32471 tempest-VolumesSnapshotsTestJSON-707211424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:21:24 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [req-402e77bd-b79b-4aa6-8226-4864b18942d6 req-85ff1298-79e3-48e4-a1b6-52d07ea32471 tempest-VolumesSnapshotsTestJSON-707211424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:21:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-402e77bd-b79b-4aa6-8226-4864b18942d6 req-85ff1298-79e3-48e4-a1b6-52d07ea32471 tempest-VolumesSnapshotsTestJSON-707211424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:21:24 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [req-402e77bd-b79b-4aa6-8226-4864b18942d6 req-85ff1298-79e3-48e4-a1b6-52d07ea32471 tempest-VolumesSnapshotsTestJSON-707211424 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:21:24 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [req-402e77bd-b79b-4aa6-8226-4864b18942d6 req-85ff1298-79e3-48e4-a1b6-52d07ea32471 tempest-VolumesSnapshotsTestJSON-707211424 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:21:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [req-402e77bd-b79b-4aa6-8226-4864b18942d6 req-85ff1298-79e3-48e4-a1b6-52d07ea32471 tempest-VolumesSnapshotsTestJSON-707211424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:24 devstack sudo[88631]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71 1073741824 Nov 01 12:21:24 devstack sudo[88631]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:25 devstack sudo[88631]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [req-402e77bd-b79b-4aa6-8226-4864b18942d6 req-85ff1298-79e3-48e4-a1b6-52d07ea32471 tempest-VolumesSnapshotsTestJSON-707211424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71 1073741824" returned: 0 in 0.663s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [req-402e77bd-b79b-4aa6-8226-4864b18942d6 req-85ff1298-79e3-48e4-a1b6-52d07ea32471 tempest-VolumesSnapshotsTestJSON-707211424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:25 devstack sudo[88637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71 Nov 01 12:21:25 devstack sudo[88637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:25 devstack sudo[88637]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [req-402e77bd-b79b-4aa6-8226-4864b18942d6 req-85ff1298-79e3-48e4-a1b6-52d07ea32471 tempest-VolumesSnapshotsTestJSON-707211424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71" returned: 0 in 0.378s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:26 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [req-402e77bd-b79b-4aa6-8226-4864b18942d6 req-85ff1298-79e3-48e4-a1b6-52d07ea32471 tempest-VolumesSnapshotsTestJSON-707211424 None] <== create_volume: return (1113ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:21:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-402e77bd-b79b-4aa6-8226-4864b18942d6 req-85ff1298-79e3-48e4-a1b6-52d07ea32471 tempest-VolumesSnapshotsTestJSON-707211424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.116s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:21:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-402e77bd-b79b-4aa6-8226-4864b18942d6 req-85ff1298-79e3-48e4-a1b6-52d07ea32471 tempest-VolumesSnapshotsTestJSON-707211424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e8bf121f-0415-4b62-9ece-2cab982ac393) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:21:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-402e77bd-b79b-4aa6-8226-4864b18942d6 req-85ff1298-79e3-48e4-a1b6-52d07ea32471 tempest-VolumesSnapshotsTestJSON-707211424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f6c33c3-45c4-49fe-8be6-abcc2016a3c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:21:26 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [req-402e77bd-b79b-4aa6-8226-4864b18942d6 req-85ff1298-79e3-48e4-a1b6-52d07ea32471 tempest-VolumesSnapshotsTestJSON-707211424 None] Volume volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71 (08b0d3ef-b593-4398-b139-4a3c74e2eb71): created successfully Nov 01 12:21:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-402e77bd-b79b-4aa6-8226-4864b18942d6 req-85ff1298-79e3-48e4-a1b6-52d07ea32471 tempest-VolumesSnapshotsTestJSON-707211424 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5f6c33c3-45c4-49fe-8be6-abcc2016a3c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:21:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-402e77bd-b79b-4aa6-8226-4864b18942d6 req-85ff1298-79e3-48e4-a1b6-52d07ea32471 tempest-VolumesSnapshotsTestJSON-707211424 None] Flow 'volume_create_manager' (32b31a7e-ebb7-43b4-837c-96d8e8b8c44b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:21:26 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-402e77bd-b79b-4aa6-8226-4864b18942d6 req-85ff1298-79e3-48e4-a1b6-52d07ea32471 tempest-VolumesSnapshotsTestJSON-707211424 None] Created volume successfully. Nov 01 12:21:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-c45880e9-ac66-4b09-b9a3-2adc935ed5e4 req-2265989d-4ef9-4d09-9f1b-c717e59f2399 tempest-VolumesSnapshotsTestJSON-707211424 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:21:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-c45880e9-ac66-4b09-b9a3-2adc935ed5e4 req-2265989d-4ef9-4d09-9f1b-c717e59f2399 tempest-VolumesSnapshotsTestJSON-707211424 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:21:27 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [req-c45880e9-ac66-4b09-b9a3-2adc935ed5e4 req-2265989d-4ef9-4d09-9f1b-c717e59f2399 tempest-VolumesSnapshotsTestJSON-707211424 None] Creating offline snapshot dcaf9d7a-829b-4705-aa8a-df9c32580ba5 of volume 08b0d3ef-b593-4398-b139-4a3c74e2eb71 {{(pid=86574) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:21:27 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[20c924f5-107d-4812-b811-4557a80a1f21]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:21:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [req-c45880e9-ac66-4b09-b9a3-2adc935ed5e4 req-2265989d-4ef9-4d09-9f1b-c717e59f2399 tempest-VolumesSnapshotsTestJSON-707211424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:27 devstack sudo[88641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71 Nov 01 12:21:27 devstack sudo[88641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:27 devstack sudo[88641]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [req-c45880e9-ac66-4b09-b9a3-2adc935ed5e4 req-2265989d-4ef9-4d09-9f1b-c717e59f2399 tempest-VolumesSnapshotsTestJSON-707211424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71" returned: 0 in 0.512s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [req-c45880e9-ac66-4b09-b9a3-2adc935ed5e4 req-2265989d-4ef9-4d09-9f1b-c717e59f2399 tempest-VolumesSnapshotsTestJSON-707211424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71.dcaf9d7a-829b-4705-aa8a-df9c32580ba5 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:27 devstack sudo[88646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71.dcaf9d7a-829b-4705-aa8a-df9c32580ba5 1G Nov 01 12:21:27 devstack sudo[88646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:28 devstack sudo[88646]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [req-c45880e9-ac66-4b09-b9a3-2adc935ed5e4 req-2265989d-4ef9-4d09-9f1b-c717e59f2399 tempest-VolumesSnapshotsTestJSON-707211424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71.dcaf9d7a-829b-4705-aa8a-df9c32580ba5 1G" returned: 0 in 0.541s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [req-c45880e9-ac66-4b09-b9a3-2adc935ed5e4 req-2265989d-4ef9-4d09-9f1b-c717e59f2399 tempest-VolumesSnapshotsTestJSON-707211424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71.dcaf9d7a-829b-4705-aa8a-df9c32580ba5 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:28 devstack sudo[88653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71.dcaf9d7a-829b-4705-aa8a-df9c32580ba5 Nov 01 12:21:28 devstack sudo[88653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:28 devstack sudo[88653]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [req-c45880e9-ac66-4b09-b9a3-2adc935ed5e4 req-2265989d-4ef9-4d09-9f1b-c717e59f2399 tempest-VolumesSnapshotsTestJSON-707211424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71.dcaf9d7a-829b-4705-aa8a-df9c32580ba5" returned: 0 in 0.441s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:28 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [req-c45880e9-ac66-4b09-b9a3-2adc935ed5e4 req-2265989d-4ef9-4d09-9f1b-c717e59f2399 tempest-VolumesSnapshotsTestJSON-707211424 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71.dcaf9d7a-829b-4705-aa8a-df9c32580ba5 is being set with open permissions: ugo+rw Nov 01 12:21:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [req-c45880e9-ac66-4b09-b9a3-2adc935ed5e4 req-2265989d-4ef9-4d09-9f1b-c717e59f2399 tempest-VolumesSnapshotsTestJSON-707211424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71.dcaf9d7a-829b-4705-aa8a-df9c32580ba5 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:28 devstack sudo[88693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71.dcaf9d7a-829b-4705-aa8a-df9c32580ba5 Nov 01 12:21:28 devstack sudo[88693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:29 devstack sudo[88693]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [req-c45880e9-ac66-4b09-b9a3-2adc935ed5e4 req-2265989d-4ef9-4d09-9f1b-c717e59f2399 tempest-VolumesSnapshotsTestJSON-707211424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71.dcaf9d7a-829b-4705-aa8a-df9c32580ba5" returned: 0 in 0.357s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [req-c45880e9-ac66-4b09-b9a3-2adc935ed5e4 req-2265989d-4ef9-4d09-9f1b-c717e59f2399 tempest-VolumesSnapshotsTestJSON-707211424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:29 devstack sudo[88696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71.info Nov 01 12:21:29 devstack sudo[88696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:29 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c68b926-ffe2-4315-b91c-0b19ac173312 tempest-TaggedAttachmentsTest-66506181 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:21:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9c68b926-ffe2-4315-b91c-0b19ac173312 tempest-TaggedAttachmentsTest-66506181 None] Flow 'volume_create_manager' (bdeaa59d-c84d-46aa-8420-7885a6799a1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:21:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9c68b926-ffe2-4315-b91c-0b19ac173312 tempest-TaggedAttachmentsTest-66506181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93157ae5-2bc6-4c43-8dbc-4d4cd701b136) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:21:29 devstack sudo[88696]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [req-c45880e9-ac66-4b09-b9a3-2adc935ed5e4 req-2265989d-4ef9-4d09-9f1b-c717e59f2399 tempest-VolumesSnapshotsTestJSON-707211424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71.info" returned: 0 in 0.399s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:29 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [req-c45880e9-ac66-4b09-b9a3-2adc935ed5e4 req-2265989d-4ef9-4d09-9f1b-c717e59f2399 tempest-VolumesSnapshotsTestJSON-707211424 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71.info is being set with open permissions: ugo+rw Nov 01 12:21:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [req-c45880e9-ac66-4b09-b9a3-2adc935ed5e4 req-2265989d-4ef9-4d09-9f1b-c717e59f2399 tempest-VolumesSnapshotsTestJSON-707211424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9c68b926-ffe2-4315-b91c-0b19ac173312 tempest-TaggedAttachmentsTest-66506181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (93157ae5-2bc6-4c43-8dbc-4d4cd701b136) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1321693927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0beaf06f-3f52-45dd-bcb0-32df856a87dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c633266d474542499a65d302c1a9e6a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:21:30Z,use_quota=True,user_id='9b5ec3652bd142928581f227b68aa81c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:21:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9c68b926-ffe2-4315-b91c-0b19ac173312 tempest-TaggedAttachmentsTest-66506181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54c8db3c-d82c-47b0-b99c-7d959d23e76b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:21:29 devstack sudo[88701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71.info Nov 01 12:21:29 devstack sudo[88701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9c68b926-ffe2-4315-b91c-0b19ac173312 tempest-TaggedAttachmentsTest-66506181 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (54c8db3c-d82c-47b0-b99c-7d959d23e76b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:21:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9c68b926-ffe2-4315-b91c-0b19ac173312 tempest-TaggedAttachmentsTest-66506181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5ebacf3-a2aa-42f6-81ea-ec37d90f7592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:21:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9c68b926-ffe2-4315-b91c-0b19ac173312 tempest-TaggedAttachmentsTest-66506181 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5ebacf3-a2aa-42f6-81ea-ec37d90f7592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0beaf06f-3f52-45dd-bcb0-32df856a87dc', 'volume_name': 'volume-0beaf06f-3f52-45dd-bcb0-32df856a87dc', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:21:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9c68b926-ffe2-4315-b91c-0b19ac173312 tempest-TaggedAttachmentsTest-66506181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a956a5d-0026-4f64-8af5-dfed4f6efa32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:21:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9c68b926-ffe2-4315-b91c-0b19ac173312 tempest-TaggedAttachmentsTest-66506181 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5a956a5d-0026-4f64-8af5-dfed4f6efa32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:21:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9c68b926-ffe2-4315-b91c-0b19ac173312 tempest-TaggedAttachmentsTest-66506181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d75f7d24-6959-47f2-a3fe-5f0c48271384) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:21:29 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-9c68b926-ffe2-4315-b91c-0b19ac173312 tempest-TaggedAttachmentsTest-66506181 None] Volume 0beaf06f-3f52-45dd-bcb0-32df856a87dc: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0beaf06f-3f52-45dd-bcb0-32df856a87dc', 'volume_size': 1} Nov 01 12:21:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-9c68b926-ffe2-4315-b91c-0b19ac173312 tempest-TaggedAttachmentsTest-66506181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:21:30 devstack sudo[88701]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [req-c45880e9-ac66-4b09-b9a3-2adc935ed5e4 req-2265989d-4ef9-4d09-9f1b-c717e59f2399 tempest-VolumesSnapshotsTestJSON-707211424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71.info" returned: 0 in 0.277s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-c45880e9-ac66-4b09-b9a3-2adc935ed5e4 req-2265989d-4ef9-4d09-9f1b-c717e59f2399 tempest-VolumesSnapshotsTestJSON-707211424 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.657s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:21:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-9c68b926-ffe2-4315-b91c-0b19ac173312 tempest-TaggedAttachmentsTest-66506181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.247s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:21:30 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-9c68b926-ffe2-4315-b91c-0b19ac173312 tempest-TaggedAttachmentsTest-66506181 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:21:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1321693927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0beaf06f-3f52-45dd-bcb0-32df856a87dc,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c633266d474542499a65d302c1a9e6a7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:21:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:21:30Z,use_quota=True,user_id='9b5ec3652bd142928581f227b68aa81c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:21:30 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-9c68b926-ffe2-4315-b91c-0b19ac173312 tempest-TaggedAttachmentsTest-66506181 None] Creating volume 0beaf06f-3f52-45dd-bcb0-32df856a87dc {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:21:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-9c68b926-ffe2-4315-b91c-0b19ac173312 tempest-TaggedAttachmentsTest-66506181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:21:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-9c68b926-ffe2-4315-b91c-0b19ac173312 tempest-TaggedAttachmentsTest-66506181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:21:30 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-9c68b926-ffe2-4315-b91c-0b19ac173312 tempest-TaggedAttachmentsTest-66506181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:21:30 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-9c68b926-ffe2-4315-b91c-0b19ac173312 tempest-TaggedAttachmentsTest-66506181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:21:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-9c68b926-ffe2-4315-b91c-0b19ac173312 tempest-TaggedAttachmentsTest-66506181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:21:30 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-9c68b926-ffe2-4315-b91c-0b19ac173312 tempest-TaggedAttachmentsTest-66506181 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:21:30 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-9c68b926-ffe2-4315-b91c-0b19ac173312 tempest-TaggedAttachmentsTest-66506181 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:21:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9c68b926-ffe2-4315-b91c-0b19ac173312 tempest-TaggedAttachmentsTest-66506181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0beaf06f-3f52-45dd-bcb0-32df856a87dc 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:30 devstack sudo[88704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0beaf06f-3f52-45dd-bcb0-32df856a87dc 1073741824 Nov 01 12:21:30 devstack sudo[88704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:30 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-c45880e9-ac66-4b09-b9a3-2adc935ed5e4 req-2265989d-4ef9-4d09-9f1b-c717e59f2399 tempest-VolumesSnapshotsTestJSON-707211424 None] Create snapshot completed successfully Nov 01 12:21:30 devstack sudo[88704]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9c68b926-ffe2-4315-b91c-0b19ac173312 tempest-TaggedAttachmentsTest-66506181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0beaf06f-3f52-45dd-bcb0-32df856a87dc 1073741824" returned: 0 in 0.550s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9c68b926-ffe2-4315-b91c-0b19ac173312 tempest-TaggedAttachmentsTest-66506181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0beaf06f-3f52-45dd-bcb0-32df856a87dc {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:30 devstack sudo[88711]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0beaf06f-3f52-45dd-bcb0-32df856a87dc Nov 01 12:21:30 devstack sudo[88711]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:30 devstack sudo[88711]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9c68b926-ffe2-4315-b91c-0b19ac173312 tempest-TaggedAttachmentsTest-66506181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0beaf06f-3f52-45dd-bcb0-32df856a87dc" returned: 0 in 0.275s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:30 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-9c68b926-ffe2-4315-b91c-0b19ac173312 tempest-TaggedAttachmentsTest-66506181 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:21:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-9c68b926-ffe2-4315-b91c-0b19ac173312 tempest-TaggedAttachmentsTest-66506181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:21:30 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9c68b926-ffe2-4315-b91c-0b19ac173312 tempest-TaggedAttachmentsTest-66506181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d75f7d24-6959-47f2-a3fe-5f0c48271384) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0beaf06f-3f52-45dd-bcb0-32df856a87dc', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:21:30 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9c68b926-ffe2-4315-b91c-0b19ac173312 tempest-TaggedAttachmentsTest-66506181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb578819-3c7e-4b1c-ab41-44d6509d7839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:21:30 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-9c68b926-ffe2-4315-b91c-0b19ac173312 tempest-TaggedAttachmentsTest-66506181 None] Volume volume-0beaf06f-3f52-45dd-bcb0-32df856a87dc (0beaf06f-3f52-45dd-bcb0-32df856a87dc): created successfully Nov 01 12:21:30 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9c68b926-ffe2-4315-b91c-0b19ac173312 tempest-TaggedAttachmentsTest-66506181 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eb578819-3c7e-4b1c-ab41-44d6509d7839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:21:31 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9c68b926-ffe2-4315-b91c-0b19ac173312 tempest-TaggedAttachmentsTest-66506181 None] Flow 'volume_create_manager' (bdeaa59d-c84d-46aa-8420-7885a6799a1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:21:31 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-9c68b926-ffe2-4315-b91c-0b19ac173312 tempest-TaggedAttachmentsTest-66506181 None] Created volume successfully. Nov 01 12:21:31 devstack cinder-volume[86574]: DEBUG cinder.coordination [req-1b08835a-92ab-4ad2-8946-bca4fb5f6de2 req-1c9c187a-e3c2-4cdd-916e-e2513ecf92dc tempest-VolumesSnapshotsTestJSON-707211424 None] Acquiring lock "cinder-dcaf9d7a-829b-4705-aa8a-df9c32580ba5-delete_snapshot" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:21:31 devstack cinder-volume[86574]: DEBUG cinder.coordination [req-1b08835a-92ab-4ad2-8946-bca4fb5f6de2 req-1c9c187a-e3c2-4cdd-916e-e2513ecf92dc tempest-VolumesSnapshotsTestJSON-707211424 None] Lock "cinder-dcaf9d7a-829b-4705-aa8a-df9c32580ba5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:21:31 devstack cinder-volume[86574]: DEBUG cinder.coordination [req-1b08835a-92ab-4ad2-8946-bca4fb5f6de2 req-1c9c187a-e3c2-4cdd-916e-e2513ecf92dc tempest-VolumesSnapshotsTestJSON-707211424 None] Acquiring lock "cinder-quobyte-08b0d3ef-b593-4398-b139-4a3c74e2eb71" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:21:31 devstack cinder-volume[86574]: DEBUG cinder.coordination [req-1b08835a-92ab-4ad2-8946-bca4fb5f6de2 req-1c9c187a-e3c2-4cdd-916e-e2513ecf92dc tempest-VolumesSnapshotsTestJSON-707211424 None] Lock "cinder-quobyte-08b0d3ef-b593-4398-b139-4a3c74e2eb71" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:21:31 devstack cinder-volume[86574]: DEBUG cinder.coordination [req-1b08835a-92ab-4ad2-8946-bca4fb5f6de2 req-1c9c187a-e3c2-4cdd-916e-e2513ecf92dc tempest-VolumesSnapshotsTestJSON-707211424 None] Acquiring lock "cinder-quobyte-dcaf9d7a-829b-4705-aa8a-df9c32580ba5" by "_delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:21:31 devstack cinder-volume[86574]: DEBUG cinder.coordination [req-1b08835a-92ab-4ad2-8946-bca4fb5f6de2 req-1c9c187a-e3c2-4cdd-916e-e2513ecf92dc tempest-VolumesSnapshotsTestJSON-707211424 None] Lock "cinder-quobyte-dcaf9d7a-829b-4705-aa8a-df9c32580ba5" acquired by "_delete_snapshot" :: waited 0.023s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:21:31 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [req-1b08835a-92ab-4ad2-8946-bca4fb5f6de2 req-1c9c187a-e3c2-4cdd-916e-e2513ecf92dc tempest-VolumesSnapshotsTestJSON-707211424 None] Deleting offline snapshot dcaf9d7a-829b-4705-aa8a-df9c32580ba5 of volume 08b0d3ef-b593-4398-b139-4a3c74e2eb71 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:21:31 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [req-1b08835a-92ab-4ad2-8946-bca4fb5f6de2 req-1c9c187a-e3c2-4cdd-916e-e2513ecf92dc tempest-VolumesSnapshotsTestJSON-707211424 None] snapshot_file for this snap is: volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71.dcaf9d7a-829b-4705-aa8a-df9c32580ba5 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:21:31 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[66edaee7-9a27-4e3f-b381-0ab149db6ecf]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:21:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [req-1b08835a-92ab-4ad2-8946-bca4fb5f6de2 req-1c9c187a-e3c2-4cdd-916e-e2513ecf92dc tempest-VolumesSnapshotsTestJSON-707211424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71.dcaf9d7a-829b-4705-aa8a-df9c32580ba5 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:31 devstack sudo[88714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71.dcaf9d7a-829b-4705-aa8a-df9c32580ba5 Nov 01 12:21:31 devstack sudo[88714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:31 devstack sudo[88714]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [req-1b08835a-92ab-4ad2-8946-bca4fb5f6de2 req-1c9c187a-e3c2-4cdd-916e-e2513ecf92dc tempest-VolumesSnapshotsTestJSON-707211424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71.dcaf9d7a-829b-4705-aa8a-df9c32580ba5" returned: 0 in 0.467s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:31 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [req-1b08835a-92ab-4ad2-8946-bca4fb5f6de2 req-1c9c187a-e3c2-4cdd-916e-e2513ecf92dc tempest-VolumesSnapshotsTestJSON-707211424 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:21:31 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8436d27-5769-4f6c-952f-10dc758f0396]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:21:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [req-1b08835a-92ab-4ad2-8946-bca4fb5f6de2 req-1c9c187a-e3c2-4cdd-916e-e2513ecf92dc tempest-VolumesSnapshotsTestJSON-707211424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:32 devstack sudo[88721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71 Nov 01 12:21:32 devstack sudo[88721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:32 devstack sudo[88721]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [req-1b08835a-92ab-4ad2-8946-bca4fb5f6de2 req-1c9c187a-e3c2-4cdd-916e-e2513ecf92dc tempest-VolumesSnapshotsTestJSON-707211424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71" returned: 0 in 0.409s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [req-1b08835a-92ab-4ad2-8946-bca4fb5f6de2 req-1c9c187a-e3c2-4cdd-916e-e2513ecf92dc tempest-VolumesSnapshotsTestJSON-707211424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71.dcaf9d7a-829b-4705-aa8a-df9c32580ba5 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:32 devstack sudo[88726]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71.dcaf9d7a-829b-4705-aa8a-df9c32580ba5 Nov 01 12:21:32 devstack sudo[88726]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:32 devstack sudo[88726]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [req-1b08835a-92ab-4ad2-8946-bca4fb5f6de2 req-1c9c187a-e3c2-4cdd-916e-e2513ecf92dc tempest-VolumesSnapshotsTestJSON-707211424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71.dcaf9d7a-829b-4705-aa8a-df9c32580ba5" returned: 0 in 0.466s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [req-1b08835a-92ab-4ad2-8946-bca4fb5f6de2 req-1c9c187a-e3c2-4cdd-916e-e2513ecf92dc tempest-VolumesSnapshotsTestJSON-707211424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71.dcaf9d7a-829b-4705-aa8a-df9c32580ba5 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:32 devstack sudo[88732]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71.dcaf9d7a-829b-4705-aa8a-df9c32580ba5 Nov 01 12:21:32 devstack sudo[88732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:33 devstack sudo[88732]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [req-1b08835a-92ab-4ad2-8946-bca4fb5f6de2 req-1c9c187a-e3c2-4cdd-916e-e2513ecf92dc tempest-VolumesSnapshotsTestJSON-707211424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71.dcaf9d7a-829b-4705-aa8a-df9c32580ba5" returned: 0 in 0.304s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:33 devstack cinder-volume[86574]: DEBUG cinder.coordination [req-1b08835a-92ab-4ad2-8946-bca4fb5f6de2 req-1c9c187a-e3c2-4cdd-916e-e2513ecf92dc tempest-VolumesSnapshotsTestJSON-707211424 None] Lock "cinder-quobyte-dcaf9d7a-829b-4705-aa8a-df9c32580ba5" released by "_delete_snapshot" :: held 1.851s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:21:33 devstack cinder-volume[86574]: DEBUG cinder.coordination [req-1b08835a-92ab-4ad2-8946-bca4fb5f6de2 req-1c9c187a-e3c2-4cdd-916e-e2513ecf92dc tempest-VolumesSnapshotsTestJSON-707211424 None] Lock "cinder-quobyte-08b0d3ef-b593-4398-b139-4a3c74e2eb71" released by "delete_snapshot" :: held 1.883s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:21:33 devstack cinder-volume[86574]: WARNING cinder.quota [req-1b08835a-92ab-4ad2-8946-bca4fb5f6de2 req-1c9c187a-e3c2-4cdd-916e-e2513ecf92dc tempest-VolumesSnapshotsTestJSON-707211424 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:21:33 devstack cinder-volume[86574]: DEBUG cinder.quota [req-1b08835a-92ab-4ad2-8946-bca4fb5f6de2 req-1c9c187a-e3c2-4cdd-916e-e2513ecf92dc tempest-VolumesSnapshotsTestJSON-707211424 None] Created reservations ['e935b2a1-2b0c-40c7-8e1d-e21dcf365380', 'c085788b-2101-46a2-81af-e522c422f417', 'de15a542-b54c-47f8-86f0-c33c174509c9', 'a61967bf-5f69-4c67-a4fa-85a3848d4da8'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:21:33 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-1b08835a-92ab-4ad2-8946-bca4fb5f6de2 req-1c9c187a-e3c2-4cdd-916e-e2513ecf92dc tempest-VolumesSnapshotsTestJSON-707211424 None] Delete snapshot completed successfully. Nov 01 12:21:33 devstack cinder-volume[86574]: DEBUG cinder.coordination [req-1b08835a-92ab-4ad2-8946-bca4fb5f6de2 req-1c9c187a-e3c2-4cdd-916e-e2513ecf92dc tempest-VolumesSnapshotsTestJSON-707211424 None] Lock "cinder-dcaf9d7a-829b-4705-aa8a-df9c32580ba5-delete_snapshot" released by "delete_snapshot" :: held 2.053s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:21:33 devstack cinder-volume[86574]: DEBUG cinder.coordination [req-f792207d-3251-4541-b287-aa7ff4d955d2 req-d35d701a-e18c-493f-8dab-83684bfae854 tempest-VolumesSnapshotsTestJSON-707211424 None] Acquiring lock "cinder-08b0d3ef-b593-4398-b139-4a3c74e2eb71-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:21:33 devstack cinder-volume[86574]: DEBUG cinder.coordination [req-f792207d-3251-4541-b287-aa7ff4d955d2 req-d35d701a-e18c-493f-8dab-83684bfae854 tempest-VolumesSnapshotsTestJSON-707211424 None] Lock "cinder-08b0d3ef-b593-4398-b139-4a3c74e2eb71-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:21:33 devstack cinder-volume[86574]: DEBUG cinder.coordination [req-f792207d-3251-4541-b287-aa7ff4d955d2 req-d35d701a-e18c-493f-8dab-83684bfae854 tempest-VolumesSnapshotsTestJSON-707211424 None] Acquiring lock "cinder-quobyte-08b0d3ef-b593-4398-b139-4a3c74e2eb71" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:21:33 devstack cinder-volume[86574]: DEBUG cinder.coordination [req-f792207d-3251-4541-b287-aa7ff4d955d2 req-d35d701a-e18c-493f-8dab-83684bfae854 tempest-VolumesSnapshotsTestJSON-707211424 None] Lock "cinder-quobyte-08b0d3ef-b593-4398-b139-4a3c74e2eb71" acquired by "delete_volume" :: waited 0.019s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:21:33 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[ffceb845-3f0a-4933-a22f-ac43a818747a]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:21:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [req-f792207d-3251-4541-b287-aa7ff4d955d2 req-d35d701a-e18c-493f-8dab-83684bfae854 tempest-VolumesSnapshotsTestJSON-707211424 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:33 devstack sudo[88736]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71 Nov 01 12:21:33 devstack sudo[88736]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:34 devstack sudo[88736]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [req-f792207d-3251-4541-b287-aa7ff4d955d2 req-d35d701a-e18c-493f-8dab-83684bfae854 tempest-VolumesSnapshotsTestJSON-707211424 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71" returned: 0 in 0.439s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [req-f792207d-3251-4541-b287-aa7ff4d955d2 req-d35d701a-e18c-493f-8dab-83684bfae854 tempest-VolumesSnapshotsTestJSON-707211424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:34 devstack sudo[88741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71 Nov 01 12:21:34 devstack sudo[88741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:34 devstack sudo[88741]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [req-f792207d-3251-4541-b287-aa7ff4d955d2 req-d35d701a-e18c-493f-8dab-83684bfae854 tempest-VolumesSnapshotsTestJSON-707211424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-08b0d3ef-b593-4398-b139-4a3c74e2eb71" returned: 0 in 0.305s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:34 devstack cinder-volume[86574]: DEBUG cinder.coordination [req-f792207d-3251-4541-b287-aa7ff4d955d2 req-d35d701a-e18c-493f-8dab-83684bfae854 tempest-VolumesSnapshotsTestJSON-707211424 None] Lock "cinder-quobyte-08b0d3ef-b593-4398-b139-4a3c74e2eb71" released by "delete_volume" :: held 0.855s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:21:34 devstack cinder-volume[86574]: DEBUG cinder.quota [req-f792207d-3251-4541-b287-aa7ff4d955d2 req-d35d701a-e18c-493f-8dab-83684bfae854 tempest-VolumesSnapshotsTestJSON-707211424 None] Created reservations ['08a1f662-7b4d-490e-a662-dfffbe95a28f', 'deefeda2-72d0-4ef4-aa18-fbb04e3eb050', 'b1912a7e-47b4-4e47-8912-b56b2b84e390', 'f27cc732-3bfa-4146-8c58-d45a78f2a5b6'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:21:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-f792207d-3251-4541-b287-aa7ff4d955d2 req-d35d701a-e18c-493f-8dab-83684bfae854 tempest-VolumesSnapshotsTestJSON-707211424 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:21:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-f792207d-3251-4541-b287-aa7ff4d955d2 req-d35d701a-e18c-493f-8dab-83684bfae854 tempest-VolumesSnapshotsTestJSON-707211424 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:21:34 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [req-f792207d-3251-4541-b287-aa7ff4d955d2 req-d35d701a-e18c-493f-8dab-83684bfae854 tempest-VolumesSnapshotsTestJSON-707211424 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:21:34 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [req-f792207d-3251-4541-b287-aa7ff4d955d2 req-d35d701a-e18c-493f-8dab-83684bfae854 tempest-VolumesSnapshotsTestJSON-707211424 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:21:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-f792207d-3251-4541-b287-aa7ff4d955d2 req-d35d701a-e18c-493f-8dab-83684bfae854 tempest-VolumesSnapshotsTestJSON-707211424 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:21:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [req-f792207d-3251-4541-b287-aa7ff4d955d2 req-d35d701a-e18c-493f-8dab-83684bfae854 tempest-VolumesSnapshotsTestJSON-707211424 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:34 devstack sudo[88744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:21:34 devstack sudo[88744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:35 devstack sudo[88744]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [req-f792207d-3251-4541-b287-aa7ff4d955d2 req-d35d701a-e18c-493f-8dab-83684bfae854 tempest-VolumesSnapshotsTestJSON-707211424 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.283s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:35 devstack cinder-volume[86574]: DEBUG cinder.manager [req-f792207d-3251-4541-b287-aa7ff4d955d2 req-d35d701a-e18c-493f-8dab-83684bfae854 tempest-VolumesSnapshotsTestJSON-707211424 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:21:35 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-f792207d-3251-4541-b287-aa7ff4d955d2 req-d35d701a-e18c-493f-8dab-83684bfae854 tempest-VolumesSnapshotsTestJSON-707211424 None] Deleted volume successfully. Nov 01 12:21:35 devstack cinder-volume[86574]: DEBUG cinder.coordination [req-f792207d-3251-4541-b287-aa7ff4d955d2 req-d35d701a-e18c-493f-8dab-83684bfae854 tempest-VolumesSnapshotsTestJSON-707211424 None] Lock "cinder-08b0d3ef-b593-4398-b139-4a3c74e2eb71-delete_volume" released by "delete_volume" :: held 1.431s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:21:39 devstack cinder-volume[86574]: DEBUG oslo_service.periodic_task [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86574) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:21:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:21:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:21:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:21:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:21:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:21:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:39 devstack sudo[88755]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:21:39 devstack sudo[88755]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.476s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:40 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:21:40 devstack sudo[88755]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:40 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae403d52-46ff-4cca-886f-8622b2f22188 tempest-VolumesTestJSON-726649374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:21:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ae403d52-46ff-4cca-886f-8622b2f22188 tempest-VolumesTestJSON-726649374 None] Flow 'volume_create_manager' (99fc9c0e-0da8-4a22-bb55-46c7957ecac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:21:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ae403d52-46ff-4cca-886f-8622b2f22188 tempest-VolumesTestJSON-726649374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (678baa0a-b326-4664-b88e-da1684e313fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:21:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ae403d52-46ff-4cca-886f-8622b2f22188 tempest-VolumesTestJSON-726649374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (678baa0a-b326-4664-b88e-da1684e313fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-602343220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c257363-c601-4ec1-ad4b-248998aab303,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6abce3d9a617473bad8e5b692c2e4cd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:21:41Z,use_quota=True,user_id='9510435ebc184b1ea9cc6dc4d078da38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:21:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ae403d52-46ff-4cca-886f-8622b2f22188 tempest-VolumesTestJSON-726649374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ef11fce-9eb3-4876-90d8-da1d1078f90f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:21:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ae403d52-46ff-4cca-886f-8622b2f22188 tempest-VolumesTestJSON-726649374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8ef11fce-9eb3-4876-90d8-da1d1078f90f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:21:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ae403d52-46ff-4cca-886f-8622b2f22188 tempest-VolumesTestJSON-726649374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f80d060-90dc-43d7-8a38-579e9a592ab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:21:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ae403d52-46ff-4cca-886f-8622b2f22188 tempest-VolumesTestJSON-726649374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f80d060-90dc-43d7-8a38-579e9a592ab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c257363-c601-4ec1-ad4b-248998aab303', 'volume_name': 'volume-5c257363-c601-4ec1-ad4b-248998aab303', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:21:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ae403d52-46ff-4cca-886f-8622b2f22188 tempest-VolumesTestJSON-726649374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e7b2a0f-835b-4f95-8bc9-2a051972c743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:21:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ae403d52-46ff-4cca-886f-8622b2f22188 tempest-VolumesTestJSON-726649374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1e7b2a0f-835b-4f95-8bc9-2a051972c743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:21:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ae403d52-46ff-4cca-886f-8622b2f22188 tempest-VolumesTestJSON-726649374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37ed7ea5-2b32-4eb4-9808-c76ff93c55dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:21:40 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-ae403d52-46ff-4cca-886f-8622b2f22188 tempest-VolumesTestJSON-726649374 None] Volume 5c257363-c601-4ec1-ad4b-248998aab303: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c257363-c601-4ec1-ad4b-248998aab303', 'volume_size': 1} Nov 01 12:21:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ae403d52-46ff-4cca-886f-8622b2f22188 tempest-VolumesTestJSON-726649374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:21:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ae403d52-46ff-4cca-886f-8622b2f22188 tempest-VolumesTestJSON-726649374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:21:40 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ae403d52-46ff-4cca-886f-8622b2f22188 tempest-VolumesTestJSON-726649374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:21:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-602343220',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c257363-c601-4ec1-ad4b-248998aab303,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6abce3d9a617473bad8e5b692c2e4cd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:21:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:21:41Z,use_quota=True,user_id='9510435ebc184b1ea9cc6dc4d078da38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:21:40 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-ae403d52-46ff-4cca-886f-8622b2f22188 tempest-VolumesTestJSON-726649374 None] Creating volume 5c257363-c601-4ec1-ad4b-248998aab303 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:21:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ae403d52-46ff-4cca-886f-8622b2f22188 tempest-VolumesTestJSON-726649374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:21:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ae403d52-46ff-4cca-886f-8622b2f22188 tempest-VolumesTestJSON-726649374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:21:40 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ae403d52-46ff-4cca-886f-8622b2f22188 tempest-VolumesTestJSON-726649374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:21:40 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ae403d52-46ff-4cca-886f-8622b2f22188 tempest-VolumesTestJSON-726649374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:21:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ae403d52-46ff-4cca-886f-8622b2f22188 tempest-VolumesTestJSON-726649374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:21:40 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ae403d52-46ff-4cca-886f-8622b2f22188 tempest-VolumesTestJSON-726649374 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:21:40 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-ae403d52-46ff-4cca-886f-8622b2f22188 tempest-VolumesTestJSON-726649374 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:21:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ae403d52-46ff-4cca-886f-8622b2f22188 tempest-VolumesTestJSON-726649374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5c257363-c601-4ec1-ad4b-248998aab303 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:40 devstack sudo[88763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5c257363-c601-4ec1-ad4b-248998aab303 1073741824 Nov 01 12:21:40 devstack sudo[88763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:41 devstack sudo[88763]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ae403d52-46ff-4cca-886f-8622b2f22188 tempest-VolumesTestJSON-726649374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5c257363-c601-4ec1-ad4b-248998aab303 1073741824" returned: 0 in 0.763s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ae403d52-46ff-4cca-886f-8622b2f22188 tempest-VolumesTestJSON-726649374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5c257363-c601-4ec1-ad4b-248998aab303 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:41 devstack sudo[88773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5c257363-c601-4ec1-ad4b-248998aab303 Nov 01 12:21:41 devstack sudo[88773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:42 devstack sudo[88773]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ae403d52-46ff-4cca-886f-8622b2f22188 tempest-VolumesTestJSON-726649374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5c257363-c601-4ec1-ad4b-248998aab303" returned: 0 in 0.460s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:42 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ae403d52-46ff-4cca-886f-8622b2f22188 tempest-VolumesTestJSON-726649374 None] <== create_volume: return (1294ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:21:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ae403d52-46ff-4cca-886f-8622b2f22188 tempest-VolumesTestJSON-726649374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.299s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:21:42 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ae403d52-46ff-4cca-886f-8622b2f22188 tempest-VolumesTestJSON-726649374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37ed7ea5-2b32-4eb4-9808-c76ff93c55dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c257363-c601-4ec1-ad4b-248998aab303', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:21:42 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ae403d52-46ff-4cca-886f-8622b2f22188 tempest-VolumesTestJSON-726649374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9425c010-d56d-4d54-981a-854e2bcb4d76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:21:42 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-ae403d52-46ff-4cca-886f-8622b2f22188 tempest-VolumesTestJSON-726649374 None] Volume volume-5c257363-c601-4ec1-ad4b-248998aab303 (5c257363-c601-4ec1-ad4b-248998aab303): created successfully Nov 01 12:21:42 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ae403d52-46ff-4cca-886f-8622b2f22188 tempest-VolumesTestJSON-726649374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9425c010-d56d-4d54-981a-854e2bcb4d76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:21:42 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ae403d52-46ff-4cca-886f-8622b2f22188 tempest-VolumesTestJSON-726649374 None] Flow 'volume_create_manager' (99fc9c0e-0da8-4a22-bb55-46c7957ecac3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:21:42 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-ae403d52-46ff-4cca-886f-8622b2f22188 tempest-VolumesTestJSON-726649374 None] Created volume successfully. Nov 01 12:21:43 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd4f3cc1-dda8-462e-9165-3c798a3b2b44 tempest-VolumesTestJSON-726649374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:21:43 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-fd4f3cc1-dda8-462e-9165-3c798a3b2b44 tempest-VolumesTestJSON-726649374 None] Flow 'volume_create_manager' (e32e1f22-50d3-4950-aeed-ed6d87d3b9b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:21:43 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-fd4f3cc1-dda8-462e-9165-3c798a3b2b44 tempest-VolumesTestJSON-726649374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b2297d0-becc-4a6f-bb2d-e3463c92c4df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:21:43 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-fd4f3cc1-dda8-462e-9165-3c798a3b2b44 tempest-VolumesTestJSON-726649374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b2297d0-becc-4a6f-bb2d-e3463c92c4df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-474958506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=762c3f64-ca7b-46e4-85af-c56980125ed0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6abce3d9a617473bad8e5b692c2e4cd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:21:44Z,use_quota=True,user_id='9510435ebc184b1ea9cc6dc4d078da38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:21:43 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-fd4f3cc1-dda8-462e-9165-3c798a3b2b44 tempest-VolumesTestJSON-726649374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f172071-7fa8-4df2-b833-af87f2f768e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:21:43 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-fd4f3cc1-dda8-462e-9165-3c798a3b2b44 tempest-VolumesTestJSON-726649374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f172071-7fa8-4df2-b833-af87f2f768e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:21:43 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-fd4f3cc1-dda8-462e-9165-3c798a3b2b44 tempest-VolumesTestJSON-726649374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fd5b459-f6d0-475c-9a71-328df4bc770f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:21:43 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-fd4f3cc1-dda8-462e-9165-3c798a3b2b44 tempest-VolumesTestJSON-726649374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fd5b459-f6d0-475c-9a71-328df4bc770f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '762c3f64-ca7b-46e4-85af-c56980125ed0', 'volume_name': 'volume-762c3f64-ca7b-46e4-85af-c56980125ed0', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:21:43 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-fd4f3cc1-dda8-462e-9165-3c798a3b2b44 tempest-VolumesTestJSON-726649374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1378fdaa-1f8d-4f29-b51e-845953a3096e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:21:43 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-fd4f3cc1-dda8-462e-9165-3c798a3b2b44 tempest-VolumesTestJSON-726649374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1378fdaa-1f8d-4f29-b51e-845953a3096e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:21:43 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-fd4f3cc1-dda8-462e-9165-3c798a3b2b44 tempest-VolumesTestJSON-726649374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56818415-4c62-4f39-9745-11c3686a3be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:21:43 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-fd4f3cc1-dda8-462e-9165-3c798a3b2b44 tempest-VolumesTestJSON-726649374 None] Volume 762c3f64-ca7b-46e4-85af-c56980125ed0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-762c3f64-ca7b-46e4-85af-c56980125ed0', 'volume_size': 1} Nov 01 12:21:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-fd4f3cc1-dda8-462e-9165-3c798a3b2b44 tempest-VolumesTestJSON-726649374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:21:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-fd4f3cc1-dda8-462e-9165-3c798a3b2b44 tempest-VolumesTestJSON-726649374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:21:43 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-fd4f3cc1-dda8-462e-9165-3c798a3b2b44 tempest-VolumesTestJSON-726649374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:21:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-474958506',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=762c3f64-ca7b-46e4-85af-c56980125ed0,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6abce3d9a617473bad8e5b692c2e4cd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:21:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:21:44Z,use_quota=True,user_id='9510435ebc184b1ea9cc6dc4d078da38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:21:43 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-fd4f3cc1-dda8-462e-9165-3c798a3b2b44 tempest-VolumesTestJSON-726649374 None] Creating volume 762c3f64-ca7b-46e4-85af-c56980125ed0 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:21:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-fd4f3cc1-dda8-462e-9165-3c798a3b2b44 tempest-VolumesTestJSON-726649374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:21:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-fd4f3cc1-dda8-462e-9165-3c798a3b2b44 tempest-VolumesTestJSON-726649374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:21:43 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-fd4f3cc1-dda8-462e-9165-3c798a3b2b44 tempest-VolumesTestJSON-726649374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:21:43 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-fd4f3cc1-dda8-462e-9165-3c798a3b2b44 tempest-VolumesTestJSON-726649374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:21:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-fd4f3cc1-dda8-462e-9165-3c798a3b2b44 tempest-VolumesTestJSON-726649374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:21:43 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-fd4f3cc1-dda8-462e-9165-3c798a3b2b44 tempest-VolumesTestJSON-726649374 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:21:43 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-fd4f3cc1-dda8-462e-9165-3c798a3b2b44 tempest-VolumesTestJSON-726649374 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:21:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-fd4f3cc1-dda8-462e-9165-3c798a3b2b44 tempest-VolumesTestJSON-726649374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-762c3f64-ca7b-46e4-85af-c56980125ed0 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:43 devstack sudo[88815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-762c3f64-ca7b-46e4-85af-c56980125ed0 1073741824 Nov 01 12:21:43 devstack sudo[88815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:44 devstack sudo[88815]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-fd4f3cc1-dda8-462e-9165-3c798a3b2b44 tempest-VolumesTestJSON-726649374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-762c3f64-ca7b-46e4-85af-c56980125ed0 1073741824" returned: 0 in 0.485s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-fd4f3cc1-dda8-462e-9165-3c798a3b2b44 tempest-VolumesTestJSON-726649374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-762c3f64-ca7b-46e4-85af-c56980125ed0 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:44 devstack sudo[88821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-762c3f64-ca7b-46e4-85af-c56980125ed0 Nov 01 12:21:44 devstack sudo[88821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:44 devstack sudo[88821]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-fd4f3cc1-dda8-462e-9165-3c798a3b2b44 tempest-VolumesTestJSON-726649374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-762c3f64-ca7b-46e4-85af-c56980125ed0" returned: 0 in 0.252s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:44 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-fd4f3cc1-dda8-462e-9165-3c798a3b2b44 tempest-VolumesTestJSON-726649374 None] <== create_volume: return (787ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:21:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-fd4f3cc1-dda8-462e-9165-3c798a3b2b44 tempest-VolumesTestJSON-726649374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.789s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:21:44 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-fd4f3cc1-dda8-462e-9165-3c798a3b2b44 tempest-VolumesTestJSON-726649374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56818415-4c62-4f39-9745-11c3686a3be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-762c3f64-ca7b-46e4-85af-c56980125ed0', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:21:44 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-fd4f3cc1-dda8-462e-9165-3c798a3b2b44 tempest-VolumesTestJSON-726649374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2795103a-f658-42e4-841f-69392f407a18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:21:44 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-fd4f3cc1-dda8-462e-9165-3c798a3b2b44 tempest-VolumesTestJSON-726649374 None] Volume volume-762c3f64-ca7b-46e4-85af-c56980125ed0 (762c3f64-ca7b-46e4-85af-c56980125ed0): created successfully Nov 01 12:21:44 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-fd4f3cc1-dda8-462e-9165-3c798a3b2b44 tempest-VolumesTestJSON-726649374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2795103a-f658-42e4-841f-69392f407a18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:21:44 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-fd4f3cc1-dda8-462e-9165-3c798a3b2b44 tempest-VolumesTestJSON-726649374 None] Flow 'volume_create_manager' (e32e1f22-50d3-4950-aeed-ed6d87d3b9b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:21:44 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-fd4f3cc1-dda8-462e-9165-3c798a3b2b44 tempest-VolumesTestJSON-726649374 None] Created volume successfully. Nov 01 12:21:46 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-32212090-a225-4211-8ffd-29a844685625 tempest-VolumesTestJSON-726649374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:21:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32212090-a225-4211-8ffd-29a844685625 tempest-VolumesTestJSON-726649374 None] Flow 'volume_create_manager' (c7cc5d22-fd8b-4349-ae4e-b05e1e5c0126) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:21:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32212090-a225-4211-8ffd-29a844685625 tempest-VolumesTestJSON-726649374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb9f7bf7-7737-4680-9cd6-820812e3e234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:21:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32212090-a225-4211-8ffd-29a844685625 tempest-VolumesTestJSON-726649374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bb9f7bf7-7737-4680-9cd6-820812e3e234) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:21:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1653209959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=413986e2-217f-4df6-9fff-ce74f4d35037,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6abce3d9a617473bad8e5b692c2e4cd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:21:47Z,use_quota=True,user_id='9510435ebc184b1ea9cc6dc4d078da38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:21:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32212090-a225-4211-8ffd-29a844685625 tempest-VolumesTestJSON-726649374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8ad36d7-a891-4b3c-a0ca-b83bf0c1739c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:21:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32212090-a225-4211-8ffd-29a844685625 tempest-VolumesTestJSON-726649374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d8ad36d7-a891-4b3c-a0ca-b83bf0c1739c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:21:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32212090-a225-4211-8ffd-29a844685625 tempest-VolumesTestJSON-726649374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c79da2a-493d-4bf8-a3e3-9aa34889bfd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:21:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32212090-a225-4211-8ffd-29a844685625 tempest-VolumesTestJSON-726649374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c79da2a-493d-4bf8-a3e3-9aa34889bfd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '413986e2-217f-4df6-9fff-ce74f4d35037', 'volume_name': 'volume-413986e2-217f-4df6-9fff-ce74f4d35037', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:21:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32212090-a225-4211-8ffd-29a844685625 tempest-VolumesTestJSON-726649374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68f47ca6-da55-4917-9bd7-2b8fe1e40df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:21:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32212090-a225-4211-8ffd-29a844685625 tempest-VolumesTestJSON-726649374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68f47ca6-da55-4917-9bd7-2b8fe1e40df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:21:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32212090-a225-4211-8ffd-29a844685625 tempest-VolumesTestJSON-726649374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ab58801-4493-4441-88cf-6abbe3d10193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:21:46 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-32212090-a225-4211-8ffd-29a844685625 tempest-VolumesTestJSON-726649374 None] Volume 413986e2-217f-4df6-9fff-ce74f4d35037: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-413986e2-217f-4df6-9fff-ce74f4d35037', 'volume_size': 1} Nov 01 12:21:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-32212090-a225-4211-8ffd-29a844685625 tempest-VolumesTestJSON-726649374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:21:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-32212090-a225-4211-8ffd-29a844685625 tempest-VolumesTestJSON-726649374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:21:46 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-32212090-a225-4211-8ffd-29a844685625 tempest-VolumesTestJSON-726649374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:21:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1653209959',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=413986e2-217f-4df6-9fff-ce74f4d35037,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6abce3d9a617473bad8e5b692c2e4cd6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:21:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:21:47Z,use_quota=True,user_id='9510435ebc184b1ea9cc6dc4d078da38',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:21:46 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-32212090-a225-4211-8ffd-29a844685625 tempest-VolumesTestJSON-726649374 None] Creating volume 413986e2-217f-4df6-9fff-ce74f4d35037 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:21:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-32212090-a225-4211-8ffd-29a844685625 tempest-VolumesTestJSON-726649374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:21:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-32212090-a225-4211-8ffd-29a844685625 tempest-VolumesTestJSON-726649374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:21:46 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-32212090-a225-4211-8ffd-29a844685625 tempest-VolumesTestJSON-726649374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:21:46 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-32212090-a225-4211-8ffd-29a844685625 tempest-VolumesTestJSON-726649374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:21:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-32212090-a225-4211-8ffd-29a844685625 tempest-VolumesTestJSON-726649374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:21:46 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-32212090-a225-4211-8ffd-29a844685625 tempest-VolumesTestJSON-726649374 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:21:46 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-32212090-a225-4211-8ffd-29a844685625 tempest-VolumesTestJSON-726649374 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:21:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-32212090-a225-4211-8ffd-29a844685625 tempest-VolumesTestJSON-726649374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-413986e2-217f-4df6-9fff-ce74f4d35037 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:47 devstack sudo[88854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-413986e2-217f-4df6-9fff-ce74f4d35037 1073741824 Nov 01 12:21:47 devstack sudo[88854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:47 devstack sudo[88854]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-32212090-a225-4211-8ffd-29a844685625 tempest-VolumesTestJSON-726649374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-413986e2-217f-4df6-9fff-ce74f4d35037 1073741824" returned: 0 in 0.809s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-32212090-a225-4211-8ffd-29a844685625 tempest-VolumesTestJSON-726649374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-413986e2-217f-4df6-9fff-ce74f4d35037 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:47 devstack sudo[88880]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-413986e2-217f-4df6-9fff-ce74f4d35037 Nov 01 12:21:47 devstack sudo[88880]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:48 devstack sudo[88880]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-32212090-a225-4211-8ffd-29a844685625 tempest-VolumesTestJSON-726649374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-413986e2-217f-4df6-9fff-ce74f4d35037" returned: 0 in 0.327s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:48 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-32212090-a225-4211-8ffd-29a844685625 tempest-VolumesTestJSON-726649374 None] <== create_volume: return (1208ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:21:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-32212090-a225-4211-8ffd-29a844685625 tempest-VolumesTestJSON-726649374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.210s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:21:48 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32212090-a225-4211-8ffd-29a844685625 tempest-VolumesTestJSON-726649374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0ab58801-4493-4441-88cf-6abbe3d10193) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-413986e2-217f-4df6-9fff-ce74f4d35037', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:21:48 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32212090-a225-4211-8ffd-29a844685625 tempest-VolumesTestJSON-726649374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a7af5b5-4cad-43d9-8d5c-a6beec43a8b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:21:48 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-32212090-a225-4211-8ffd-29a844685625 tempest-VolumesTestJSON-726649374 None] Volume volume-413986e2-217f-4df6-9fff-ce74f4d35037 (413986e2-217f-4df6-9fff-ce74f4d35037): created successfully Nov 01 12:21:48 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32212090-a225-4211-8ffd-29a844685625 tempest-VolumesTestJSON-726649374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3a7af5b5-4cad-43d9-8d5c-a6beec43a8b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:21:48 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32212090-a225-4211-8ffd-29a844685625 tempest-VolumesTestJSON-726649374 None] Flow 'volume_create_manager' (c7cc5d22-fd8b-4349-ae4e-b05e1e5c0126) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:21:48 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-32212090-a225-4211-8ffd-29a844685625 tempest-VolumesTestJSON-726649374 None] Created volume successfully. Nov 01 12:21:52 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-210bb9b1-d224-400b-bc99-beb2b4feadef tempest-VolumesTestJSON-726649374 None] Acquiring lock "cinder-413986e2-217f-4df6-9fff-ce74f4d35037-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:21:52 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-210bb9b1-d224-400b-bc99-beb2b4feadef tempest-VolumesTestJSON-726649374 None] Lock "cinder-413986e2-217f-4df6-9fff-ce74f4d35037-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:21:52 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-210bb9b1-d224-400b-bc99-beb2b4feadef tempest-VolumesTestJSON-726649374 None] Acquiring lock "cinder-quobyte-413986e2-217f-4df6-9fff-ce74f4d35037" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:21:52 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-210bb9b1-d224-400b-bc99-beb2b4feadef tempest-VolumesTestJSON-726649374 None] Lock "cinder-quobyte-413986e2-217f-4df6-9fff-ce74f4d35037" acquired by "delete_volume" :: waited 0.040s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:21:52 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[da37f96b-f4c2-4f04-82cc-a8fd80135693]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:21:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-210bb9b1-d224-400b-bc99-beb2b4feadef tempest-VolumesTestJSON-726649374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-413986e2-217f-4df6-9fff-ce74f4d35037 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:52 devstack sudo[88977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-413986e2-217f-4df6-9fff-ce74f4d35037 Nov 01 12:21:52 devstack sudo[88977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:53 devstack sudo[88977]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-210bb9b1-d224-400b-bc99-beb2b4feadef tempest-VolumesTestJSON-726649374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-413986e2-217f-4df6-9fff-ce74f4d35037" returned: 0 in 0.766s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-210bb9b1-d224-400b-bc99-beb2b4feadef tempest-VolumesTestJSON-726649374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-413986e2-217f-4df6-9fff-ce74f4d35037 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:53 devstack sudo[88989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-413986e2-217f-4df6-9fff-ce74f4d35037 Nov 01 12:21:53 devstack sudo[88989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:53 devstack sudo[88989]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-210bb9b1-d224-400b-bc99-beb2b4feadef tempest-VolumesTestJSON-726649374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-413986e2-217f-4df6-9fff-ce74f4d35037" returned: 0 in 0.889s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:53 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-210bb9b1-d224-400b-bc99-beb2b4feadef tempest-VolumesTestJSON-726649374 None] Lock "cinder-quobyte-413986e2-217f-4df6-9fff-ce74f4d35037" released by "delete_volume" :: held 1.776s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:21:54 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-210bb9b1-d224-400b-bc99-beb2b4feadef tempest-VolumesTestJSON-726649374 None] Created reservations ['16c17715-11fd-41bb-a948-64d44e32bb7b', '74507c9a-d197-432c-bd30-7980ded1f598', 'f6dbb159-d41c-41fb-9e98-ef0b7ff36bcb', '6ef6fed2-af26-4e18-82b5-2d930c5bd613'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:21:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-210bb9b1-d224-400b-bc99-beb2b4feadef tempest-VolumesTestJSON-726649374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:21:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-210bb9b1-d224-400b-bc99-beb2b4feadef tempest-VolumesTestJSON-726649374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:21:54 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-210bb9b1-d224-400b-bc99-beb2b4feadef tempest-VolumesTestJSON-726649374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:21:54 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-210bb9b1-d224-400b-bc99-beb2b4feadef tempest-VolumesTestJSON-726649374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:21:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-210bb9b1-d224-400b-bc99-beb2b4feadef tempest-VolumesTestJSON-726649374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:21:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-210bb9b1-d224-400b-bc99-beb2b4feadef tempest-VolumesTestJSON-726649374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:54 devstack sudo[89006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:21:54 devstack sudo[89006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:54 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-5dbe654a-d6d5-4ec7-b153-1f7b504474fc tempest-VolumesTestJSON-726649374 None] Acquiring lock "cinder-762c3f64-ca7b-46e4-85af-c56980125ed0-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:21:54 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-5dbe654a-d6d5-4ec7-b153-1f7b504474fc tempest-VolumesTestJSON-726649374 None] Lock "cinder-762c3f64-ca7b-46e4-85af-c56980125ed0-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:21:54 devstack sudo[89006]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-210bb9b1-d224-400b-bc99-beb2b4feadef tempest-VolumesTestJSON-726649374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.457s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:54 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-210bb9b1-d224-400b-bc99-beb2b4feadef tempest-VolumesTestJSON-726649374 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:21:54 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-210bb9b1-d224-400b-bc99-beb2b4feadef tempest-VolumesTestJSON-726649374 None] Deleted volume successfully. Nov 01 12:21:54 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-5dbe654a-d6d5-4ec7-b153-1f7b504474fc tempest-VolumesTestJSON-726649374 None] Acquiring lock "cinder-quobyte-762c3f64-ca7b-46e4-85af-c56980125ed0" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:21:54 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-5dbe654a-d6d5-4ec7-b153-1f7b504474fc tempest-VolumesTestJSON-726649374 None] Lock "cinder-quobyte-762c3f64-ca7b-46e4-85af-c56980125ed0" acquired by "delete_volume" :: waited 0.020s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:21:54 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-210bb9b1-d224-400b-bc99-beb2b4feadef tempest-VolumesTestJSON-726649374 None] Lock "cinder-413986e2-217f-4df6-9fff-ce74f4d35037-delete_volume" released by "delete_volume" :: held 2.682s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:21:54 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[63b72858-8416-405a-9982-8b9606fdbb78]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:21:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5dbe654a-d6d5-4ec7-b153-1f7b504474fc tempest-VolumesTestJSON-726649374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-762c3f64-ca7b-46e4-85af-c56980125ed0 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:55 devstack sudo[89009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-762c3f64-ca7b-46e4-85af-c56980125ed0 Nov 01 12:21:55 devstack sudo[89009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:55 devstack sudo[89009]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5dbe654a-d6d5-4ec7-b153-1f7b504474fc tempest-VolumesTestJSON-726649374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-762c3f64-ca7b-46e4-85af-c56980125ed0" returned: 0 in 0.780s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5dbe654a-d6d5-4ec7-b153-1f7b504474fc tempest-VolumesTestJSON-726649374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-762c3f64-ca7b-46e4-85af-c56980125ed0 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:55 devstack sudo[89015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-762c3f64-ca7b-46e4-85af-c56980125ed0 Nov 01 12:21:55 devstack sudo[89015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:56 devstack sudo[89015]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5dbe654a-d6d5-4ec7-b153-1f7b504474fc tempest-VolumesTestJSON-726649374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-762c3f64-ca7b-46e4-85af-c56980125ed0" returned: 0 in 0.612s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:56 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-5dbe654a-d6d5-4ec7-b153-1f7b504474fc tempest-VolumesTestJSON-726649374 None] Lock "cinder-quobyte-762c3f64-ca7b-46e4-85af-c56980125ed0" released by "delete_volume" :: held 1.487s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:21:56 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-5dbe654a-d6d5-4ec7-b153-1f7b504474fc tempest-VolumesTestJSON-726649374 None] Created reservations ['0c84c587-87d6-422b-b0a0-8e6dfe103f4f', '2aa34a96-593f-480c-b832-1415505a084d', '5a57fe4f-8a36-4ab9-bbc0-a687b14cadb8', '374bf8df-8c52-4431-a9bb-cacef0210095'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:21:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5dbe654a-d6d5-4ec7-b153-1f7b504474fc tempest-VolumesTestJSON-726649374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:21:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5dbe654a-d6d5-4ec7-b153-1f7b504474fc tempest-VolumesTestJSON-726649374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:21:56 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-5dbe654a-d6d5-4ec7-b153-1f7b504474fc tempest-VolumesTestJSON-726649374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:21:56 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-5dbe654a-d6d5-4ec7-b153-1f7b504474fc tempest-VolumesTestJSON-726649374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:21:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5dbe654a-d6d5-4ec7-b153-1f7b504474fc tempest-VolumesTestJSON-726649374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:21:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5dbe654a-d6d5-4ec7-b153-1f7b504474fc tempest-VolumesTestJSON-726649374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:56 devstack sudo[89019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:21:56 devstack sudo[89019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:56 devstack sudo[89019]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5dbe654a-d6d5-4ec7-b153-1f7b504474fc tempest-VolumesTestJSON-726649374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.437s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:56 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-5dbe654a-d6d5-4ec7-b153-1f7b504474fc tempest-VolumesTestJSON-726649374 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:21:56 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-5dbe654a-d6d5-4ec7-b153-1f7b504474fc tempest-VolumesTestJSON-726649374 None] Deleted volume successfully. Nov 01 12:21:57 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-5dbe654a-d6d5-4ec7-b153-1f7b504474fc tempest-VolumesTestJSON-726649374 None] Lock "cinder-762c3f64-ca7b-46e4-85af-c56980125ed0-delete_volume" released by "delete_volume" :: held 2.434s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:21:57 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6af288b7-15a9-4bfa-93d3-8f44354bb25b tempest-VolumesTestJSON-726649374 None] Acquiring lock "cinder-5c257363-c601-4ec1-ad4b-248998aab303-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:21:57 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6af288b7-15a9-4bfa-93d3-8f44354bb25b tempest-VolumesTestJSON-726649374 None] Lock "cinder-5c257363-c601-4ec1-ad4b-248998aab303-delete_volume" acquired by "delete_volume" :: waited 0.077s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:21:57 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6af288b7-15a9-4bfa-93d3-8f44354bb25b tempest-VolumesTestJSON-726649374 None] Acquiring lock "cinder-quobyte-5c257363-c601-4ec1-ad4b-248998aab303" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:21:57 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6af288b7-15a9-4bfa-93d3-8f44354bb25b tempest-VolumesTestJSON-726649374 None] Lock "cinder-quobyte-5c257363-c601-4ec1-ad4b-248998aab303" acquired by "delete_volume" :: waited 0.056s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:21:57 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[73ab3426-39a7-43aa-9915-fe03ad6b64bd]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:21:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6af288b7-15a9-4bfa-93d3-8f44354bb25b tempest-VolumesTestJSON-726649374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5c257363-c601-4ec1-ad4b-248998aab303 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:57 devstack sudo[89040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5c257363-c601-4ec1-ad4b-248998aab303 Nov 01 12:21:57 devstack sudo[89040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:58 devstack sudo[89040]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6af288b7-15a9-4bfa-93d3-8f44354bb25b tempest-VolumesTestJSON-726649374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5c257363-c601-4ec1-ad4b-248998aab303" returned: 0 in 0.738s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6af288b7-15a9-4bfa-93d3-8f44354bb25b tempest-VolumesTestJSON-726649374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5c257363-c601-4ec1-ad4b-248998aab303 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:58 devstack sudo[89081]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5c257363-c601-4ec1-ad4b-248998aab303 Nov 01 12:21:58 devstack sudo[89081]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:21:59 devstack sudo[89081]: pam_unix(sudo:session): session closed for user root Nov 01 12:21:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6af288b7-15a9-4bfa-93d3-8f44354bb25b tempest-VolumesTestJSON-726649374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5c257363-c601-4ec1-ad4b-248998aab303" returned: 0 in 0.788s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:21:59 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6af288b7-15a9-4bfa-93d3-8f44354bb25b tempest-VolumesTestJSON-726649374 None] Lock "cinder-quobyte-5c257363-c601-4ec1-ad4b-248998aab303" released by "delete_volume" :: held 1.680s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:21:59 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-6af288b7-15a9-4bfa-93d3-8f44354bb25b tempest-VolumesTestJSON-726649374 None] Created reservations ['28a06d4a-7db6-4f12-96a4-2d067e810234', 'aa214e75-22c4-43ff-95ad-0e853628dd79', 'c68f48ab-d2c0-4d97-8f02-a019df1a690f', 'e3ac5690-eaaf-483a-aa34-4aec620a3d56'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:21:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-6af288b7-15a9-4bfa-93d3-8f44354bb25b tempest-VolumesTestJSON-726649374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:21:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-6af288b7-15a9-4bfa-93d3-8f44354bb25b tempest-VolumesTestJSON-726649374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:21:59 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-6af288b7-15a9-4bfa-93d3-8f44354bb25b tempest-VolumesTestJSON-726649374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:21:59 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-6af288b7-15a9-4bfa-93d3-8f44354bb25b tempest-VolumesTestJSON-726649374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:21:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-6af288b7-15a9-4bfa-93d3-8f44354bb25b tempest-VolumesTestJSON-726649374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:21:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6af288b7-15a9-4bfa-93d3-8f44354bb25b tempest-VolumesTestJSON-726649374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:21:59 devstack sudo[89100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:21:59 devstack sudo[89100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:00 devstack sudo[89100]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6af288b7-15a9-4bfa-93d3-8f44354bb25b tempest-VolumesTestJSON-726649374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.642s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:00 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-6af288b7-15a9-4bfa-93d3-8f44354bb25b tempest-VolumesTestJSON-726649374 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:22:00 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-6af288b7-15a9-4bfa-93d3-8f44354bb25b tempest-VolumesTestJSON-726649374 None] Deleted volume successfully. Nov 01 12:22:00 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6af288b7-15a9-4bfa-93d3-8f44354bb25b tempest-VolumesTestJSON-726649374 None] Lock "cinder-5c257363-c601-4ec1-ad4b-248998aab303-delete_volume" released by "delete_volume" :: held 3.053s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:22:09 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:SELECT=41,cinder:INSERT=8,cinder:UPDATE=52,cinder:DELETE=3 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:22:10 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:UPDATE=56,cinder:SELECT=37,cinder:DELETE=7,cinder:INSERT=18 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:22:20 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-c40fe162-c9f8-4d63-8c2b-b0fdcd8d300b tempest-ServersNegativeTestJSON-2000124268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:22:20 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c40fe162-c9f8-4d63-8c2b-b0fdcd8d300b tempest-ServersNegativeTestJSON-2000124268 None] Flow 'volume_create_manager' (4a9e980f-fee3-4969-a78a-9f3872c5174b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:22:20 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c40fe162-c9f8-4d63-8c2b-b0fdcd8d300b tempest-ServersNegativeTestJSON-2000124268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (642be979-f45c-4cab-bc14-d1d51001de46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:20 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c40fe162-c9f8-4d63-8c2b-b0fdcd8d300b tempest-ServersNegativeTestJSON-2000124268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (642be979-f45c-4cab-bc14-d1d51001de46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2127338624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a947863-d186-4825-8c5a-851c2a592832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='035542b67fae4d1982ee41e4a47acfd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:22:20Z,use_quota=True,user_id='9a1cea98e8dd4ab4901468ae404c4374',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:20 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c40fe162-c9f8-4d63-8c2b-b0fdcd8d300b tempest-ServersNegativeTestJSON-2000124268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (910a9e52-fafa-4eb5-b97d-aebf08e026a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:20 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c40fe162-c9f8-4d63-8c2b-b0fdcd8d300b tempest-ServersNegativeTestJSON-2000124268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (910a9e52-fafa-4eb5-b97d-aebf08e026a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:20 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c40fe162-c9f8-4d63-8c2b-b0fdcd8d300b tempest-ServersNegativeTestJSON-2000124268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a579b4be-8ab1-4435-af3d-d8106ec1f2cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:20 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c40fe162-c9f8-4d63-8c2b-b0fdcd8d300b tempest-ServersNegativeTestJSON-2000124268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a579b4be-8ab1-4435-af3d-d8106ec1f2cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a947863-d186-4825-8c5a-851c2a592832', 'volume_name': 'volume-0a947863-d186-4825-8c5a-851c2a592832', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:20 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c40fe162-c9f8-4d63-8c2b-b0fdcd8d300b tempest-ServersNegativeTestJSON-2000124268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d68a1acc-82c9-437c-b57b-c1b7a5257bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:20 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c40fe162-c9f8-4d63-8c2b-b0fdcd8d300b tempest-ServersNegativeTestJSON-2000124268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d68a1acc-82c9-437c-b57b-c1b7a5257bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:20 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c40fe162-c9f8-4d63-8c2b-b0fdcd8d300b tempest-ServersNegativeTestJSON-2000124268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1309b30e-353c-46dc-98e1-82f571183a2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:20 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-c40fe162-c9f8-4d63-8c2b-b0fdcd8d300b tempest-ServersNegativeTestJSON-2000124268 None] Volume 0a947863-d186-4825-8c5a-851c2a592832: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a947863-d186-4825-8c5a-851c2a592832', 'volume_size': 1} Nov 01 12:22:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-c40fe162-c9f8-4d63-8c2b-b0fdcd8d300b tempest-ServersNegativeTestJSON-2000124268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:22:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-c40fe162-c9f8-4d63-8c2b-b0fdcd8d300b tempest-ServersNegativeTestJSON-2000124268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:22:20 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-c40fe162-c9f8-4d63-8c2b-b0fdcd8d300b tempest-ServersNegativeTestJSON-2000124268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:22:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2127338624',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a947863-d186-4825-8c5a-851c2a592832,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='035542b67fae4d1982ee41e4a47acfd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:22:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:22:20Z,use_quota=True,user_id='9a1cea98e8dd4ab4901468ae404c4374',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:22:20 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-c40fe162-c9f8-4d63-8c2b-b0fdcd8d300b tempest-ServersNegativeTestJSON-2000124268 None] Creating volume 0a947863-d186-4825-8c5a-851c2a592832 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:22:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-c40fe162-c9f8-4d63-8c2b-b0fdcd8d300b tempest-ServersNegativeTestJSON-2000124268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:22:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-c40fe162-c9f8-4d63-8c2b-b0fdcd8d300b tempest-ServersNegativeTestJSON-2000124268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:22:20 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-c40fe162-c9f8-4d63-8c2b-b0fdcd8d300b tempest-ServersNegativeTestJSON-2000124268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:22:20 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-c40fe162-c9f8-4d63-8c2b-b0fdcd8d300b tempest-ServersNegativeTestJSON-2000124268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:22:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-c40fe162-c9f8-4d63-8c2b-b0fdcd8d300b tempest-ServersNegativeTestJSON-2000124268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:22:20 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-c40fe162-c9f8-4d63-8c2b-b0fdcd8d300b tempest-ServersNegativeTestJSON-2000124268 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:22:20 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-c40fe162-c9f8-4d63-8c2b-b0fdcd8d300b tempest-ServersNegativeTestJSON-2000124268 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:22:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c40fe162-c9f8-4d63-8c2b-b0fdcd8d300b tempest-ServersNegativeTestJSON-2000124268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a947863-d186-4825-8c5a-851c2a592832 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:20 devstack sudo[89330]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a947863-d186-4825-8c5a-851c2a592832 1073741824 Nov 01 12:22:20 devstack sudo[89330]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:20 devstack sudo[89330]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c40fe162-c9f8-4d63-8c2b-b0fdcd8d300b tempest-ServersNegativeTestJSON-2000124268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a947863-d186-4825-8c5a-851c2a592832 1073741824" returned: 0 in 0.545s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c40fe162-c9f8-4d63-8c2b-b0fdcd8d300b tempest-ServersNegativeTestJSON-2000124268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a947863-d186-4825-8c5a-851c2a592832 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:20 devstack sudo[89336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a947863-d186-4825-8c5a-851c2a592832 Nov 01 12:22:20 devstack sudo[89336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:21 devstack sudo[89336]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c40fe162-c9f8-4d63-8c2b-b0fdcd8d300b tempest-ServersNegativeTestJSON-2000124268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a947863-d186-4825-8c5a-851c2a592832" returned: 0 in 0.310s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:21 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-c40fe162-c9f8-4d63-8c2b-b0fdcd8d300b tempest-ServersNegativeTestJSON-2000124268 None] <== create_volume: return (908ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:22:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-c40fe162-c9f8-4d63-8c2b-b0fdcd8d300b tempest-ServersNegativeTestJSON-2000124268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.911s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:22:21 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c40fe162-c9f8-4d63-8c2b-b0fdcd8d300b tempest-ServersNegativeTestJSON-2000124268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1309b30e-353c-46dc-98e1-82f571183a2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a947863-d186-4825-8c5a-851c2a592832', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:21 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c40fe162-c9f8-4d63-8c2b-b0fdcd8d300b tempest-ServersNegativeTestJSON-2000124268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf03979a-96a4-4e2f-a6f5-165be6b099e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:21 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-c40fe162-c9f8-4d63-8c2b-b0fdcd8d300b tempest-ServersNegativeTestJSON-2000124268 None] Volume volume-0a947863-d186-4825-8c5a-851c2a592832 (0a947863-d186-4825-8c5a-851c2a592832): created successfully Nov 01 12:22:21 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c40fe162-c9f8-4d63-8c2b-b0fdcd8d300b tempest-ServersNegativeTestJSON-2000124268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf03979a-96a4-4e2f-a6f5-165be6b099e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:21 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c40fe162-c9f8-4d63-8c2b-b0fdcd8d300b tempest-ServersNegativeTestJSON-2000124268 None] Flow 'volume_create_manager' (4a9e980f-fee3-4969-a78a-9f3872c5174b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:22:21 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-c40fe162-c9f8-4d63-8c2b-b0fdcd8d300b tempest-ServersNegativeTestJSON-2000124268 None] Created volume successfully. Nov 01 12:22:24 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-84ea82ba-52e6-4544-99d5-64441f6ec8d0 tempest-AttachVolumeTestJSON-2012429887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:22:24 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-84ea82ba-52e6-4544-99d5-64441f6ec8d0 tempest-AttachVolumeTestJSON-2012429887 None] Flow 'volume_create_manager' (0a947bcd-d6e7-4c69-ab87-b4240608cc0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:22:24 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-84ea82ba-52e6-4544-99d5-64441f6ec8d0 tempest-AttachVolumeTestJSON-2012429887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8fdc7ca-5ca1-49d1-afdd-1de438081b78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:24 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-8cabaf41-a620-4e07-8c5f-7fa957e6317e tempest-GroupsTest-1286922955 None] Group tempest-Group1-472008680: creating Nov 01 12:22:24 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-84ea82ba-52e6-4544-99d5-64441f6ec8d0 tempest-AttachVolumeTestJSON-2012429887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b8fdc7ca-5ca1-49d1-afdd-1de438081b78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-319179899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=453c1c8a-2a14-4043-ae4f-320d720921a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7e72d8aa8784b3cb0e32ad59522b3fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:22:24Z,use_quota=True,user_id='603c24fad16041739c6ce5f4630ccecd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:24 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-84ea82ba-52e6-4544-99d5-64441f6ec8d0 tempest-AttachVolumeTestJSON-2012429887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f1c51c8-60c3-4306-8dbf-4e9806af8127) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:24 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-84ea82ba-52e6-4544-99d5-64441f6ec8d0 tempest-AttachVolumeTestJSON-2012429887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7f1c51c8-60c3-4306-8dbf-4e9806af8127) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:24 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-84ea82ba-52e6-4544-99d5-64441f6ec8d0 tempest-AttachVolumeTestJSON-2012429887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c004e79-68fd-40b5-984b-7d3ac1ef243b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:24 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-84ea82ba-52e6-4544-99d5-64441f6ec8d0 tempest-AttachVolumeTestJSON-2012429887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1c004e79-68fd-40b5-984b-7d3ac1ef243b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '453c1c8a-2a14-4043-ae4f-320d720921a8', 'volume_name': 'volume-453c1c8a-2a14-4043-ae4f-320d720921a8', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:24 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-84ea82ba-52e6-4544-99d5-64441f6ec8d0 tempest-AttachVolumeTestJSON-2012429887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f15b06c5-5a20-4046-8158-e0aef28f0cda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:24 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-84ea82ba-52e6-4544-99d5-64441f6ec8d0 tempest-AttachVolumeTestJSON-2012429887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f15b06c5-5a20-4046-8158-e0aef28f0cda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:24 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-84ea82ba-52e6-4544-99d5-64441f6ec8d0 tempest-AttachVolumeTestJSON-2012429887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d1ce146-f393-4221-a820-a29b6e624463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:24 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-84ea82ba-52e6-4544-99d5-64441f6ec8d0 tempest-AttachVolumeTestJSON-2012429887 None] Volume 453c1c8a-2a14-4043-ae4f-320d720921a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-453c1c8a-2a14-4043-ae4f-320d720921a8', 'volume_size': 1} Nov 01 12:22:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-84ea82ba-52e6-4544-99d5-64441f6ec8d0 tempest-AttachVolumeTestJSON-2012429887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:22:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-84ea82ba-52e6-4544-99d5-64441f6ec8d0 tempest-AttachVolumeTestJSON-2012429887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:22:24 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-84ea82ba-52e6-4544-99d5-64441f6ec8d0 tempest-AttachVolumeTestJSON-2012429887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:22:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-319179899',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=453c1c8a-2a14-4043-ae4f-320d720921a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7e72d8aa8784b3cb0e32ad59522b3fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:22:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:22:24Z,use_quota=True,user_id='603c24fad16041739c6ce5f4630ccecd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:22:24 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-84ea82ba-52e6-4544-99d5-64441f6ec8d0 tempest-AttachVolumeTestJSON-2012429887 None] Creating volume 453c1c8a-2a14-4043-ae4f-320d720921a8 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:22:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-84ea82ba-52e6-4544-99d5-64441f6ec8d0 tempest-AttachVolumeTestJSON-2012429887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:22:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-84ea82ba-52e6-4544-99d5-64441f6ec8d0 tempest-AttachVolumeTestJSON-2012429887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:22:24 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-84ea82ba-52e6-4544-99d5-64441f6ec8d0 tempest-AttachVolumeTestJSON-2012429887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:22:24 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-84ea82ba-52e6-4544-99d5-64441f6ec8d0 tempest-AttachVolumeTestJSON-2012429887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:22:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-84ea82ba-52e6-4544-99d5-64441f6ec8d0 tempest-AttachVolumeTestJSON-2012429887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:22:24 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-84ea82ba-52e6-4544-99d5-64441f6ec8d0 tempest-AttachVolumeTestJSON-2012429887 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:22:24 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-84ea82ba-52e6-4544-99d5-64441f6ec8d0 tempest-AttachVolumeTestJSON-2012429887 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:22:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-84ea82ba-52e6-4544-99d5-64441f6ec8d0 tempest-AttachVolumeTestJSON-2012429887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-453c1c8a-2a14-4043-ae4f-320d720921a8 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:24 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-8cabaf41-a620-4e07-8c5f-7fa957e6317e tempest-GroupsTest-1286922955 None] Group tempest-Group1-472008680: created successfully Nov 01 12:22:24 devstack sudo[89402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-453c1c8a-2a14-4043-ae4f-320d720921a8 1073741824 Nov 01 12:22:24 devstack sudo[89402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:24 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-8cabaf41-a620-4e07-8c5f-7fa957e6317e tempest-GroupsTest-1286922955 None] Create group completed successfully. Nov 01 12:22:25 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-5351f3ad-1f8c-478b-9174-01b97700c399 tempest-ServersNegativeTestJSON-2000124268 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:22:25 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5351f3ad-1f8c-478b-9174-01b97700c399 tempest-ServersNegativeTestJSON-2000124268 None] Flow 'volume_create_manager' (c775b270-c53a-4d46-9ca3-a7df655a3d0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:22:25 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5351f3ad-1f8c-478b-9174-01b97700c399 tempest-ServersNegativeTestJSON-2000124268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d11a0fe-e3c6-43c3-8a50-944c88759565) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:25 devstack sudo[89402]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-84ea82ba-52e6-4544-99d5-64441f6ec8d0 tempest-AttachVolumeTestJSON-2012429887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-453c1c8a-2a14-4043-ae4f-320d720921a8 1073741824" returned: 0 in 0.695s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:25 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5351f3ad-1f8c-478b-9174-01b97700c399 tempest-ServersNegativeTestJSON-2000124268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1d11a0fe-e3c6-43c3-8a50-944c88759565) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-569042928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=583ec896-d09d-4396-b7b5-998173f18bb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='035542b67fae4d1982ee41e4a47acfd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:22:25Z,use_quota=True,user_id='9a1cea98e8dd4ab4901468ae404c4374',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:25 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5351f3ad-1f8c-478b-9174-01b97700c399 tempest-ServersNegativeTestJSON-2000124268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e64315a-d0b9-4538-b6bf-8a390791e4ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:25 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5351f3ad-1f8c-478b-9174-01b97700c399 tempest-ServersNegativeTestJSON-2000124268 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e64315a-d0b9-4538-b6bf-8a390791e4ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:25 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5351f3ad-1f8c-478b-9174-01b97700c399 tempest-ServersNegativeTestJSON-2000124268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebc92e02-883e-415a-9600-c6e8021c1cd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:25 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5351f3ad-1f8c-478b-9174-01b97700c399 tempest-ServersNegativeTestJSON-2000124268 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebc92e02-883e-415a-9600-c6e8021c1cd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '583ec896-d09d-4396-b7b5-998173f18bb6', 'volume_name': 'volume-583ec896-d09d-4396-b7b5-998173f18bb6', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:25 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5351f3ad-1f8c-478b-9174-01b97700c399 tempest-ServersNegativeTestJSON-2000124268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edee77d2-65fe-45b0-b2a5-34447f2637f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:25 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5351f3ad-1f8c-478b-9174-01b97700c399 tempest-ServersNegativeTestJSON-2000124268 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (edee77d2-65fe-45b0-b2a5-34447f2637f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:25 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5351f3ad-1f8c-478b-9174-01b97700c399 tempest-ServersNegativeTestJSON-2000124268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21e1a51f-c465-46b8-8fa1-95087649fede) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:25 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-5351f3ad-1f8c-478b-9174-01b97700c399 tempest-ServersNegativeTestJSON-2000124268 None] Volume 583ec896-d09d-4396-b7b5-998173f18bb6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-583ec896-d09d-4396-b7b5-998173f18bb6', 'volume_size': 1} Nov 01 12:22:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5351f3ad-1f8c-478b-9174-01b97700c399 tempest-ServersNegativeTestJSON-2000124268 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:22:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-84ea82ba-52e6-4544-99d5-64441f6ec8d0 tempest-AttachVolumeTestJSON-2012429887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-453c1c8a-2a14-4043-ae4f-320d720921a8 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:25 devstack sudo[89409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-453c1c8a-2a14-4043-ae4f-320d720921a8 Nov 01 12:22:25 devstack sudo[89409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:25 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-fcab8ebf-d32c-4084-b876-0a04bce5cbdf tempest-GroupsTest-1286922955 None] Group tempest-Group2-1106911207: creating Nov 01 12:22:25 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-fcab8ebf-d32c-4084-b876-0a04bce5cbdf tempest-GroupsTest-1286922955 None] Group tempest-Group2-1106911207: created successfully Nov 01 12:22:25 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-fcab8ebf-d32c-4084-b876-0a04bce5cbdf tempest-GroupsTest-1286922955 None] Create group completed successfully. Nov 01 12:22:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-59605c47-a36d-4681-95ce-ae9c97ae438f req-7f1cdcf7-379b-4181-89a7-6d8206c0e433 tempest-TaggedAttachmentsTest-66506181 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:22:25 devstack sudo[89409]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-84ea82ba-52e6-4544-99d5-64441f6ec8d0 tempest-AttachVolumeTestJSON-2012429887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-453c1c8a-2a14-4043-ae4f-320d720921a8" returned: 0 in 0.339s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:25 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-84ea82ba-52e6-4544-99d5-64441f6ec8d0 tempest-AttachVolumeTestJSON-2012429887 None] <== create_volume: return (1125ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:22:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-84ea82ba-52e6-4544-99d5-64441f6ec8d0 tempest-AttachVolumeTestJSON-2012429887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.128s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:22:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5351f3ad-1f8c-478b-9174-01b97700c399 tempest-ServersNegativeTestJSON-2000124268 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.367s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:22:25 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-5351f3ad-1f8c-478b-9174-01b97700c399 tempest-ServersNegativeTestJSON-2000124268 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:22:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-569042928',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=583ec896-d09d-4396-b7b5-998173f18bb6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='035542b67fae4d1982ee41e4a47acfd7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:22:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:22:25Z,use_quota=True,user_id='9a1cea98e8dd4ab4901468ae404c4374',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:22:25 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-5351f3ad-1f8c-478b-9174-01b97700c399 tempest-ServersNegativeTestJSON-2000124268 None] Creating volume 583ec896-d09d-4396-b7b5-998173f18bb6 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:22:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5351f3ad-1f8c-478b-9174-01b97700c399 tempest-ServersNegativeTestJSON-2000124268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:22:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5351f3ad-1f8c-478b-9174-01b97700c399 tempest-ServersNegativeTestJSON-2000124268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:22:25 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-5351f3ad-1f8c-478b-9174-01b97700c399 tempest-ServersNegativeTestJSON-2000124268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:22:25 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-5351f3ad-1f8c-478b-9174-01b97700c399 tempest-ServersNegativeTestJSON-2000124268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:22:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5351f3ad-1f8c-478b-9174-01b97700c399 tempest-ServersNegativeTestJSON-2000124268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:22:25 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-5351f3ad-1f8c-478b-9174-01b97700c399 tempest-ServersNegativeTestJSON-2000124268 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:22:25 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-5351f3ad-1f8c-478b-9174-01b97700c399 tempest-ServersNegativeTestJSON-2000124268 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:22:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5351f3ad-1f8c-478b-9174-01b97700c399 tempest-ServersNegativeTestJSON-2000124268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-583ec896-d09d-4396-b7b5-998173f18bb6 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:25 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-84ea82ba-52e6-4544-99d5-64441f6ec8d0 tempest-AttachVolumeTestJSON-2012429887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4d1ce146-f393-4221-a820-a29b6e624463) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-453c1c8a-2a14-4043-ae4f-320d720921a8', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:25 devstack sudo[89420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-583ec896-d09d-4396-b7b5-998173f18bb6 1073741824 Nov 01 12:22:25 devstack sudo[89420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:25 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-84ea82ba-52e6-4544-99d5-64441f6ec8d0 tempest-AttachVolumeTestJSON-2012429887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7e7f652-f428-4f16-8bad-9fc8571358f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:25 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-84ea82ba-52e6-4544-99d5-64441f6ec8d0 tempest-AttachVolumeTestJSON-2012429887 None] Volume volume-453c1c8a-2a14-4043-ae4f-320d720921a8 (453c1c8a-2a14-4043-ae4f-320d720921a8): created successfully Nov 01 12:22:25 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-84ea82ba-52e6-4544-99d5-64441f6ec8d0 tempest-AttachVolumeTestJSON-2012429887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7e7f652-f428-4f16-8bad-9fc8571358f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:25 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-84ea82ba-52e6-4544-99d5-64441f6ec8d0 tempest-AttachVolumeTestJSON-2012429887 None] Flow 'volume_create_manager' (0a947bcd-d6e7-4c69-ab87-b4240608cc0e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:22:25 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-84ea82ba-52e6-4544-99d5-64441f6ec8d0 tempest-AttachVolumeTestJSON-2012429887 None] Created volume successfully. Nov 01 12:22:26 devstack sudo[89420]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5351f3ad-1f8c-478b-9174-01b97700c399 tempest-ServersNegativeTestJSON-2000124268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-583ec896-d09d-4396-b7b5-998173f18bb6 1073741824" returned: 0 in 0.448s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5351f3ad-1f8c-478b-9174-01b97700c399 tempest-ServersNegativeTestJSON-2000124268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-583ec896-d09d-4396-b7b5-998173f18bb6 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:26 devstack sudo[89426]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-583ec896-d09d-4396-b7b5-998173f18bb6 Nov 01 12:22:26 devstack sudo[89426]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:26 devstack sudo[89426]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5351f3ad-1f8c-478b-9174-01b97700c399 tempest-ServersNegativeTestJSON-2000124268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-583ec896-d09d-4396-b7b5-998173f18bb6" returned: 0 in 0.256s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:26 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-5351f3ad-1f8c-478b-9174-01b97700c399 tempest-ServersNegativeTestJSON-2000124268 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:22:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5351f3ad-1f8c-478b-9174-01b97700c399 tempest-ServersNegativeTestJSON-2000124268 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:22:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-59605c47-a36d-4681-95ce-ae9c97ae438f req-7f1cdcf7-379b-4181-89a7-6d8206c0e433 tempest-TaggedAttachmentsTest-66506181 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.780s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:22:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5351f3ad-1f8c-478b-9174-01b97700c399 tempest-ServersNegativeTestJSON-2000124268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21e1a51f-c465-46b8-8fa1-95087649fede) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-583ec896-d09d-4396-b7b5-998173f18bb6', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5351f3ad-1f8c-478b-9174-01b97700c399 tempest-ServersNegativeTestJSON-2000124268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a26bb42f-965c-4cb4-8b88-dae300c89b99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-59605c47-a36d-4681-95ce-ae9c97ae438f req-7f1cdcf7-379b-4181-89a7-6d8206c0e433 tempest-TaggedAttachmentsTest-66506181 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:22:26 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-5351f3ad-1f8c-478b-9174-01b97700c399 tempest-ServersNegativeTestJSON-2000124268 None] Volume volume-583ec896-d09d-4396-b7b5-998173f18bb6 (583ec896-d09d-4396-b7b5-998173f18bb6): created successfully Nov 01 12:22:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5351f3ad-1f8c-478b-9174-01b97700c399 tempest-ServersNegativeTestJSON-2000124268 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a26bb42f-965c-4cb4-8b88-dae300c89b99) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5351f3ad-1f8c-478b-9174-01b97700c399 tempest-ServersNegativeTestJSON-2000124268 None] Flow 'volume_create_manager' (c775b270-c53a-4d46-9ca3-a7df655a3d0a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:22:26 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-5351f3ad-1f8c-478b-9174-01b97700c399 tempest-ServersNegativeTestJSON-2000124268 None] Created volume successfully. Nov 01 12:22:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-59605c47-a36d-4681-95ce-ae9c97ae438f req-7f1cdcf7-379b-4181-89a7-6d8206c0e433 tempest-TaggedAttachmentsTest-66506181 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb', 'name': 'volume-0beaf06f-3f52-45dd-bcb0-32df856a87dc', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '4274d57f-d0a5-4f45-aea6-dfe84f55a199', 'enforce_multipath': True} {{(pid=86574) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 12:22:26 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-59605c47-a36d-4681-95ce-ae9c97ae438f req-7f1cdcf7-379b-4181-89a7-6d8206c0e433 tempest-TaggedAttachmentsTest-66506181 None] attachment_update completed successfully. Nov 01 12:22:27 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5667994-bbd5-4050-b07d-dc27b791ee15 tempest-GroupsTest-1286922955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:22:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b5667994-bbd5-4050-b07d-dc27b791ee15 tempest-GroupsTest-1286922955 None] Flow 'volume_create_manager' (46212153-4a4b-4cce-857b-b2a6baaec433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:22:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b5667994-bbd5-4050-b07d-dc27b791ee15 tempest-GroupsTest-1286922955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f079a55-e7de-4218-8eea-edd8c6057da7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b5667994-bbd5-4050-b07d-dc27b791ee15 tempest-GroupsTest-1286922955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4f079a55-e7de-4218-8eea-edd8c6057da7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1711403384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3b84d9fd-1370-44e1-adad-72e49b0b3054,host='devstack@QuobyteHD#QuobyteHD',id=091dc8ad-0e69-41ed-bffb-b633a1570cd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bbdc19d56364c5cbe7f2c979710e174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:22:27Z,use_quota=True,user_id='15a6bbdf1d0d4d71965212d053faa50f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59c7c9e0-6e2b-4b81-8e0f-77d4263dca63),volume_type_id=59c7c9e0-6e2b-4b81-8e0f-77d4263dca63)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b5667994-bbd5-4050-b07d-dc27b791ee15 tempest-GroupsTest-1286922955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33b10348-6ff4-4d7f-bf90-082b1c363031) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b5667994-bbd5-4050-b07d-dc27b791ee15 tempest-GroupsTest-1286922955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (33b10348-6ff4-4d7f-bf90-082b1c363031) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b5667994-bbd5-4050-b07d-dc27b791ee15 tempest-GroupsTest-1286922955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5c41992-9a7b-4818-9bb1-d16ad40bfddb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b5667994-bbd5-4050-b07d-dc27b791ee15 tempest-GroupsTest-1286922955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c5c41992-9a7b-4818-9bb1-d16ad40bfddb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '091dc8ad-0e69-41ed-bffb-b633a1570cd0', 'volume_name': 'volume-091dc8ad-0e69-41ed-bffb-b633a1570cd0', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b5667994-bbd5-4050-b07d-dc27b791ee15 tempest-GroupsTest-1286922955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5b26a47-6121-4b03-a112-0c99ecc0dd22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b5667994-bbd5-4050-b07d-dc27b791ee15 tempest-GroupsTest-1286922955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e5b26a47-6121-4b03-a112-0c99ecc0dd22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b5667994-bbd5-4050-b07d-dc27b791ee15 tempest-GroupsTest-1286922955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4d3c1f0-8bd4-40e4-bcbb-2f4d1dc56d5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:27 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-b5667994-bbd5-4050-b07d-dc27b791ee15 tempest-GroupsTest-1286922955 None] Volume 091dc8ad-0e69-41ed-bffb-b633a1570cd0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-091dc8ad-0e69-41ed-bffb-b633a1570cd0', 'volume_size': 1} Nov 01 12:22:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b5667994-bbd5-4050-b07d-dc27b791ee15 tempest-GroupsTest-1286922955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:22:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b5667994-bbd5-4050-b07d-dc27b791ee15 tempest-GroupsTest-1286922955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:22:27 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-b5667994-bbd5-4050-b07d-dc27b791ee15 tempest-GroupsTest-1286922955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=3b84d9fd-1370-44e1-adad-72e49b0b3054,created_at=2026-11-01T11:22:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1711403384',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=3b84d9fd-1370-44e1-adad-72e49b0b3054,host='devstack@QuobyteHD#QuobyteHD',id=091dc8ad-0e69-41ed-bffb-b633a1570cd0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bbdc19d56364c5cbe7f2c979710e174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:22:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:22:27Z,use_quota=True,user_id='15a6bbdf1d0d4d71965212d053faa50f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(59c7c9e0-6e2b-4b81-8e0f-77d4263dca63),volume_type_id=59c7c9e0-6e2b-4b81-8e0f-77d4263dca63)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:22:27 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-b5667994-bbd5-4050-b07d-dc27b791ee15 tempest-GroupsTest-1286922955 None] Creating volume 091dc8ad-0e69-41ed-bffb-b633a1570cd0 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:22:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b5667994-bbd5-4050-b07d-dc27b791ee15 tempest-GroupsTest-1286922955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:22:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b5667994-bbd5-4050-b07d-dc27b791ee15 tempest-GroupsTest-1286922955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:22:27 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-b5667994-bbd5-4050-b07d-dc27b791ee15 tempest-GroupsTest-1286922955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:22:27 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-b5667994-bbd5-4050-b07d-dc27b791ee15 tempest-GroupsTest-1286922955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:22:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b5667994-bbd5-4050-b07d-dc27b791ee15 tempest-GroupsTest-1286922955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:22:27 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-b5667994-bbd5-4050-b07d-dc27b791ee15 tempest-GroupsTest-1286922955 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:22:27 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-b5667994-bbd5-4050-b07d-dc27b791ee15 tempest-GroupsTest-1286922955 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:22:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b5667994-bbd5-4050-b07d-dc27b791ee15 tempest-GroupsTest-1286922955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-091dc8ad-0e69-41ed-bffb-b633a1570cd0 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-a0e12367-f78c-4781-81f2-deda030bd460 req-12cf1741-2bbb-4d9c-b0dc-f4d9a8e27f6f tempest-AttachVolumeTestJSON-2012429887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:22:27 devstack sudo[89858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-091dc8ad-0e69-41ed-bffb-b633a1570cd0 1073741824 Nov 01 12:22:27 devstack sudo[89858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:27 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-eed382a2-14aa-4ee8-842d-ddf30bf530c7 tempest-ServersNegativeTestJSON-2000124268 None] Acquiring lock "cinder-583ec896-d09d-4396-b7b5-998173f18bb6-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:22:27 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-eed382a2-14aa-4ee8-842d-ddf30bf530c7 tempest-ServersNegativeTestJSON-2000124268 None] Lock "cinder-583ec896-d09d-4396-b7b5-998173f18bb6-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:22:27 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-eed382a2-14aa-4ee8-842d-ddf30bf530c7 tempest-ServersNegativeTestJSON-2000124268 None] Acquiring lock "cinder-quobyte-583ec896-d09d-4396-b7b5-998173f18bb6" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:22:27 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-eed382a2-14aa-4ee8-842d-ddf30bf530c7 tempest-ServersNegativeTestJSON-2000124268 None] Lock "cinder-quobyte-583ec896-d09d-4396-b7b5-998173f18bb6" acquired by "delete_volume" :: waited 0.017s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:22:27 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[441c1743-67e8-4bfb-8dc4-c8c2c0781fec]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:22:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eed382a2-14aa-4ee8-842d-ddf30bf530c7 tempest-ServersNegativeTestJSON-2000124268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-583ec896-d09d-4396-b7b5-998173f18bb6 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:27 devstack sudo[89858]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b5667994-bbd5-4050-b07d-dc27b791ee15 tempest-GroupsTest-1286922955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-091dc8ad-0e69-41ed-bffb-b633a1570cd0 1073741824" returned: 0 in 0.503s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:27 devstack sudo[89864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-583ec896-d09d-4396-b7b5-998173f18bb6 Nov 01 12:22:27 devstack sudo[89864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b5667994-bbd5-4050-b07d-dc27b791ee15 tempest-GroupsTest-1286922955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-091dc8ad-0e69-41ed-bffb-b633a1570cd0 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:27 devstack sudo[89866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-091dc8ad-0e69-41ed-bffb-b633a1570cd0 Nov 01 12:22:27 devstack sudo[89866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:28 devstack sudo[89864]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eed382a2-14aa-4ee8-842d-ddf30bf530c7 tempest-ServersNegativeTestJSON-2000124268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-583ec896-d09d-4396-b7b5-998173f18bb6" returned: 0 in 0.366s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eed382a2-14aa-4ee8-842d-ddf30bf530c7 tempest-ServersNegativeTestJSON-2000124268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-583ec896-d09d-4396-b7b5-998173f18bb6 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:28 devstack sudo[89866]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b5667994-bbd5-4050-b07d-dc27b791ee15 tempest-GroupsTest-1286922955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-091dc8ad-0e69-41ed-bffb-b633a1570cd0" returned: 0 in 0.251s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:28 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-b5667994-bbd5-4050-b07d-dc27b791ee15 tempest-GroupsTest-1286922955 None] <== create_volume: return (802ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:22:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b5667994-bbd5-4050-b07d-dc27b791ee15 tempest-GroupsTest-1286922955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.806s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:22:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-a0e12367-f78c-4781-81f2-deda030bd460 req-12cf1741-2bbb-4d9c-b0dc-f4d9a8e27f6f tempest-AttachVolumeTestJSON-2012429887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.777s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:22:28 devstack sudo[89872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-583ec896-d09d-4396-b7b5-998173f18bb6 Nov 01 12:22:28 devstack sudo[89872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b5667994-bbd5-4050-b07d-dc27b791ee15 tempest-GroupsTest-1286922955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b4d3c1f0-8bd4-40e4-bcbb-2f4d1dc56d5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-091dc8ad-0e69-41ed-bffb-b633a1570cd0', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b5667994-bbd5-4050-b07d-dc27b791ee15 tempest-GroupsTest-1286922955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1903b234-f5be-412c-9192-0aae07a104e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-a0e12367-f78c-4781-81f2-deda030bd460 req-12cf1741-2bbb-4d9c-b0dc-f4d9a8e27f6f tempest-AttachVolumeTestJSON-2012429887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:22:28 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-b5667994-bbd5-4050-b07d-dc27b791ee15 tempest-GroupsTest-1286922955 None] Volume volume-091dc8ad-0e69-41ed-bffb-b633a1570cd0 (091dc8ad-0e69-41ed-bffb-b633a1570cd0): created successfully Nov 01 12:22:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b5667994-bbd5-4050-b07d-dc27b791ee15 tempest-GroupsTest-1286922955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1903b234-f5be-412c-9192-0aae07a104e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b5667994-bbd5-4050-b07d-dc27b791ee15 tempest-GroupsTest-1286922955 None] Flow 'volume_create_manager' (46212153-4a4b-4cce-857b-b2a6baaec433) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:22:28 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-b5667994-bbd5-4050-b07d-dc27b791ee15 tempest-GroupsTest-1286922955 None] Created volume successfully. Nov 01 12:22:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-a0e12367-f78c-4781-81f2-deda030bd460 req-12cf1741-2bbb-4d9c-b0dc-f4d9a8e27f6f tempest-AttachVolumeTestJSON-2012429887 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb', 'name': 'volume-453c1c8a-2a14-4043-ae4f-320d720921a8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ac8c879e-3d36-4037-8c35-567f2fdf416f', 'enforce_multipath': True} {{(pid=86574) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 12:22:28 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-a0e12367-f78c-4781-81f2-deda030bd460 req-12cf1741-2bbb-4d9c-b0dc-f4d9a8e27f6f tempest-AttachVolumeTestJSON-2012429887 None] attachment_update completed successfully. Nov 01 12:22:28 devstack sudo[89872]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eed382a2-14aa-4ee8-842d-ddf30bf530c7 tempest-ServersNegativeTestJSON-2000124268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-583ec896-d09d-4396-b7b5-998173f18bb6" returned: 0 in 0.272s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:28 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-eed382a2-14aa-4ee8-842d-ddf30bf530c7 tempest-ServersNegativeTestJSON-2000124268 None] Lock "cinder-quobyte-583ec896-d09d-4396-b7b5-998173f18bb6" released by "delete_volume" :: held 0.684s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:22:28 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-eed382a2-14aa-4ee8-842d-ddf30bf530c7 tempest-ServersNegativeTestJSON-2000124268 None] Created reservations ['1811fc43-5625-479f-b5a2-30f6ff28f765', 'a1ee06af-b50b-4a48-9f38-211b804f7375', '4299af8d-bd9a-4c2a-9d4f-dcd5a193c8c3', 'f207ce83-785f-4aeb-9716-1e8052aac2a6'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:22:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-eed382a2-14aa-4ee8-842d-ddf30bf530c7 tempest-ServersNegativeTestJSON-2000124268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:22:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-eed382a2-14aa-4ee8-842d-ddf30bf530c7 tempest-ServersNegativeTestJSON-2000124268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:22:28 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-eed382a2-14aa-4ee8-842d-ddf30bf530c7 tempest-ServersNegativeTestJSON-2000124268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:22:28 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-eed382a2-14aa-4ee8-842d-ddf30bf530c7 tempest-ServersNegativeTestJSON-2000124268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:22:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-eed382a2-14aa-4ee8-842d-ddf30bf530c7 tempest-ServersNegativeTestJSON-2000124268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:22:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eed382a2-14aa-4ee8-842d-ddf30bf530c7 tempest-ServersNegativeTestJSON-2000124268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:28 devstack sudo[89882]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:22:28 devstack sudo[89882]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:29 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d5d28ab0-75cd-4aec-8396-2d4b5b64d996 tempest-ServersNegativeTestJSON-2000124268 None] Acquiring lock "cinder-0a947863-d186-4825-8c5a-851c2a592832-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:22:29 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d5d28ab0-75cd-4aec-8396-2d4b5b64d996 tempest-ServersNegativeTestJSON-2000124268 None] Lock "cinder-0a947863-d186-4825-8c5a-851c2a592832-delete_volume" acquired by "delete_volume" :: waited 0.050s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:22:29 devstack sudo[89882]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eed382a2-14aa-4ee8-842d-ddf30bf530c7 tempest-ServersNegativeTestJSON-2000124268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.460s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:29 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-eed382a2-14aa-4ee8-842d-ddf30bf530c7 tempest-ServersNegativeTestJSON-2000124268 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:22:29 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-eed382a2-14aa-4ee8-842d-ddf30bf530c7 tempest-ServersNegativeTestJSON-2000124268 None] Deleted volume successfully. Nov 01 12:22:29 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d5d28ab0-75cd-4aec-8396-2d4b5b64d996 tempest-ServersNegativeTestJSON-2000124268 None] Acquiring lock "cinder-quobyte-0a947863-d186-4825-8c5a-851c2a592832" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:22:29 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-eed382a2-14aa-4ee8-842d-ddf30bf530c7 tempest-ServersNegativeTestJSON-2000124268 None] Lock "cinder-583ec896-d09d-4396-b7b5-998173f18bb6-delete_volume" released by "delete_volume" :: held 1.473s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:22:29 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d5d28ab0-75cd-4aec-8396-2d4b5b64d996 tempest-ServersNegativeTestJSON-2000124268 None] Lock "cinder-quobyte-0a947863-d186-4825-8c5a-851c2a592832" acquired by "delete_volume" :: waited 0.042s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:22:29 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[aa1099c4-a848-42e0-a201-815ac03e0394]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:22:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d5d28ab0-75cd-4aec-8396-2d4b5b64d996 tempest-ServersNegativeTestJSON-2000124268 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a947863-d186-4825-8c5a-851c2a592832 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:29 devstack sudo[89887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a947863-d186-4825-8c5a-851c2a592832 Nov 01 12:22:29 devstack sudo[89887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:29 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-bffc8231-a6c2-4bc6-a61c-d28f9246604c tempest-GroupsTest-1286922955 None] Acquiring lock "cinder-quobyte-091dc8ad-0e69-41ed-bffb-b633a1570cd0" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:22:29 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-bffc8231-a6c2-4bc6-a61c-d28f9246604c tempest-GroupsTest-1286922955 None] Lock "cinder-quobyte-091dc8ad-0e69-41ed-bffb-b633a1570cd0" acquired by "delete_volume" :: waited 0.061s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:22:29 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[4190277c-d8cf-4201-ae84-90d369140633]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:22:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bffc8231-a6c2-4bc6-a61c-d28f9246604c tempest-GroupsTest-1286922955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-091dc8ad-0e69-41ed-bffb-b633a1570cd0 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:29 devstack sudo[89887]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d5d28ab0-75cd-4aec-8396-2d4b5b64d996 tempest-ServersNegativeTestJSON-2000124268 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a947863-d186-4825-8c5a-851c2a592832" returned: 0 in 0.628s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d5d28ab0-75cd-4aec-8396-2d4b5b64d996 tempest-ServersNegativeTestJSON-2000124268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a947863-d186-4825-8c5a-851c2a592832 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:29 devstack sudo[89925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a947863-d186-4825-8c5a-851c2a592832 Nov 01 12:22:29 devstack sudo[89925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:29 devstack sudo[89914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-091dc8ad-0e69-41ed-bffb-b633a1570cd0 Nov 01 12:22:29 devstack sudo[89914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:30 devstack sudo[89914]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bffc8231-a6c2-4bc6-a61c-d28f9246604c tempest-GroupsTest-1286922955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-091dc8ad-0e69-41ed-bffb-b633a1570cd0" returned: 0 in 0.500s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bffc8231-a6c2-4bc6-a61c-d28f9246604c tempest-GroupsTest-1286922955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-091dc8ad-0e69-41ed-bffb-b633a1570cd0 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:30 devstack sudo[89941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-091dc8ad-0e69-41ed-bffb-b633a1570cd0 Nov 01 12:22:30 devstack sudo[89941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:30 devstack sudo[89925]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d5d28ab0-75cd-4aec-8396-2d4b5b64d996 tempest-ServersNegativeTestJSON-2000124268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a947863-d186-4825-8c5a-851c2a592832" returned: 0 in 0.533s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:30 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d5d28ab0-75cd-4aec-8396-2d4b5b64d996 tempest-ServersNegativeTestJSON-2000124268 None] Lock "cinder-quobyte-0a947863-d186-4825-8c5a-851c2a592832" released by "delete_volume" :: held 1.223s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:22:30 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-d5d28ab0-75cd-4aec-8396-2d4b5b64d996 tempest-ServersNegativeTestJSON-2000124268 None] Created reservations ['d88115fe-8a64-4960-b825-cb21e791381b', 'c439c9db-c06e-4890-88fb-78433cba47ca', 'c8a291f2-3bff-4586-ab75-55605eecf495', '003d5e0d-cbac-45fc-91c0-59406d4f2e99'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:22:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d5d28ab0-75cd-4aec-8396-2d4b5b64d996 tempest-ServersNegativeTestJSON-2000124268 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:22:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d5d28ab0-75cd-4aec-8396-2d4b5b64d996 tempest-ServersNegativeTestJSON-2000124268 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:22:30 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d5d28ab0-75cd-4aec-8396-2d4b5b64d996 tempest-ServersNegativeTestJSON-2000124268 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:22:30 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d5d28ab0-75cd-4aec-8396-2d4b5b64d996 tempest-ServersNegativeTestJSON-2000124268 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:22:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d5d28ab0-75cd-4aec-8396-2d4b5b64d996 tempest-ServersNegativeTestJSON-2000124268 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:22:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d5d28ab0-75cd-4aec-8396-2d4b5b64d996 tempest-ServersNegativeTestJSON-2000124268 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:30 devstack sudo[89945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:22:30 devstack sudo[89945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:30 devstack sudo[89941]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bffc8231-a6c2-4bc6-a61c-d28f9246604c tempest-GroupsTest-1286922955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-091dc8ad-0e69-41ed-bffb-b633a1570cd0" returned: 0 in 0.307s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:30 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-bffc8231-a6c2-4bc6-a61c-d28f9246604c tempest-GroupsTest-1286922955 None] Lock "cinder-quobyte-091dc8ad-0e69-41ed-bffb-b633a1570cd0" released by "delete_volume" :: held 0.909s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:22:30 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-bffc8231-a6c2-4bc6-a61c-d28f9246604c tempest-GroupsTest-1286922955 None] Created reservations ['1e4886ef-ca9d-4c08-820f-9245a298769e'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:22:30 devstack cinder-volume[86574]: WARNING cinder.quota [None req-bffc8231-a6c2-4bc6-a61c-d28f9246604c tempest-GroupsTest-1286922955 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-77979127 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-77979127, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:22:30 devstack cinder-volume[86574]: WARNING cinder.quota [None req-bffc8231-a6c2-4bc6-a61c-d28f9246604c tempest-GroupsTest-1286922955 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-77979127 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-77979127, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:22:30 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-bffc8231-a6c2-4bc6-a61c-d28f9246604c tempest-GroupsTest-1286922955 None] Created reservations ['0f1e7b00-65a5-4d0e-bdb1-96da2337827d', 'bcb82613-f6a9-45c0-bf9a-8ff00ea76eb6', 'dde75428-cd4a-4a79-b949-9907400abe6f', 'c8ef5d59-69ce-47a0-9ca8-bb8855f34309'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:22:30 devstack sudo[89945]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d5d28ab0-75cd-4aec-8396-2d4b5b64d996 tempest-ServersNegativeTestJSON-2000124268 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.306s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:30 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-d5d28ab0-75cd-4aec-8396-2d4b5b64d996 tempest-ServersNegativeTestJSON-2000124268 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:22:30 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-d5d28ab0-75cd-4aec-8396-2d4b5b64d996 tempest-ServersNegativeTestJSON-2000124268 None] Deleted volume successfully. Nov 01 12:22:30 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d5d28ab0-75cd-4aec-8396-2d4b5b64d996 tempest-ServersNegativeTestJSON-2000124268 None] Lock "cinder-0a947863-d186-4825-8c5a-851c2a592832-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:22:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-bffc8231-a6c2-4bc6-a61c-d28f9246604c tempest-GroupsTest-1286922955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:22:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-bffc8231-a6c2-4bc6-a61c-d28f9246604c tempest-GroupsTest-1286922955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:22:30 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-bffc8231-a6c2-4bc6-a61c-d28f9246604c tempest-GroupsTest-1286922955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:22:30 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-bffc8231-a6c2-4bc6-a61c-d28f9246604c tempest-GroupsTest-1286922955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:22:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-bffc8231-a6c2-4bc6-a61c-d28f9246604c tempest-GroupsTest-1286922955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:22:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bffc8231-a6c2-4bc6-a61c-d28f9246604c tempest-GroupsTest-1286922955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:30 devstack sudo[89951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:22:30 devstack sudo[89951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:31 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-1d1c16ca-13b3-41ba-a03a-5b72dee32fbf req-451714a5-517c-47d3-84a2-1e57c9f95bde tempest-TaggedAttachmentsTest-66506181 None] Terminate volume connection completed successfully. Nov 01 12:22:31 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-1d1c16ca-13b3-41ba-a03a-5b72dee32fbf req-451714a5-517c-47d3-84a2-1e57c9f95bde tempest-TaggedAttachmentsTest-66506181 None] Deleting attachment 4274d57f-d0a5-4f45-aea6-dfe84f55a199. {{(pid=86574) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 12:22:31 devstack sudo[89951]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bffc8231-a6c2-4bc6-a61c-d28f9246604c tempest-GroupsTest-1286922955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.332s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:31 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-bffc8231-a6c2-4bc6-a61c-d28f9246604c tempest-GroupsTest-1286922955 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:22:31 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-bffc8231-a6c2-4bc6-a61c-d28f9246604c tempest-GroupsTest-1286922955 None] Delete group completed successfully. Nov 01 12:22:31 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-858f12e2-4092-44f5-a3e2-373d38689283 tempest-GroupsTest-1286922955 None] Created reservations ['8fa57fc6-7dcb-4820-9f7e-9cb88ad48389'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:22:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-858f12e2-4092-44f5-a3e2-373d38689283 tempest-GroupsTest-1286922955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:22:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-858f12e2-4092-44f5-a3e2-373d38689283 tempest-GroupsTest-1286922955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:22:31 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-858f12e2-4092-44f5-a3e2-373d38689283 tempest-GroupsTest-1286922955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:22:31 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-858f12e2-4092-44f5-a3e2-373d38689283 tempest-GroupsTest-1286922955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:22:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-858f12e2-4092-44f5-a3e2-373d38689283 tempest-GroupsTest-1286922955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:22:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-858f12e2-4092-44f5-a3e2-373d38689283 tempest-GroupsTest-1286922955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:31 devstack sudo[89979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:22:31 devstack sudo[89979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:31 devstack sudo[89979]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-858f12e2-4092-44f5-a3e2-373d38689283 tempest-GroupsTest-1286922955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.324s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:31 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-858f12e2-4092-44f5-a3e2-373d38689283 tempest-GroupsTest-1286922955 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:22:31 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-858f12e2-4092-44f5-a3e2-373d38689283 tempest-GroupsTest-1286922955 None] Delete group completed successfully. Nov 01 12:22:33 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-2f9f1cf1-1dce-4dc8-9263-af14f3a74c15 tempest-GroupsTest-1286922955 None] Group tempest-GroupsTest-Group-865187097: creating Nov 01 12:22:33 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-2f9f1cf1-1dce-4dc8-9263-af14f3a74c15 tempest-GroupsTest-1286922955 None] Group tempest-GroupsTest-Group-865187097: created successfully Nov 01 12:22:33 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-2f9f1cf1-1dce-4dc8-9263-af14f3a74c15 tempest-GroupsTest-1286922955 None] Create group completed successfully. Nov 01 12:22:35 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-e8d392b5-8485-42ea-8360-f480ee8e3a26 tempest-GroupsTest-1286922955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:22:35 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e8d392b5-8485-42ea-8360-f480ee8e3a26 tempest-GroupsTest-1286922955 None] Flow 'volume_create_manager' (2b46b640-912d-443d-9d5d-b120d416bf31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:22:35 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e8d392b5-8485-42ea-8360-f480ee8e3a26 tempest-GroupsTest-1286922955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78de4566-9a34-4f09-8ab8-5f2bc00398cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:35 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e8d392b5-8485-42ea-8360-f480ee8e3a26 tempest-GroupsTest-1286922955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78de4566-9a34-4f09-8ab8-5f2bc00398cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-167210725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=61a9d3ed-0fca-446a-aeea-3ee2599ef309,host='devstack@QuobyteHD#QuobyteHD',id=90eb88dd-ebb8-47bd-b77d-1842c745129f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bbdc19d56364c5cbe7f2c979710e174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:22:36Z,use_quota=True,user_id='15a6bbdf1d0d4d71965212d053faa50f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0033ac28-d2a4-4fc2-a692-7633f3fd4cab),volume_type_id=0033ac28-d2a4-4fc2-a692-7633f3fd4cab)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:35 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e8d392b5-8485-42ea-8360-f480ee8e3a26 tempest-GroupsTest-1286922955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab2140cf-807e-4a40-82ae-25da7e694758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:35 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e8d392b5-8485-42ea-8360-f480ee8e3a26 tempest-GroupsTest-1286922955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ab2140cf-807e-4a40-82ae-25da7e694758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:35 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e8d392b5-8485-42ea-8360-f480ee8e3a26 tempest-GroupsTest-1286922955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f334fee9-1697-4f79-98ee-29e5c4f995a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:35 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e8d392b5-8485-42ea-8360-f480ee8e3a26 tempest-GroupsTest-1286922955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f334fee9-1697-4f79-98ee-29e5c4f995a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90eb88dd-ebb8-47bd-b77d-1842c745129f', 'volume_name': 'volume-90eb88dd-ebb8-47bd-b77d-1842c745129f', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:35 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e8d392b5-8485-42ea-8360-f480ee8e3a26 tempest-GroupsTest-1286922955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e1d71ea-982f-413e-9b75-1eed8216e5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:35 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e8d392b5-8485-42ea-8360-f480ee8e3a26 tempest-GroupsTest-1286922955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9e1d71ea-982f-413e-9b75-1eed8216e5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:35 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e8d392b5-8485-42ea-8360-f480ee8e3a26 tempest-GroupsTest-1286922955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b963f261-1cb6-4bfc-917b-d3d3759c783a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:35 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-e8d392b5-8485-42ea-8360-f480ee8e3a26 tempest-GroupsTest-1286922955 None] Volume 90eb88dd-ebb8-47bd-b77d-1842c745129f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90eb88dd-ebb8-47bd-b77d-1842c745129f', 'volume_size': 1} Nov 01 12:22:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e8d392b5-8485-42ea-8360-f480ee8e3a26 tempest-GroupsTest-1286922955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:22:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e8d392b5-8485-42ea-8360-f480ee8e3a26 tempest-GroupsTest-1286922955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:22:35 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e8d392b5-8485-42ea-8360-f480ee8e3a26 tempest-GroupsTest-1286922955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=61a9d3ed-0fca-446a-aeea-3ee2599ef309,created_at=2026-11-01T11:22:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-167210725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=61a9d3ed-0fca-446a-aeea-3ee2599ef309,host='devstack@QuobyteHD#QuobyteHD',id=90eb88dd-ebb8-47bd-b77d-1842c745129f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bbdc19d56364c5cbe7f2c979710e174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:22:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:22:36Z,use_quota=True,user_id='15a6bbdf1d0d4d71965212d053faa50f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0033ac28-d2a4-4fc2-a692-7633f3fd4cab),volume_type_id=0033ac28-d2a4-4fc2-a692-7633f3fd4cab)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:22:35 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-e8d392b5-8485-42ea-8360-f480ee8e3a26 tempest-GroupsTest-1286922955 None] Creating volume 90eb88dd-ebb8-47bd-b77d-1842c745129f {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:22:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e8d392b5-8485-42ea-8360-f480ee8e3a26 tempest-GroupsTest-1286922955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:22:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e8d392b5-8485-42ea-8360-f480ee8e3a26 tempest-GroupsTest-1286922955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:22:35 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e8d392b5-8485-42ea-8360-f480ee8e3a26 tempest-GroupsTest-1286922955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:22:35 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e8d392b5-8485-42ea-8360-f480ee8e3a26 tempest-GroupsTest-1286922955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:22:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e8d392b5-8485-42ea-8360-f480ee8e3a26 tempest-GroupsTest-1286922955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:22:35 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e8d392b5-8485-42ea-8360-f480ee8e3a26 tempest-GroupsTest-1286922955 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:22:35 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-e8d392b5-8485-42ea-8360-f480ee8e3a26 tempest-GroupsTest-1286922955 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:22:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e8d392b5-8485-42ea-8360-f480ee8e3a26 tempest-GroupsTest-1286922955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-90eb88dd-ebb8-47bd-b77d-1842c745129f 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:36 devstack sudo[90526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-90eb88dd-ebb8-47bd-b77d-1842c745129f 1073741824 Nov 01 12:22:36 devstack sudo[90526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:36 devstack sudo[90526]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e8d392b5-8485-42ea-8360-f480ee8e3a26 tempest-GroupsTest-1286922955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-90eb88dd-ebb8-47bd-b77d-1842c745129f 1073741824" returned: 0 in 0.576s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e8d392b5-8485-42ea-8360-f480ee8e3a26 tempest-GroupsTest-1286922955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-90eb88dd-ebb8-47bd-b77d-1842c745129f {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:36 devstack sudo[90538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-90eb88dd-ebb8-47bd-b77d-1842c745129f Nov 01 12:22:36 devstack sudo[90538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:36 devstack sudo[90538]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e8d392b5-8485-42ea-8360-f480ee8e3a26 tempest-GroupsTest-1286922955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-90eb88dd-ebb8-47bd-b77d-1842c745129f" returned: 0 in 0.273s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:36 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e8d392b5-8485-42ea-8360-f480ee8e3a26 tempest-GroupsTest-1286922955 None] <== create_volume: return (966ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:22:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e8d392b5-8485-42ea-8360-f480ee8e3a26 tempest-GroupsTest-1286922955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.973s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:22:36 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e8d392b5-8485-42ea-8360-f480ee8e3a26 tempest-GroupsTest-1286922955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b963f261-1cb6-4bfc-917b-d3d3759c783a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90eb88dd-ebb8-47bd-b77d-1842c745129f', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:37 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e8d392b5-8485-42ea-8360-f480ee8e3a26 tempest-GroupsTest-1286922955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38e41562-9aa3-41ec-b6de-fe21608f04f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:37 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-e8d392b5-8485-42ea-8360-f480ee8e3a26 tempest-GroupsTest-1286922955 None] Volume volume-90eb88dd-ebb8-47bd-b77d-1842c745129f (90eb88dd-ebb8-47bd-b77d-1842c745129f): created successfully Nov 01 12:22:37 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e8d392b5-8485-42ea-8360-f480ee8e3a26 tempest-GroupsTest-1286922955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (38e41562-9aa3-41ec-b6de-fe21608f04f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:37 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e8d392b5-8485-42ea-8360-f480ee8e3a26 tempest-GroupsTest-1286922955 None] Flow 'volume_create_manager' (2b46b640-912d-443d-9d5d-b120d416bf31) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:22:37 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-e8d392b5-8485-42ea-8360-f480ee8e3a26 tempest-GroupsTest-1286922955 None] Created volume successfully. Nov 01 12:22:39 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-f18936f0-6d3c-4104-b043-f80d8109ba16 tempest-GroupsTest-1286922955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:22:39 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f18936f0-6d3c-4104-b043-f80d8109ba16 tempest-GroupsTest-1286922955 None] Flow 'volume_create_manager' (57c0d795-de12-444c-a83d-ae2d09a9a6ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:22:39 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f18936f0-6d3c-4104-b043-f80d8109ba16 tempest-GroupsTest-1286922955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13e2b913-63e5-41eb-9911-f92ea97c5746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:39 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f18936f0-6d3c-4104-b043-f80d8109ba16 tempest-GroupsTest-1286922955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (13e2b913-63e5-41eb-9911-f92ea97c5746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1042343312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=61a9d3ed-0fca-446a-aeea-3ee2599ef309,host='devstack@QuobyteHD#QuobyteHD',id=7373976a-def5-4cb8-acc4-1a48f8464785,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bbdc19d56364c5cbe7f2c979710e174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:22:40Z,use_quota=True,user_id='15a6bbdf1d0d4d71965212d053faa50f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0033ac28-d2a4-4fc2-a692-7633f3fd4cab),volume_type_id=0033ac28-d2a4-4fc2-a692-7633f3fd4cab)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:39 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f18936f0-6d3c-4104-b043-f80d8109ba16 tempest-GroupsTest-1286922955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c8a2a0a-2429-4d43-b534-9472c6f07f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:39 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f18936f0-6d3c-4104-b043-f80d8109ba16 tempest-GroupsTest-1286922955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c8a2a0a-2429-4d43-b534-9472c6f07f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:39 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f18936f0-6d3c-4104-b043-f80d8109ba16 tempest-GroupsTest-1286922955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8c276c3-6c8e-41e4-8727-e5b08f7455eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:39 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f18936f0-6d3c-4104-b043-f80d8109ba16 tempest-GroupsTest-1286922955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f8c276c3-6c8e-41e4-8727-e5b08f7455eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7373976a-def5-4cb8-acc4-1a48f8464785', 'volume_name': 'volume-7373976a-def5-4cb8-acc4-1a48f8464785', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:39 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f18936f0-6d3c-4104-b043-f80d8109ba16 tempest-GroupsTest-1286922955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffc351db-1da3-4a52-ab06-84164be363c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:39 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f18936f0-6d3c-4104-b043-f80d8109ba16 tempest-GroupsTest-1286922955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffc351db-1da3-4a52-ab06-84164be363c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:39 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f18936f0-6d3c-4104-b043-f80d8109ba16 tempest-GroupsTest-1286922955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6708204e-8884-4b88-9fea-7278554926cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:39 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-f18936f0-6d3c-4104-b043-f80d8109ba16 tempest-GroupsTest-1286922955 None] Volume 7373976a-def5-4cb8-acc4-1a48f8464785: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7373976a-def5-4cb8-acc4-1a48f8464785', 'volume_size': 1} Nov 01 12:22:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f18936f0-6d3c-4104-b043-f80d8109ba16 tempest-GroupsTest-1286922955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:22:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f18936f0-6d3c-4104-b043-f80d8109ba16 tempest-GroupsTest-1286922955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:22:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f18936f0-6d3c-4104-b043-f80d8109ba16 tempest-GroupsTest-1286922955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=61a9d3ed-0fca-446a-aeea-3ee2599ef309,created_at=2026-11-01T11:22:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1042343312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=61a9d3ed-0fca-446a-aeea-3ee2599ef309,host='devstack@QuobyteHD#QuobyteHD',id=7373976a-def5-4cb8-acc4-1a48f8464785,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6bbdc19d56364c5cbe7f2c979710e174',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:22:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:22:40Z,use_quota=True,user_id='15a6bbdf1d0d4d71965212d053faa50f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(0033ac28-d2a4-4fc2-a692-7633f3fd4cab),volume_type_id=0033ac28-d2a4-4fc2-a692-7633f3fd4cab)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:22:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-f18936f0-6d3c-4104-b043-f80d8109ba16 tempest-GroupsTest-1286922955 None] Creating volume 7373976a-def5-4cb8-acc4-1a48f8464785 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:22:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f18936f0-6d3c-4104-b043-f80d8109ba16 tempest-GroupsTest-1286922955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:22:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f18936f0-6d3c-4104-b043-f80d8109ba16 tempest-GroupsTest-1286922955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:22:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f18936f0-6d3c-4104-b043-f80d8109ba16 tempest-GroupsTest-1286922955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:22:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f18936f0-6d3c-4104-b043-f80d8109ba16 tempest-GroupsTest-1286922955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:22:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f18936f0-6d3c-4104-b043-f80d8109ba16 tempest-GroupsTest-1286922955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:22:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f18936f0-6d3c-4104-b043-f80d8109ba16 tempest-GroupsTest-1286922955 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:22:39 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-f18936f0-6d3c-4104-b043-f80d8109ba16 tempest-GroupsTest-1286922955 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:22:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f18936f0-6d3c-4104-b043-f80d8109ba16 tempest-GroupsTest-1286922955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7373976a-def5-4cb8-acc4-1a48f8464785 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:39 devstack sudo[90575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7373976a-def5-4cb8-acc4-1a48f8464785 1073741824 Nov 01 12:22:39 devstack sudo[90575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:39 devstack cinder-volume[86574]: DEBUG oslo_service.periodic_task [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86574) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:22:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:22:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:22:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:22:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:22:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:22:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:39 devstack sudo[90577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:22:39 devstack sudo[90577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:40 devstack sudo[90577]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.512s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:40 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:22:40 devstack cinder-volume[86574]: DEBUG oslo_service.periodic_task [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running periodic task VolumeManager._thread_info {{(pid=86574) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:22:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] thread count: 8 {{(pid=86574) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 12:22:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] thread info: [<_MainThread(MainThread, started 131331184930944)>, , , , , , , ] {{(pid=86574) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 12:22:40 devstack sudo[90575]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f18936f0-6d3c-4104-b043-f80d8109ba16 tempest-GroupsTest-1286922955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7373976a-def5-4cb8-acc4-1a48f8464785 1073741824" returned: 0 in 0.637s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f18936f0-6d3c-4104-b043-f80d8109ba16 tempest-GroupsTest-1286922955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7373976a-def5-4cb8-acc4-1a48f8464785 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:40 devstack sudo[90585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7373976a-def5-4cb8-acc4-1a48f8464785 Nov 01 12:22:40 devstack sudo[90585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:40 devstack sudo[90585]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f18936f0-6d3c-4104-b043-f80d8109ba16 tempest-GroupsTest-1286922955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7373976a-def5-4cb8-acc4-1a48f8464785" returned: 0 in 0.361s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:40 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f18936f0-6d3c-4104-b043-f80d8109ba16 tempest-GroupsTest-1286922955 None] <== create_volume: return (1051ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:22:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f18936f0-6d3c-4104-b043-f80d8109ba16 tempest-GroupsTest-1286922955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:22:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f18936f0-6d3c-4104-b043-f80d8109ba16 tempest-GroupsTest-1286922955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6708204e-8884-4b88-9fea-7278554926cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7373976a-def5-4cb8-acc4-1a48f8464785', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f18936f0-6d3c-4104-b043-f80d8109ba16 tempest-GroupsTest-1286922955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aac43e7-fb84-4543-bccc-af6c0cfb01e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:22:40 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-f18936f0-6d3c-4104-b043-f80d8109ba16 tempest-GroupsTest-1286922955 None] Volume volume-7373976a-def5-4cb8-acc4-1a48f8464785 (7373976a-def5-4cb8-acc4-1a48f8464785): created successfully Nov 01 12:22:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f18936f0-6d3c-4104-b043-f80d8109ba16 tempest-GroupsTest-1286922955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5aac43e7-fb84-4543-bccc-af6c0cfb01e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:22:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f18936f0-6d3c-4104-b043-f80d8109ba16 tempest-GroupsTest-1286922955 None] Flow 'volume_create_manager' (57c0d795-de12-444c-a83d-ae2d09a9a6ea) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:22:40 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-f18936f0-6d3c-4104-b043-f80d8109ba16 tempest-GroupsTest-1286922955 None] Created volume successfully. Nov 01 12:22:42 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-f62af797-fd54-40d3-b205-c3f6d0afe916 tempest-GroupsTest-1286922955 None] Update group completed successfully. Nov 01 12:22:44 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-516638ff-7fb2-40c8-87d2-dbcf660cca4c tempest-GroupsTest-1286922955 None] Update group completed successfully. Nov 01 12:22:45 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a286c2bc-b470-49ab-aa8d-1b68540f5a39 tempest-TaggedAttachmentsTest-66506181 None] Acquiring lock "cinder-0beaf06f-3f52-45dd-bcb0-32df856a87dc-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:22:45 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a286c2bc-b470-49ab-aa8d-1b68540f5a39 tempest-TaggedAttachmentsTest-66506181 None] Lock "cinder-0beaf06f-3f52-45dd-bcb0-32df856a87dc-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:22:45 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a286c2bc-b470-49ab-aa8d-1b68540f5a39 tempest-TaggedAttachmentsTest-66506181 None] Acquiring lock "cinder-quobyte-0beaf06f-3f52-45dd-bcb0-32df856a87dc" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:22:45 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a286c2bc-b470-49ab-aa8d-1b68540f5a39 tempest-TaggedAttachmentsTest-66506181 None] Lock "cinder-quobyte-0beaf06f-3f52-45dd-bcb0-32df856a87dc" acquired by "delete_volume" :: waited 0.036s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:22:45 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a0037b-18b0-4029-a872-4504e2b08854]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:22:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a286c2bc-b470-49ab-aa8d-1b68540f5a39 tempest-TaggedAttachmentsTest-66506181 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0beaf06f-3f52-45dd-bcb0-32df856a87dc {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:46 devstack sudo[90593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0beaf06f-3f52-45dd-bcb0-32df856a87dc Nov 01 12:22:46 devstack sudo[90593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:46 devstack sudo[90593]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a286c2bc-b470-49ab-aa8d-1b68540f5a39 tempest-TaggedAttachmentsTest-66506181 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0beaf06f-3f52-45dd-bcb0-32df856a87dc" returned: 0 in 0.580s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a286c2bc-b470-49ab-aa8d-1b68540f5a39 tempest-TaggedAttachmentsTest-66506181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0beaf06f-3f52-45dd-bcb0-32df856a87dc {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:46 devstack sudo[90599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0beaf06f-3f52-45dd-bcb0-32df856a87dc Nov 01 12:22:46 devstack sudo[90599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:46 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a1add9df-b261-4bcc-8363-f0fa9cd48cfb tempest-GroupsTest-1286922955 None] Acquiring lock "cinder-quobyte-7373976a-def5-4cb8-acc4-1a48f8464785" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:22:46 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a1add9df-b261-4bcc-8363-f0fa9cd48cfb tempest-GroupsTest-1286922955 None] Lock "cinder-quobyte-7373976a-def5-4cb8-acc4-1a48f8464785" acquired by "delete_volume" :: waited 0.019s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:22:46 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[b90c0aae-170e-4ff9-910e-96d928357e55]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:22:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a1add9df-b261-4bcc-8363-f0fa9cd48cfb tempest-GroupsTest-1286922955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7373976a-def5-4cb8-acc4-1a48f8464785 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:46 devstack sudo[90601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7373976a-def5-4cb8-acc4-1a48f8464785 Nov 01 12:22:46 devstack sudo[90601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:46 devstack sudo[90599]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a286c2bc-b470-49ab-aa8d-1b68540f5a39 tempest-TaggedAttachmentsTest-66506181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0beaf06f-3f52-45dd-bcb0-32df856a87dc" returned: 0 in 0.429s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:46 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a286c2bc-b470-49ab-aa8d-1b68540f5a39 tempest-TaggedAttachmentsTest-66506181 None] Lock "cinder-quobyte-0beaf06f-3f52-45dd-bcb0-32df856a87dc" released by "delete_volume" :: held 1.084s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:22:46 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-a286c2bc-b470-49ab-aa8d-1b68540f5a39 tempest-TaggedAttachmentsTest-66506181 None] Created reservations ['6658e3cb-25f4-42f2-ad5d-d2976335d187', '0d8681fd-a84f-46ce-965b-5d341c058108', '38243c30-1655-4d61-83fa-b6765cbe86b3', '8d1a5c7b-39a9-4d10-8ced-7f34c07bd5ff'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:22:47 devstack sudo[90601]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a286c2bc-b470-49ab-aa8d-1b68540f5a39 tempest-TaggedAttachmentsTest-66506181 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:22:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a286c2bc-b470-49ab-aa8d-1b68540f5a39 tempest-TaggedAttachmentsTest-66506181 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:22:47 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a286c2bc-b470-49ab-aa8d-1b68540f5a39 tempest-TaggedAttachmentsTest-66506181 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:22:47 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a286c2bc-b470-49ab-aa8d-1b68540f5a39 tempest-TaggedAttachmentsTest-66506181 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:22:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a286c2bc-b470-49ab-aa8d-1b68540f5a39 tempest-TaggedAttachmentsTest-66506181 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:22:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a286c2bc-b470-49ab-aa8d-1b68540f5a39 tempest-TaggedAttachmentsTest-66506181 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a1add9df-b261-4bcc-8363-f0fa9cd48cfb tempest-GroupsTest-1286922955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7373976a-def5-4cb8-acc4-1a48f8464785" returned: 0 in 0.451s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a1add9df-b261-4bcc-8363-f0fa9cd48cfb tempest-GroupsTest-1286922955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7373976a-def5-4cb8-acc4-1a48f8464785 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:47 devstack sudo[90608]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:22:47 devstack sudo[90608]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:47 devstack sudo[90609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7373976a-def5-4cb8-acc4-1a48f8464785 Nov 01 12:22:47 devstack sudo[90609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:47 devstack sudo[90608]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a286c2bc-b470-49ab-aa8d-1b68540f5a39 tempest-TaggedAttachmentsTest-66506181 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.315s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:47 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-a286c2bc-b470-49ab-aa8d-1b68540f5a39 tempest-TaggedAttachmentsTest-66506181 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:22:47 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-a286c2bc-b470-49ab-aa8d-1b68540f5a39 tempest-TaggedAttachmentsTest-66506181 None] Deleted volume successfully. Nov 01 12:22:47 devstack sudo[90609]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a1add9df-b261-4bcc-8363-f0fa9cd48cfb tempest-GroupsTest-1286922955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7373976a-def5-4cb8-acc4-1a48f8464785" returned: 0 in 0.327s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:47 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a1add9df-b261-4bcc-8363-f0fa9cd48cfb tempest-GroupsTest-1286922955 None] Lock "cinder-quobyte-7373976a-def5-4cb8-acc4-1a48f8464785" released by "delete_volume" :: held 0.857s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:22:47 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a1add9df-b261-4bcc-8363-f0fa9cd48cfb tempest-GroupsTest-1286922955 None] Acquiring lock "cinder-quobyte-90eb88dd-ebb8-47bd-b77d-1842c745129f" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:22:47 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a286c2bc-b470-49ab-aa8d-1b68540f5a39 tempest-TaggedAttachmentsTest-66506181 None] Lock "cinder-0beaf06f-3f52-45dd-bcb0-32df856a87dc-delete_volume" released by "delete_volume" :: held 1.765s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:22:47 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a1add9df-b261-4bcc-8363-f0fa9cd48cfb tempest-GroupsTest-1286922955 None] Lock "cinder-quobyte-90eb88dd-ebb8-47bd-b77d-1842c745129f" acquired by "delete_volume" :: waited 0.023s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:22:47 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc5560f8-faa6-4601-b6d2-7fa3b80d42be]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:22:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a1add9df-b261-4bcc-8363-f0fa9cd48cfb tempest-GroupsTest-1286922955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-90eb88dd-ebb8-47bd-b77d-1842c745129f {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:47 devstack sudo[90615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-90eb88dd-ebb8-47bd-b77d-1842c745129f Nov 01 12:22:47 devstack sudo[90615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:47 devstack sudo[90615]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a1add9df-b261-4bcc-8363-f0fa9cd48cfb tempest-GroupsTest-1286922955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-90eb88dd-ebb8-47bd-b77d-1842c745129f" returned: 0 in 0.396s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a1add9df-b261-4bcc-8363-f0fa9cd48cfb tempest-GroupsTest-1286922955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-90eb88dd-ebb8-47bd-b77d-1842c745129f {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:47 devstack sudo[90621]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-90eb88dd-ebb8-47bd-b77d-1842c745129f Nov 01 12:22:47 devstack sudo[90621]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:48 devstack sudo[90621]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a1add9df-b261-4bcc-8363-f0fa9cd48cfb tempest-GroupsTest-1286922955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-90eb88dd-ebb8-47bd-b77d-1842c745129f" returned: 0 in 0.338s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:48 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a1add9df-b261-4bcc-8363-f0fa9cd48cfb tempest-GroupsTest-1286922955 None] Lock "cinder-quobyte-90eb88dd-ebb8-47bd-b77d-1842c745129f" released by "delete_volume" :: held 0.789s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:22:48 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-a1add9df-b261-4bcc-8363-f0fa9cd48cfb tempest-GroupsTest-1286922955 None] Created reservations ['02ebbf25-5714-4a4f-bfed-32f10bca5efb'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:22:48 devstack cinder-volume[86574]: WARNING cinder.quota [None req-a1add9df-b261-4bcc-8363-f0fa9cd48cfb tempest-GroupsTest-1286922955 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1533455787 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1533455787, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:22:48 devstack cinder-volume[86574]: WARNING cinder.quota [None req-a1add9df-b261-4bcc-8363-f0fa9cd48cfb tempest-GroupsTest-1286922955 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1533455787 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1533455787, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:22:48 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-a1add9df-b261-4bcc-8363-f0fa9cd48cfb tempest-GroupsTest-1286922955 None] Created reservations ['d4d8f5f5-fd7e-405e-a512-d1f62fd189ac', '0d7037b9-2697-43e8-a804-6d9042efb8fa', '52caf463-848f-4338-b421-45692cdfd257', '67ac00f7-757f-4cd6-b56a-9bfcbe7e349d'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:22:48 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-a1add9df-b261-4bcc-8363-f0fa9cd48cfb tempest-GroupsTest-1286922955 None] Created reservations ['f2f68993-ce33-4a0a-b229-d3a4b4666665', '97144e41-a573-416b-85dc-a882aa8b10c8', '8bd82eee-1081-4cf7-a6d3-b3d81dcac27c', 'e8ba0bf1-0f24-4098-8a51-0cd550b9ed20'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:22:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a1add9df-b261-4bcc-8363-f0fa9cd48cfb tempest-GroupsTest-1286922955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:22:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a1add9df-b261-4bcc-8363-f0fa9cd48cfb tempest-GroupsTest-1286922955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:22:48 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a1add9df-b261-4bcc-8363-f0fa9cd48cfb tempest-GroupsTest-1286922955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:22:48 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a1add9df-b261-4bcc-8363-f0fa9cd48cfb tempest-GroupsTest-1286922955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:22:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a1add9df-b261-4bcc-8363-f0fa9cd48cfb tempest-GroupsTest-1286922955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:22:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a1add9df-b261-4bcc-8363-f0fa9cd48cfb tempest-GroupsTest-1286922955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:22:48 devstack sudo[90624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:22:48 devstack sudo[90624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:22:49 devstack sudo[90624]: pam_unix(sudo:session): session closed for user root Nov 01 12:22:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a1add9df-b261-4bcc-8363-f0fa9cd48cfb tempest-GroupsTest-1286922955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.387s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:22:49 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-a1add9df-b261-4bcc-8363-f0fa9cd48cfb tempest-GroupsTest-1286922955 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:22:49 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-a1add9df-b261-4bcc-8363-f0fa9cd48cfb tempest-GroupsTest-1286922955 None] Delete group completed successfully. Nov 01 12:22:58 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:SELECT=78,cinder:INSERT=16,cinder:UPDATE=76,cinder:DELETE=4 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:22:58 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:UPDATE=87,cinder:SELECT=74,cinder:DELETE=5,cinder:INSERT=17 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:23:01 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-8dd8c24f-cf2c-4b95-a024-c291a16a8124 req-2d0e0d6b-dd27-4b6b-8a90-413da30979d0 tempest-AttachVolumeTestJSON-2012429887 None] Terminate volume connection completed successfully. Nov 01 12:23:01 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-8dd8c24f-cf2c-4b95-a024-c291a16a8124 req-2d0e0d6b-dd27-4b6b-8a90-413da30979d0 tempest-AttachVolumeTestJSON-2012429887 None] Deleting attachment ac8c879e-3d36-4037-8c35-567f2fdf416f. {{(pid=86574) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 12:23:13 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-42a0ac40-4d18-40de-bf34-cf25e7106d29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:23:13 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-42a0ac40-4d18-40de-bf34-cf25e7106d29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Flow 'volume_create_manager' (4d2f0175-dcf3-40e5-a4cb-542d4ed6c972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:23:13 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-42a0ac40-4d18-40de-bf34-cf25e7106d29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac297d11-be08-4fd6-ba0c-bbfc5aa5d89b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:13 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-42a0ac40-4d18-40de-bf34-cf25e7106d29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ac297d11-be08-4fd6-ba0c-bbfc5aa5d89b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1628441286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c3ce1354e3c4dc9900fed51165cc44d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:23:13Z,use_quota=True,user_id='b60a4e6f640b44cfa3956efd1b8b3ce3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:13 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-42a0ac40-4d18-40de-bf34-cf25e7106d29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76a89d7b-e09a-4bc5-ac9a-4e8d5cdac6f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:13 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-42a0ac40-4d18-40de-bf34-cf25e7106d29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (76a89d7b-e09a-4bc5-ac9a-4e8d5cdac6f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:13 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-42a0ac40-4d18-40de-bf34-cf25e7106d29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9f68acb-01d7-4a17-9a2d-f2f90be0ad66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:13 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-42a0ac40-4d18-40de-bf34-cf25e7106d29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9f68acb-01d7-4a17-9a2d-f2f90be0ad66) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd8eb6c3b-c3a9-46dc-9fd6-9b734845a78d', 'volume_name': 'volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:13 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-42a0ac40-4d18-40de-bf34-cf25e7106d29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bcd2857-3820-4c5b-96af-62a3c815328d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:13 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-42a0ac40-4d18-40de-bf34-cf25e7106d29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7bcd2857-3820-4c5b-96af-62a3c815328d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:13 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-42a0ac40-4d18-40de-bf34-cf25e7106d29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a99a5cb6-3c6c-4a38-a771-2b9903003b71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:13 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-42a0ac40-4d18-40de-bf34-cf25e7106d29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Volume d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d', 'volume_size': 1} Nov 01 12:23:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-42a0ac40-4d18-40de-bf34-cf25e7106d29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:23:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-42a0ac40-4d18-40de-bf34-cf25e7106d29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:23:13 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-42a0ac40-4d18-40de-bf34-cf25e7106d29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:23:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-1628441286',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9c3ce1354e3c4dc9900fed51165cc44d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:23:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:23:13Z,use_quota=True,user_id='b60a4e6f640b44cfa3956efd1b8b3ce3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:23:13 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-42a0ac40-4d18-40de-bf34-cf25e7106d29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Creating volume d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:23:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-42a0ac40-4d18-40de-bf34-cf25e7106d29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:23:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-42a0ac40-4d18-40de-bf34-cf25e7106d29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:23:13 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-42a0ac40-4d18-40de-bf34-cf25e7106d29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:23:13 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-42a0ac40-4d18-40de-bf34-cf25e7106d29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:23:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-42a0ac40-4d18-40de-bf34-cf25e7106d29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:23:13 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-42a0ac40-4d18-40de-bf34-cf25e7106d29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:23:13 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-42a0ac40-4d18-40de-bf34-cf25e7106d29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:23:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-42a0ac40-4d18-40de-bf34-cf25e7106d29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:13 devstack sudo[90869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d 1073741824 Nov 01 12:23:13 devstack sudo[90869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:14 devstack sudo[90869]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:14 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-42a0ac40-4d18-40de-bf34-cf25e7106d29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d 1073741824" returned: 0 in 0.972s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:14 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-42a0ac40-4d18-40de-bf34-cf25e7106d29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:14 devstack sudo[90887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d Nov 01 12:23:14 devstack sudo[90887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:14 devstack sudo[90887]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:14 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-42a0ac40-4d18-40de-bf34-cf25e7106d29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d" returned: 0 in 0.314s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:14 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-42a0ac40-4d18-40de-bf34-cf25e7106d29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] <== create_volume: return (1364ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:23:14 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-42a0ac40-4d18-40de-bf34-cf25e7106d29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.369s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:23:14 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-42a0ac40-4d18-40de-bf34-cf25e7106d29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a99a5cb6-3c6c-4a38-a771-2b9903003b71) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:14 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-42a0ac40-4d18-40de-bf34-cf25e7106d29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fd60167-fa9a-46bf-b803-8693057e5335) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:14 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-42a0ac40-4d18-40de-bf34-cf25e7106d29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Volume volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d (d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d): created successfully Nov 01 12:23:14 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-42a0ac40-4d18-40de-bf34-cf25e7106d29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5fd60167-fa9a-46bf-b803-8693057e5335) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:14 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-42a0ac40-4d18-40de-bf34-cf25e7106d29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Flow 'volume_create_manager' (4d2f0175-dcf3-40e5-a4cb-542d4ed6c972) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:23:15 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-42a0ac40-4d18-40de-bf34-cf25e7106d29 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Created volume successfully. Nov 01 12:23:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-69983560-9c55-4c27-b74b-949f500cf9f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:23:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-69983560-9c55-4c27-b74b-949f500cf9f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:23:15 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-69983560-9c55-4c27-b74b-949f500cf9f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Creating offline snapshot 84898058-530e-404f-9b28-a40318108945 of volume d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d {{(pid=86574) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:23:15 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[af073768-0ba7-4a6a-808e-b9d89d95e473]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:23:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-69983560-9c55-4c27-b74b-949f500cf9f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:15 devstack sudo[90893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d Nov 01 12:23:15 devstack sudo[90893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:16 devstack sudo[90893]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:16 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-69983560-9c55-4c27-b74b-949f500cf9f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d" returned: 0 in 0.813s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:16 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-69983560-9c55-4c27-b74b-949f500cf9f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d.84898058-530e-404f-9b28-a40318108945 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:16 devstack sudo[90899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d.84898058-530e-404f-9b28-a40318108945 1G Nov 01 12:23:16 devstack sudo[90899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:17 devstack sudo[90899]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:17 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-69983560-9c55-4c27-b74b-949f500cf9f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d.84898058-530e-404f-9b28-a40318108945 1G" returned: 0 in 0.991s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:17 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-69983560-9c55-4c27-b74b-949f500cf9f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d.84898058-530e-404f-9b28-a40318108945 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:17 devstack sudo[90905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d.84898058-530e-404f-9b28-a40318108945 Nov 01 12:23:17 devstack sudo[90905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:18 devstack sudo[90905]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:18 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-69983560-9c55-4c27-b74b-949f500cf9f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d.84898058-530e-404f-9b28-a40318108945" returned: 0 in 0.598s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:18 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-69983560-9c55-4c27-b74b-949f500cf9f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d.84898058-530e-404f-9b28-a40318108945 is being set with open permissions: ugo+rw Nov 01 12:23:18 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-69983560-9c55-4c27-b74b-949f500cf9f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d.84898058-530e-404f-9b28-a40318108945 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:18 devstack sudo[90910]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d.84898058-530e-404f-9b28-a40318108945 Nov 01 12:23:18 devstack sudo[90910]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:18 devstack sudo[90910]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:18 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-69983560-9c55-4c27-b74b-949f500cf9f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d.84898058-530e-404f-9b28-a40318108945" returned: 0 in 0.682s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:18 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-69983560-9c55-4c27-b74b-949f500cf9f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:18 devstack sudo[90914]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d.info Nov 01 12:23:18 devstack sudo[90914]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:19 devstack sudo[90914]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:19 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-69983560-9c55-4c27-b74b-949f500cf9f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d.info" returned: 0 in 0.429s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:19 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-69983560-9c55-4c27-b74b-949f500cf9f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d.info is being set with open permissions: ugo+rw Nov 01 12:23:19 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-69983560-9c55-4c27-b74b-949f500cf9f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:19 devstack sudo[90917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d.info Nov 01 12:23:19 devstack sudo[90917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:19 devstack sudo[90917]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:19 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-69983560-9c55-4c27-b74b-949f500cf9f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d.info" returned: 0 in 0.496s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:19 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-69983560-9c55-4c27-b74b-949f500cf9f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.197s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:23:19 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-69983560-9c55-4c27-b74b-949f500cf9f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Create snapshot completed successfully Nov 01 12:23:22 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-2afb72ff-daab-4db1-ae62-5814cda8ed12 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Acquiring lock "cinder-84898058-530e-404f-9b28-a40318108945-delete_snapshot" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:23:22 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-2afb72ff-daab-4db1-ae62-5814cda8ed12 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Lock "cinder-84898058-530e-404f-9b28-a40318108945-delete_snapshot" acquired by "delete_snapshot" :: waited 0.064s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:23:22 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-2afb72ff-daab-4db1-ae62-5814cda8ed12 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Acquiring lock "cinder-quobyte-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:23:22 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-2afb72ff-daab-4db1-ae62-5814cda8ed12 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Lock "cinder-quobyte-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:23:22 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-2afb72ff-daab-4db1-ae62-5814cda8ed12 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Acquiring lock "cinder-quobyte-84898058-530e-404f-9b28-a40318108945" by "_delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:23:22 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-2afb72ff-daab-4db1-ae62-5814cda8ed12 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Lock "cinder-quobyte-84898058-530e-404f-9b28-a40318108945" acquired by "_delete_snapshot" :: waited 0.045s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:23:22 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-2afb72ff-daab-4db1-ae62-5814cda8ed12 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Deleting offline snapshot 84898058-530e-404f-9b28-a40318108945 of volume d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:23:22 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-2afb72ff-daab-4db1-ae62-5814cda8ed12 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] snapshot_file for this snap is: volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d.84898058-530e-404f-9b28-a40318108945 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:23:22 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[6e2bc5a3-9790-46f2-a007-b6bc4f481db6]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:23:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2afb72ff-daab-4db1-ae62-5814cda8ed12 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d.84898058-530e-404f-9b28-a40318108945 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:22 devstack sudo[90923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d.84898058-530e-404f-9b28-a40318108945 Nov 01 12:23:22 devstack sudo[90923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:23 devstack sudo[90923]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2afb72ff-daab-4db1-ae62-5814cda8ed12 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d.84898058-530e-404f-9b28-a40318108945" returned: 0 in 0.803s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:23 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-2afb72ff-daab-4db1-ae62-5814cda8ed12 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:23:23 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[f48c787e-10db-40f2-b69f-8b0918636142]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:23:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2afb72ff-daab-4db1-ae62-5814cda8ed12 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:23 devstack sudo[90938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d Nov 01 12:23:23 devstack sudo[90938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:23 devstack sudo[90938]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2afb72ff-daab-4db1-ae62-5814cda8ed12 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d" returned: 0 in 0.569s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2afb72ff-daab-4db1-ae62-5814cda8ed12 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d.84898058-530e-404f-9b28-a40318108945 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:23 devstack sudo[90943]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d.84898058-530e-404f-9b28-a40318108945 Nov 01 12:23:23 devstack sudo[90943]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:24 devstack sudo[90943]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2afb72ff-daab-4db1-ae62-5814cda8ed12 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d.84898058-530e-404f-9b28-a40318108945" returned: 0 in 0.334s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2afb72ff-daab-4db1-ae62-5814cda8ed12 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d.84898058-530e-404f-9b28-a40318108945 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:24 devstack sudo[90949]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d.84898058-530e-404f-9b28-a40318108945 Nov 01 12:23:24 devstack sudo[90949]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:24 devstack sudo[90949]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2afb72ff-daab-4db1-ae62-5814cda8ed12 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d.84898058-530e-404f-9b28-a40318108945" returned: 0 in 0.297s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:24 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-2afb72ff-daab-4db1-ae62-5814cda8ed12 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Lock "cinder-quobyte-84898058-530e-404f-9b28-a40318108945" released by "_delete_snapshot" :: held 2.184s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:23:24 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-2afb72ff-daab-4db1-ae62-5814cda8ed12 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Lock "cinder-quobyte-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d" released by "delete_snapshot" :: held 2.238s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:23:24 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-2afb72ff-daab-4db1-ae62-5814cda8ed12 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Created reservations ['3e643933-0e95-49a9-9d8a-e203334f4634', 'cc7fd676-d625-41d9-98c5-72769cdeb4f3', '9edc4847-3f5b-45ed-bb3c-c40b3fed22c2', '5d546a72-9b7e-4bbe-94a1-1056e65c506d'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:23:24 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-2afb72ff-daab-4db1-ae62-5814cda8ed12 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Delete snapshot completed successfully. Nov 01 12:23:24 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-2afb72ff-daab-4db1-ae62-5814cda8ed12 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Lock "cinder-84898058-530e-404f-9b28-a40318108945-delete_snapshot" released by "delete_snapshot" :: held 2.408s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:23:25 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-689cd3ba-4d84-4934-94ee-d9226046e7e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Acquiring lock "cinder-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:23:25 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-689cd3ba-4d84-4934-94ee-d9226046e7e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Lock "cinder-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:23:25 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-689cd3ba-4d84-4934-94ee-d9226046e7e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Acquiring lock "cinder-quobyte-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:23:25 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-689cd3ba-4d84-4934-94ee-d9226046e7e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Lock "cinder-quobyte-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d" acquired by "delete_volume" :: waited 0.021s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:23:25 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[e356a369-439c-4683-8f09-0906523ecf17]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:23:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-689cd3ba-4d84-4934-94ee-d9226046e7e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:25 devstack sudo[90952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d Nov 01 12:23:25 devstack sudo[90952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:26 devstack sudo[90952]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-689cd3ba-4d84-4934-94ee-d9226046e7e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d" returned: 0 in 0.399s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-689cd3ba-4d84-4934-94ee-d9226046e7e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:26 devstack sudo[90957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d Nov 01 12:23:26 devstack sudo[90957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:26 devstack sudo[90957]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-689cd3ba-4d84-4934-94ee-d9226046e7e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d" returned: 0 in 0.268s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:26 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-689cd3ba-4d84-4934-94ee-d9226046e7e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Lock "cinder-quobyte-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d" released by "delete_volume" :: held 0.740s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:23:26 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-689cd3ba-4d84-4934-94ee-d9226046e7e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Created reservations ['5e3026bc-9ed9-47d7-ba75-3fd825a12269', '11a5b844-6ee7-45f3-b580-b871e5606b26', '8ce18b9b-d6cd-4cb4-bef7-0b58c6edf68d', '392ce9b2-4988-434c-9c03-eaa8127ceae3'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:23:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-689cd3ba-4d84-4934-94ee-d9226046e7e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:23:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-689cd3ba-4d84-4934-94ee-d9226046e7e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:23:26 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-689cd3ba-4d84-4934-94ee-d9226046e7e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:23:26 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-689cd3ba-4d84-4934-94ee-d9226046e7e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:23:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-689cd3ba-4d84-4934-94ee-d9226046e7e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:23:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-689cd3ba-4d84-4934-94ee-d9226046e7e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:26 devstack sudo[90960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:23:26 devstack sudo[90960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:26 devstack sudo[90960]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-689cd3ba-4d84-4934-94ee-d9226046e7e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.342s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:26 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-689cd3ba-4d84-4934-94ee-d9226046e7e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:23:26 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-689cd3ba-4d84-4934-94ee-d9226046e7e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Deleted volume successfully. Nov 01 12:23:26 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-689cd3ba-4d84-4934-94ee-d9226046e7e0 tempest-VolumeSnapshotQuotasNegativeTestJSON-1681894955 None] Lock "cinder-d8eb6c3b-c3a9-46dc-9fd6-9b734845a78d-delete_volume" released by "delete_volume" :: held 1.364s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:23:36 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:SELECT=17,cinder:UPDATE=17,cinder:INSERT=5,cinder:DELETE=2 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:23:36 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:SELECT=18,cinder:UPDATE=20,cinder:INSERT=5,cinder:DELETE=1 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:23:39 devstack cinder-volume[86574]: DEBUG oslo_service.periodic_task [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86574) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:23:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:23:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:23:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:23:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:23:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:23:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:39 devstack sudo[91152]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:23:39 devstack sudo[91152]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:40 devstack sudo[91152]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.352s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:40 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:23:40 devstack cinder-volume[86574]: DEBUG oslo_service.periodic_task [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running periodic task VolumeManager._thread_info {{(pid=86574) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:23:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] thread count: 8 {{(pid=86574) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 12:23:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] thread info: [<_MainThread(MainThread, started 131331184930944)>, , , , , , , ] {{(pid=86574) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 12:23:41 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-f565558d-46ed-4bdd-9ad9-558215e1c2d7 tempest-AttachVolumeNegativeTest-245012374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:23:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f565558d-46ed-4bdd-9ad9-558215e1c2d7 tempest-AttachVolumeNegativeTest-245012374 None] Flow 'volume_create_manager' (1b6b89cd-eb0b-473a-b12d-dc8434a22768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:23:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f565558d-46ed-4bdd-9ad9-558215e1c2d7 tempest-AttachVolumeNegativeTest-245012374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d13c052-f67d-4693-b7ca-b9d65b92d747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f565558d-46ed-4bdd-9ad9-558215e1c2d7 tempest-AttachVolumeNegativeTest-245012374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d13c052-f67d-4693-b7ca-b9d65b92d747) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-71600600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24a6a708-b2b5-423d-9db6-52133f9f1eb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33bece50a475457daaa280199a8d84b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:23:41Z,use_quota=True,user_id='5e41c2cf7aa144d488e34538a0804726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f565558d-46ed-4bdd-9ad9-558215e1c2d7 tempest-AttachVolumeNegativeTest-245012374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (415c287c-4498-42b9-866e-7fc5580038d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f565558d-46ed-4bdd-9ad9-558215e1c2d7 tempest-AttachVolumeNegativeTest-245012374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (415c287c-4498-42b9-866e-7fc5580038d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f565558d-46ed-4bdd-9ad9-558215e1c2d7 tempest-AttachVolumeNegativeTest-245012374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b53c2cc9-8968-4b42-844d-a4232ca87693) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f565558d-46ed-4bdd-9ad9-558215e1c2d7 tempest-AttachVolumeNegativeTest-245012374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b53c2cc9-8968-4b42-844d-a4232ca87693) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24a6a708-b2b5-423d-9db6-52133f9f1eb4', 'volume_name': 'volume-24a6a708-b2b5-423d-9db6-52133f9f1eb4', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f565558d-46ed-4bdd-9ad9-558215e1c2d7 tempest-AttachVolumeNegativeTest-245012374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (806fd740-61bb-4a9c-85bf-ed090c53cd68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f565558d-46ed-4bdd-9ad9-558215e1c2d7 tempest-AttachVolumeNegativeTest-245012374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (806fd740-61bb-4a9c-85bf-ed090c53cd68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f565558d-46ed-4bdd-9ad9-558215e1c2d7 tempest-AttachVolumeNegativeTest-245012374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2898d5c-9978-48e7-8f02-3a7ff4ba9402) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:41 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-f565558d-46ed-4bdd-9ad9-558215e1c2d7 tempest-AttachVolumeNegativeTest-245012374 None] Volume 24a6a708-b2b5-423d-9db6-52133f9f1eb4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24a6a708-b2b5-423d-9db6-52133f9f1eb4', 'volume_size': 1} Nov 01 12:23:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f565558d-46ed-4bdd-9ad9-558215e1c2d7 tempest-AttachVolumeNegativeTest-245012374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:23:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f565558d-46ed-4bdd-9ad9-558215e1c2d7 tempest-AttachVolumeNegativeTest-245012374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:23:41 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f565558d-46ed-4bdd-9ad9-558215e1c2d7 tempest-AttachVolumeNegativeTest-245012374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:23:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-71600600',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24a6a708-b2b5-423d-9db6-52133f9f1eb4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33bece50a475457daaa280199a8d84b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:23:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:23:41Z,use_quota=True,user_id='5e41c2cf7aa144d488e34538a0804726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:23:41 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-f565558d-46ed-4bdd-9ad9-558215e1c2d7 tempest-AttachVolumeNegativeTest-245012374 None] Creating volume 24a6a708-b2b5-423d-9db6-52133f9f1eb4 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:23:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f565558d-46ed-4bdd-9ad9-558215e1c2d7 tempest-AttachVolumeNegativeTest-245012374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:23:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f565558d-46ed-4bdd-9ad9-558215e1c2d7 tempest-AttachVolumeNegativeTest-245012374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:23:41 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f565558d-46ed-4bdd-9ad9-558215e1c2d7 tempest-AttachVolumeNegativeTest-245012374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:23:41 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f565558d-46ed-4bdd-9ad9-558215e1c2d7 tempest-AttachVolumeNegativeTest-245012374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:23:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f565558d-46ed-4bdd-9ad9-558215e1c2d7 tempest-AttachVolumeNegativeTest-245012374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:23:41 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f565558d-46ed-4bdd-9ad9-558215e1c2d7 tempest-AttachVolumeNegativeTest-245012374 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:23:41 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-f565558d-46ed-4bdd-9ad9-558215e1c2d7 tempest-AttachVolumeNegativeTest-245012374 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:23:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f565558d-46ed-4bdd-9ad9-558215e1c2d7 tempest-AttachVolumeNegativeTest-245012374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24a6a708-b2b5-423d-9db6-52133f9f1eb4 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:41 devstack sudo[91157]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24a6a708-b2b5-423d-9db6-52133f9f1eb4 1073741824 Nov 01 12:23:41 devstack sudo[91157]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:42 devstack sudo[91157]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f565558d-46ed-4bdd-9ad9-558215e1c2d7 tempest-AttachVolumeNegativeTest-245012374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24a6a708-b2b5-423d-9db6-52133f9f1eb4 1073741824" returned: 0 in 0.560s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f565558d-46ed-4bdd-9ad9-558215e1c2d7 tempest-AttachVolumeNegativeTest-245012374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24a6a708-b2b5-423d-9db6-52133f9f1eb4 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:23:42 devstack sudo[91166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24a6a708-b2b5-423d-9db6-52133f9f1eb4 Nov 01 12:23:42 devstack sudo[91166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:23:42 devstack sudo[91166]: pam_unix(sudo:session): session closed for user root Nov 01 12:23:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f565558d-46ed-4bdd-9ad9-558215e1c2d7 tempest-AttachVolumeNegativeTest-245012374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24a6a708-b2b5-423d-9db6-52133f9f1eb4" returned: 0 in 0.456s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:23:42 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f565558d-46ed-4bdd-9ad9-558215e1c2d7 tempest-AttachVolumeNegativeTest-245012374 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:23:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f565558d-46ed-4bdd-9ad9-558215e1c2d7 tempest-AttachVolumeNegativeTest-245012374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:23:42 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f565558d-46ed-4bdd-9ad9-558215e1c2d7 tempest-AttachVolumeNegativeTest-245012374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d2898d5c-9978-48e7-8f02-3a7ff4ba9402) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24a6a708-b2b5-423d-9db6-52133f9f1eb4', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:42 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f565558d-46ed-4bdd-9ad9-558215e1c2d7 tempest-AttachVolumeNegativeTest-245012374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8aee709-fc6a-4aa3-970e-881d13e518e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:23:42 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-f565558d-46ed-4bdd-9ad9-558215e1c2d7 tempest-AttachVolumeNegativeTest-245012374 None] Volume volume-24a6a708-b2b5-423d-9db6-52133f9f1eb4 (24a6a708-b2b5-423d-9db6-52133f9f1eb4): created successfully Nov 01 12:23:42 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f565558d-46ed-4bdd-9ad9-558215e1c2d7 tempest-AttachVolumeNegativeTest-245012374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8aee709-fc6a-4aa3-970e-881d13e518e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:23:42 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f565558d-46ed-4bdd-9ad9-558215e1c2d7 tempest-AttachVolumeNegativeTest-245012374 None] Flow 'volume_create_manager' (1b6b89cd-eb0b-473a-b12d-dc8434a22768) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:23:42 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-f565558d-46ed-4bdd-9ad9-558215e1c2d7 tempest-AttachVolumeNegativeTest-245012374 None] Created volume successfully. Nov 01 12:23:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-b0728d51-1a4d-4375-9108-501fcf1c3804 req-4a8a52f8-d584-4e9d-9cbe-a400f58772f3 tempest-AttachVolumeNegativeTest-245012374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:23:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-b0728d51-1a4d-4375-9108-501fcf1c3804 req-4a8a52f8-d584-4e9d-9cbe-a400f58772f3 tempest-AttachVolumeNegativeTest-245012374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:23:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-b0728d51-1a4d-4375-9108-501fcf1c3804 req-4a8a52f8-d584-4e9d-9cbe-a400f58772f3 tempest-AttachVolumeNegativeTest-245012374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.020s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:23:45 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-b0728d51-1a4d-4375-9108-501fcf1c3804 req-4a8a52f8-d584-4e9d-9cbe-a400f58772f3 tempest-AttachVolumeNegativeTest-245012374 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb', 'name': 'volume-24a6a708-b2b5-423d-9db6-52133f9f1eb4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '26bfe721-5a48-4b82-be7c-d9756faac386', 'enforce_multipath': True} {{(pid=86574) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 12:23:45 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-b0728d51-1a4d-4375-9108-501fcf1c3804 req-4a8a52f8-d584-4e9d-9cbe-a400f58772f3 tempest-AttachVolumeNegativeTest-245012374 None] attachment_update completed successfully. Nov 01 12:23:55 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3,cinder:DELETE=1 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:23:55 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:UPDATE=6,cinder:SELECT=9,cinder:INSERT=1 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:24:01 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f46d09b-5ffd-4303-aaaa-bf860c98ba07 tempest-ServerActionsTestOtherA-2064758512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:24:01 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-7f46d09b-5ffd-4303-aaaa-bf860c98ba07 tempest-ServerActionsTestOtherA-2064758512 None] Flow 'volume_create_manager' (690608a0-bdcf-4fe9-810e-b3924b8aac3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:24:02 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-7f46d09b-5ffd-4303-aaaa-bf860c98ba07 tempest-ServerActionsTestOtherA-2064758512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b36894a1-71c8-4f94-ab84-cba1fe47b379) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:02 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-7f46d09b-5ffd-4303-aaaa-bf860c98ba07 tempest-ServerActionsTestOtherA-2064758512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b36894a1-71c8-4f94-ab84-cba1fe47b379) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1190024673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8d23fa1-7cea-46a1-b22f-31e8dd59cdd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89fba3f7dbbe400bbdea46e735351975',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:24:02Z,use_quota=True,user_id='24a3f424962f485ba077702c2b4d6a8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:02 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-7f46d09b-5ffd-4303-aaaa-bf860c98ba07 tempest-ServerActionsTestOtherA-2064758512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40fcebbf-8496-4112-b505-99357cb12f6b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:02 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-7f46d09b-5ffd-4303-aaaa-bf860c98ba07 tempest-ServerActionsTestOtherA-2064758512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40fcebbf-8496-4112-b505-99357cb12f6b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:02 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-7f46d09b-5ffd-4303-aaaa-bf860c98ba07 tempest-ServerActionsTestOtherA-2064758512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (950320fb-615e-43c3-a12a-e4bb619a5c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:02 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-7f46d09b-5ffd-4303-aaaa-bf860c98ba07 tempest-ServerActionsTestOtherA-2064758512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (950320fb-615e-43c3-a12a-e4bb619a5c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8d23fa1-7cea-46a1-b22f-31e8dd59cdd5', 'volume_name': 'volume-c8d23fa1-7cea-46a1-b22f-31e8dd59cdd5', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:02 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-7f46d09b-5ffd-4303-aaaa-bf860c98ba07 tempest-ServerActionsTestOtherA-2064758512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01725244-aa25-4b7d-9c67-09bfc8c59512) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:02 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-7f46d09b-5ffd-4303-aaaa-bf860c98ba07 tempest-ServerActionsTestOtherA-2064758512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (01725244-aa25-4b7d-9c67-09bfc8c59512) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:02 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-7f46d09b-5ffd-4303-aaaa-bf860c98ba07 tempest-ServerActionsTestOtherA-2064758512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9162db26-7f51-4ebe-8581-47491341bd25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:02 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-7f46d09b-5ffd-4303-aaaa-bf860c98ba07 tempest-ServerActionsTestOtherA-2064758512 None] Volume c8d23fa1-7cea-46a1-b22f-31e8dd59cdd5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8d23fa1-7cea-46a1-b22f-31e8dd59cdd5', 'volume_size': 1} Nov 01 12:24:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-7f46d09b-5ffd-4303-aaaa-bf860c98ba07 tempest-ServerActionsTestOtherA-2064758512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-7f46d09b-5ffd-4303-aaaa-bf860c98ba07 tempest-ServerActionsTestOtherA-2064758512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:02 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-7f46d09b-5ffd-4303-aaaa-bf860c98ba07 tempest-ServerActionsTestOtherA-2064758512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:24:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServerActionsTestOtherA-volume-1190024673',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8d23fa1-7cea-46a1-b22f-31e8dd59cdd5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89fba3f7dbbe400bbdea46e735351975',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:24:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:24:02Z,use_quota=True,user_id='24a3f424962f485ba077702c2b4d6a8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:24:02 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-7f46d09b-5ffd-4303-aaaa-bf860c98ba07 tempest-ServerActionsTestOtherA-2064758512 None] Creating volume c8d23fa1-7cea-46a1-b22f-31e8dd59cdd5 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:24:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-7f46d09b-5ffd-4303-aaaa-bf860c98ba07 tempest-ServerActionsTestOtherA-2064758512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-7f46d09b-5ffd-4303-aaaa-bf860c98ba07 tempest-ServerActionsTestOtherA-2064758512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:02 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-7f46d09b-5ffd-4303-aaaa-bf860c98ba07 tempest-ServerActionsTestOtherA-2064758512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:24:02 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-7f46d09b-5ffd-4303-aaaa-bf860c98ba07 tempest-ServerActionsTestOtherA-2064758512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:24:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-7f46d09b-5ffd-4303-aaaa-bf860c98ba07 tempest-ServerActionsTestOtherA-2064758512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:02 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-7f46d09b-5ffd-4303-aaaa-bf860c98ba07 tempest-ServerActionsTestOtherA-2064758512 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:24:02 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-7f46d09b-5ffd-4303-aaaa-bf860c98ba07 tempest-ServerActionsTestOtherA-2064758512 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:24:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7f46d09b-5ffd-4303-aaaa-bf860c98ba07 tempest-ServerActionsTestOtherA-2064758512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c8d23fa1-7cea-46a1-b22f-31e8dd59cdd5 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:02 devstack sudo[91782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c8d23fa1-7cea-46a1-b22f-31e8dd59cdd5 1073741824 Nov 01 12:24:02 devstack sudo[91782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:03 devstack sudo[91782]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7f46d09b-5ffd-4303-aaaa-bf860c98ba07 tempest-ServerActionsTestOtherA-2064758512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c8d23fa1-7cea-46a1-b22f-31e8dd59cdd5 1073741824" returned: 0 in 0.887s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7f46d09b-5ffd-4303-aaaa-bf860c98ba07 tempest-ServerActionsTestOtherA-2064758512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c8d23fa1-7cea-46a1-b22f-31e8dd59cdd5 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:03 devstack sudo[91790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c8d23fa1-7cea-46a1-b22f-31e8dd59cdd5 Nov 01 12:24:03 devstack sudo[91790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:04 devstack sudo[91790]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7f46d09b-5ffd-4303-aaaa-bf860c98ba07 tempest-ServerActionsTestOtherA-2064758512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c8d23fa1-7cea-46a1-b22f-31e8dd59cdd5" returned: 0 in 0.910s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:04 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-7f46d09b-5ffd-4303-aaaa-bf860c98ba07 tempest-ServerActionsTestOtherA-2064758512 None] <== create_volume: return (1944ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:24:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-7f46d09b-5ffd-4303-aaaa-bf860c98ba07 tempest-ServerActionsTestOtherA-2064758512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.948s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-7f46d09b-5ffd-4303-aaaa-bf860c98ba07 tempest-ServerActionsTestOtherA-2064758512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9162db26-7f51-4ebe-8581-47491341bd25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8d23fa1-7cea-46a1-b22f-31e8dd59cdd5', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-7f46d09b-5ffd-4303-aaaa-bf860c98ba07 tempest-ServerActionsTestOtherA-2064758512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39aac765-f3b3-4aa5-ac67-0aa04e0bb6d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:04 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-7f46d09b-5ffd-4303-aaaa-bf860c98ba07 tempest-ServerActionsTestOtherA-2064758512 None] Volume volume-c8d23fa1-7cea-46a1-b22f-31e8dd59cdd5 (c8d23fa1-7cea-46a1-b22f-31e8dd59cdd5): created successfully Nov 01 12:24:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-7f46d09b-5ffd-4303-aaaa-bf860c98ba07 tempest-ServerActionsTestOtherA-2064758512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39aac765-f3b3-4aa5-ac67-0aa04e0bb6d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-7f46d09b-5ffd-4303-aaaa-bf860c98ba07 tempest-ServerActionsTestOtherA-2064758512 None] Flow 'volume_create_manager' (690608a0-bdcf-4fe9-810e-b3924b8aac3a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:24:04 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-7f46d09b-5ffd-4303-aaaa-bf860c98ba07 tempest-ServerActionsTestOtherA-2064758512 None] Created volume successfully. Nov 01 12:24:14 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:UPDATE=4,cinder:SELECT=2 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:24:14 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:SELECT=2,cinder:INSERT=1,cinder:UPDATE=2,cinder:DELETE=1 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:24:18 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c6e2a7e-58fd-4638-a217-c70983a13707 tempest-AttachVolumeTestJSON-2012429887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:24:18 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8c6e2a7e-58fd-4638-a217-c70983a13707 tempest-AttachVolumeTestJSON-2012429887 None] Flow 'volume_create_manager' (f7aaad51-133c-4e99-b4a2-0453606f91d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:24:18 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8c6e2a7e-58fd-4638-a217-c70983a13707 tempest-AttachVolumeTestJSON-2012429887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f764aa61-4280-4965-a4e2-aad8edb0ebb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:18 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8c6e2a7e-58fd-4638-a217-c70983a13707 tempest-AttachVolumeTestJSON-2012429887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f764aa61-4280-4965-a4e2-aad8edb0ebb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1289297611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa01e09c-9f3f-4b8a-9529-0e4d59030af9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7e72d8aa8784b3cb0e32ad59522b3fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:24:19Z,use_quota=True,user_id='603c24fad16041739c6ce5f4630ccecd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:18 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8c6e2a7e-58fd-4638-a217-c70983a13707 tempest-AttachVolumeTestJSON-2012429887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba414727-dd4e-4e9d-847f-64bd928e1d93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:18 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8c6e2a7e-58fd-4638-a217-c70983a13707 tempest-AttachVolumeTestJSON-2012429887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ba414727-dd4e-4e9d-847f-64bd928e1d93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:18 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8c6e2a7e-58fd-4638-a217-c70983a13707 tempest-AttachVolumeTestJSON-2012429887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41cbcc84-6633-45dc-ae75-8a7861af9f72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:18 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8c6e2a7e-58fd-4638-a217-c70983a13707 tempest-AttachVolumeTestJSON-2012429887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (41cbcc84-6633-45dc-ae75-8a7861af9f72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa01e09c-9f3f-4b8a-9529-0e4d59030af9', 'volume_name': 'volume-fa01e09c-9f3f-4b8a-9529-0e4d59030af9', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:19 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8c6e2a7e-58fd-4638-a217-c70983a13707 tempest-AttachVolumeTestJSON-2012429887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26a4d753-5314-4c1d-b77e-7635132a4542) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:19 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8c6e2a7e-58fd-4638-a217-c70983a13707 tempest-AttachVolumeTestJSON-2012429887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26a4d753-5314-4c1d-b77e-7635132a4542) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:19 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8c6e2a7e-58fd-4638-a217-c70983a13707 tempest-AttachVolumeTestJSON-2012429887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bfd6118-cc93-4a21-b71d-56897482a7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:19 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-8c6e2a7e-58fd-4638-a217-c70983a13707 tempest-AttachVolumeTestJSON-2012429887 None] Volume fa01e09c-9f3f-4b8a-9529-0e4d59030af9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa01e09c-9f3f-4b8a-9529-0e4d59030af9', 'volume_size': 1} Nov 01 12:24:19 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8c6e2a7e-58fd-4638-a217-c70983a13707 tempest-AttachVolumeTestJSON-2012429887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:19 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8c6e2a7e-58fd-4638-a217-c70983a13707 tempest-AttachVolumeTestJSON-2012429887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:19 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-8c6e2a7e-58fd-4638-a217-c70983a13707 tempest-AttachVolumeTestJSON-2012429887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:24:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1289297611',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa01e09c-9f3f-4b8a-9529-0e4d59030af9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7e72d8aa8784b3cb0e32ad59522b3fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:24:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:24:19Z,use_quota=True,user_id='603c24fad16041739c6ce5f4630ccecd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:24:19 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-8c6e2a7e-58fd-4638-a217-c70983a13707 tempest-AttachVolumeTestJSON-2012429887 None] Creating volume fa01e09c-9f3f-4b8a-9529-0e4d59030af9 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:24:19 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8c6e2a7e-58fd-4638-a217-c70983a13707 tempest-AttachVolumeTestJSON-2012429887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:19 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8c6e2a7e-58fd-4638-a217-c70983a13707 tempest-AttachVolumeTestJSON-2012429887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:19 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-8c6e2a7e-58fd-4638-a217-c70983a13707 tempest-AttachVolumeTestJSON-2012429887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:24:19 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-8c6e2a7e-58fd-4638-a217-c70983a13707 tempest-AttachVolumeTestJSON-2012429887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:24:19 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8c6e2a7e-58fd-4638-a217-c70983a13707 tempest-AttachVolumeTestJSON-2012429887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:19 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-8c6e2a7e-58fd-4638-a217-c70983a13707 tempest-AttachVolumeTestJSON-2012429887 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:24:19 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-8c6e2a7e-58fd-4638-a217-c70983a13707 tempest-AttachVolumeTestJSON-2012429887 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:24:19 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8c6e2a7e-58fd-4638-a217-c70983a13707 tempest-AttachVolumeTestJSON-2012429887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa01e09c-9f3f-4b8a-9529-0e4d59030af9 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:19 devstack sudo[91977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa01e09c-9f3f-4b8a-9529-0e4d59030af9 1073741824 Nov 01 12:24:19 devstack sudo[91977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:19 devstack sudo[91977]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:19 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8c6e2a7e-58fd-4638-a217-c70983a13707 tempest-AttachVolumeTestJSON-2012429887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa01e09c-9f3f-4b8a-9529-0e4d59030af9 1073741824" returned: 0 in 0.806s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:19 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8c6e2a7e-58fd-4638-a217-c70983a13707 tempest-AttachVolumeTestJSON-2012429887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa01e09c-9f3f-4b8a-9529-0e4d59030af9 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:19 devstack sudo[91997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa01e09c-9f3f-4b8a-9529-0e4d59030af9 Nov 01 12:24:19 devstack sudo[91997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:20 devstack sudo[91997]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8c6e2a7e-58fd-4638-a217-c70983a13707 tempest-AttachVolumeTestJSON-2012429887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa01e09c-9f3f-4b8a-9529-0e4d59030af9" returned: 0 in 0.384s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:20 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-8c6e2a7e-58fd-4638-a217-c70983a13707 tempest-AttachVolumeTestJSON-2012429887 None] <== create_volume: return (1296ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:24:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8c6e2a7e-58fd-4638-a217-c70983a13707 tempest-AttachVolumeTestJSON-2012429887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.304s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:20 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8c6e2a7e-58fd-4638-a217-c70983a13707 tempest-AttachVolumeTestJSON-2012429887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0bfd6118-cc93-4a21-b71d-56897482a7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa01e09c-9f3f-4b8a-9529-0e4d59030af9', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:20 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8c6e2a7e-58fd-4638-a217-c70983a13707 tempest-AttachVolumeTestJSON-2012429887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2b5d6c0-3979-4e0b-808a-9812013d7f76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:20 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-8c6e2a7e-58fd-4638-a217-c70983a13707 tempest-AttachVolumeTestJSON-2012429887 None] Volume volume-fa01e09c-9f3f-4b8a-9529-0e4d59030af9 (fa01e09c-9f3f-4b8a-9529-0e4d59030af9): created successfully Nov 01 12:24:20 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8c6e2a7e-58fd-4638-a217-c70983a13707 tempest-AttachVolumeTestJSON-2012429887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c2b5d6c0-3979-4e0b-808a-9812013d7f76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:20 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8c6e2a7e-58fd-4638-a217-c70983a13707 tempest-AttachVolumeTestJSON-2012429887 None] Flow 'volume_create_manager' (f7aaad51-133c-4e99-b4a2-0453606f91d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:24:20 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-8c6e2a7e-58fd-4638-a217-c70983a13707 tempest-AttachVolumeTestJSON-2012429887 None] Created volume successfully. Nov 01 12:24:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-2c60baa8-3ff4-432d-882b-fca40d509580 req-ac29cbec-30f1-4e62-94bc-ca50e18c563c tempest-AttachVolumeTestJSON-2012429887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-2c60baa8-3ff4-432d-882b-fca40d509580 req-ac29cbec-30f1-4e62-94bc-ca50e18c563c tempest-AttachVolumeTestJSON-2012429887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-2c60baa8-3ff4-432d-882b-fca40d509580 req-ac29cbec-30f1-4e62-94bc-ca50e18c563c tempest-AttachVolumeTestJSON-2012429887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.031s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:22 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-2c60baa8-3ff4-432d-882b-fca40d509580 req-ac29cbec-30f1-4e62-94bc-ca50e18c563c tempest-AttachVolumeTestJSON-2012429887 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb', 'name': 'volume-fa01e09c-9f3f-4b8a-9529-0e4d59030af9', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6acdbbef-e130-47c7-a95e-c42f9e4b7f27', 'enforce_multipath': True} {{(pid=86574) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 12:24:22 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-2c60baa8-3ff4-432d-882b-fca40d509580 req-ac29cbec-30f1-4e62-94bc-ca50e18c563c tempest-AttachVolumeTestJSON-2012429887 None] attachment_update completed successfully. Nov 01 12:24:25 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-b2585a54-dc9e-4164-968d-2b3d703543d2 tempest-AttachVolumeTestJSON-2012429887 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:24:25 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b2585a54-dc9e-4164-968d-2b3d703543d2 tempest-AttachVolumeTestJSON-2012429887 None] Flow 'volume_create_manager' (70c6e5e7-36c2-4cc2-a2f3-b6e2d4c3dacd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:24:25 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b2585a54-dc9e-4164-968d-2b3d703543d2 tempest-AttachVolumeTestJSON-2012429887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d2694e7-1307-4928-95e9-069e5f6783cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:25 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b2585a54-dc9e-4164-968d-2b3d703543d2 tempest-AttachVolumeTestJSON-2012429887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d2694e7-1307-4928-95e9-069e5f6783cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2110474355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ac4439c-b395-45af-8418-1af176debce4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7e72d8aa8784b3cb0e32ad59522b3fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:24:26Z,use_quota=True,user_id='603c24fad16041739c6ce5f4630ccecd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:25 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b2585a54-dc9e-4164-968d-2b3d703543d2 tempest-AttachVolumeTestJSON-2012429887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee7e741f-e5d8-4d8c-ab06-ea0e170b6bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:25 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b2585a54-dc9e-4164-968d-2b3d703543d2 tempest-AttachVolumeTestJSON-2012429887 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ee7e741f-e5d8-4d8c-ab06-ea0e170b6bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:25 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b2585a54-dc9e-4164-968d-2b3d703543d2 tempest-AttachVolumeTestJSON-2012429887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccb5e02a-014e-4780-a549-ddcf47c8cedd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:25 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b2585a54-dc9e-4164-968d-2b3d703543d2 tempest-AttachVolumeTestJSON-2012429887 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccb5e02a-014e-4780-a549-ddcf47c8cedd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1ac4439c-b395-45af-8418-1af176debce4', 'volume_name': 'volume-1ac4439c-b395-45af-8418-1af176debce4', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:25 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b2585a54-dc9e-4164-968d-2b3d703543d2 tempest-AttachVolumeTestJSON-2012429887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25cbc047-a824-4ff1-9a1d-74705b34c972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:25 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b2585a54-dc9e-4164-968d-2b3d703543d2 tempest-AttachVolumeTestJSON-2012429887 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25cbc047-a824-4ff1-9a1d-74705b34c972) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:25 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b2585a54-dc9e-4164-968d-2b3d703543d2 tempest-AttachVolumeTestJSON-2012429887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac12176d-0c2f-4b48-a44b-1fef5f438ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:25 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-b2585a54-dc9e-4164-968d-2b3d703543d2 tempest-AttachVolumeTestJSON-2012429887 None] Volume 1ac4439c-b395-45af-8418-1af176debce4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1ac4439c-b395-45af-8418-1af176debce4', 'volume_size': 1} Nov 01 12:24:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b2585a54-dc9e-4164-968d-2b3d703543d2 tempest-AttachVolumeTestJSON-2012429887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b2585a54-dc9e-4164-968d-2b3d703543d2 tempest-AttachVolumeTestJSON-2012429887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:25 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-b2585a54-dc9e-4164-968d-2b3d703543d2 tempest-AttachVolumeTestJSON-2012429887 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-2110474355',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1ac4439c-b395-45af-8418-1af176debce4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e7e72d8aa8784b3cb0e32ad59522b3fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:24:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:24:26Z,use_quota=True,user_id='603c24fad16041739c6ce5f4630ccecd',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:24:25 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-b2585a54-dc9e-4164-968d-2b3d703543d2 tempest-AttachVolumeTestJSON-2012429887 None] Creating volume 1ac4439c-b395-45af-8418-1af176debce4 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:24:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b2585a54-dc9e-4164-968d-2b3d703543d2 tempest-AttachVolumeTestJSON-2012429887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b2585a54-dc9e-4164-968d-2b3d703543d2 tempest-AttachVolumeTestJSON-2012429887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:25 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-b2585a54-dc9e-4164-968d-2b3d703543d2 tempest-AttachVolumeTestJSON-2012429887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:24:25 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-b2585a54-dc9e-4164-968d-2b3d703543d2 tempest-AttachVolumeTestJSON-2012429887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:24:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b2585a54-dc9e-4164-968d-2b3d703543d2 tempest-AttachVolumeTestJSON-2012429887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:25 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-b2585a54-dc9e-4164-968d-2b3d703543d2 tempest-AttachVolumeTestJSON-2012429887 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:24:25 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-b2585a54-dc9e-4164-968d-2b3d703543d2 tempest-AttachVolumeTestJSON-2012429887 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:24:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b2585a54-dc9e-4164-968d-2b3d703543d2 tempest-AttachVolumeTestJSON-2012429887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1ac4439c-b395-45af-8418-1af176debce4 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:25 devstack sudo[92092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1ac4439c-b395-45af-8418-1af176debce4 1073741824 Nov 01 12:24:25 devstack sudo[92092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:26 devstack sudo[92092]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b2585a54-dc9e-4164-968d-2b3d703543d2 tempest-AttachVolumeTestJSON-2012429887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1ac4439c-b395-45af-8418-1af176debce4 1073741824" returned: 0 in 0.488s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b2585a54-dc9e-4164-968d-2b3d703543d2 tempest-AttachVolumeTestJSON-2012429887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1ac4439c-b395-45af-8418-1af176debce4 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:26 devstack sudo[92098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1ac4439c-b395-45af-8418-1af176debce4 Nov 01 12:24:26 devstack sudo[92098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:26 devstack sudo[92098]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b2585a54-dc9e-4164-968d-2b3d703543d2 tempest-AttachVolumeTestJSON-2012429887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1ac4439c-b395-45af-8418-1af176debce4" returned: 0 in 0.408s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:26 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-b2585a54-dc9e-4164-968d-2b3d703543d2 tempest-AttachVolumeTestJSON-2012429887 None] <== create_volume: return (978ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:24:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b2585a54-dc9e-4164-968d-2b3d703543d2 tempest-AttachVolumeTestJSON-2012429887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.984s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b2585a54-dc9e-4164-968d-2b3d703543d2 tempest-AttachVolumeTestJSON-2012429887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ac12176d-0c2f-4b48-a44b-1fef5f438ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1ac4439c-b395-45af-8418-1af176debce4', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b2585a54-dc9e-4164-968d-2b3d703543d2 tempest-AttachVolumeTestJSON-2012429887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeb4eeff-e9be-458a-aeda-d2bb07747fec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:26 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-b2585a54-dc9e-4164-968d-2b3d703543d2 tempest-AttachVolumeTestJSON-2012429887 None] Volume volume-1ac4439c-b395-45af-8418-1af176debce4 (1ac4439c-b395-45af-8418-1af176debce4): created successfully Nov 01 12:24:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b2585a54-dc9e-4164-968d-2b3d703543d2 tempest-AttachVolumeTestJSON-2012429887 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eeb4eeff-e9be-458a-aeda-d2bb07747fec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b2585a54-dc9e-4164-968d-2b3d703543d2 tempest-AttachVolumeTestJSON-2012429887 None] Flow 'volume_create_manager' (70c6e5e7-36c2-4cc2-a2f3-b6e2d4c3dacd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:24:26 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-b2585a54-dc9e-4164-968d-2b3d703543d2 tempest-AttachVolumeTestJSON-2012429887 None] Created volume successfully. Nov 01 12:24:27 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cbb74c4-e9b7-4e27-87c9-37b3b029b57c tempest-VolumesActionsTest-1819912924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:24:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9cbb74c4-e9b7-4e27-87c9-37b3b029b57c tempest-VolumesActionsTest-1819912924 None] Flow 'volume_create_manager' (1bbbddbc-4aa9-42b6-8514-3585c87de6d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:24:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9cbb74c4-e9b7-4e27-87c9-37b3b029b57c tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98c10de2-84dc-49b8-8a6d-5dc8dc37c816) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9cbb74c4-e9b7-4e27-87c9-37b3b029b57c tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98c10de2-84dc-49b8-8a6d-5dc8dc37c816) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1368350606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90e9c355-04c1-4ac4-9bd9-6711e562cdf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5cd945732ab40d48b81f8b28fba5d49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:24:27Z,use_quota=True,user_id='5814ea32a9b6456cbd80202cda2cdb14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9cbb74c4-e9b7-4e27-87c9-37b3b029b57c tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3569227-3ccd-4d85-b095-6fb9acf06197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9cbb74c4-e9b7-4e27-87c9-37b3b029b57c tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a3569227-3ccd-4d85-b095-6fb9acf06197) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9cbb74c4-e9b7-4e27-87c9-37b3b029b57c tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71e43836-03b4-4496-8b5b-699827db533d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9cbb74c4-e9b7-4e27-87c9-37b3b029b57c tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (71e43836-03b4-4496-8b5b-699827db533d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '90e9c355-04c1-4ac4-9bd9-6711e562cdf6', 'volume_name': 'volume-90e9c355-04c1-4ac4-9bd9-6711e562cdf6', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9cbb74c4-e9b7-4e27-87c9-37b3b029b57c tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4e993f7-c0f2-45f6-aa82-4a42b80ebe51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9cbb74c4-e9b7-4e27-87c9-37b3b029b57c tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a4e993f7-c0f2-45f6-aa82-4a42b80ebe51) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9cbb74c4-e9b7-4e27-87c9-37b3b029b57c tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06747fcc-2ac6-4751-996a-9024319db7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:27 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-9cbb74c4-e9b7-4e27-87c9-37b3b029b57c tempest-VolumesActionsTest-1819912924 None] Volume 90e9c355-04c1-4ac4-9bd9-6711e562cdf6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-90e9c355-04c1-4ac4-9bd9-6711e562cdf6', 'volume_size': 1} Nov 01 12:24:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-9cbb74c4-e9b7-4e27-87c9-37b3b029b57c tempest-VolumesActionsTest-1819912924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-9cbb74c4-e9b7-4e27-87c9-37b3b029b57c tempest-VolumesActionsTest-1819912924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:27 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-9cbb74c4-e9b7-4e27-87c9-37b3b029b57c tempest-VolumesActionsTest-1819912924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:24:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1368350606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=90e9c355-04c1-4ac4-9bd9-6711e562cdf6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5cd945732ab40d48b81f8b28fba5d49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:24:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:24:27Z,use_quota=True,user_id='5814ea32a9b6456cbd80202cda2cdb14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:24:27 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-9cbb74c4-e9b7-4e27-87c9-37b3b029b57c tempest-VolumesActionsTest-1819912924 None] Creating volume 90e9c355-04c1-4ac4-9bd9-6711e562cdf6 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:24:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-9cbb74c4-e9b7-4e27-87c9-37b3b029b57c tempest-VolumesActionsTest-1819912924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-9cbb74c4-e9b7-4e27-87c9-37b3b029b57c tempest-VolumesActionsTest-1819912924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:27 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-9cbb74c4-e9b7-4e27-87c9-37b3b029b57c tempest-VolumesActionsTest-1819912924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:24:27 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-9cbb74c4-e9b7-4e27-87c9-37b3b029b57c tempest-VolumesActionsTest-1819912924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:24:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-9cbb74c4-e9b7-4e27-87c9-37b3b029b57c tempest-VolumesActionsTest-1819912924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:27 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-9cbb74c4-e9b7-4e27-87c9-37b3b029b57c tempest-VolumesActionsTest-1819912924 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:24:27 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-9cbb74c4-e9b7-4e27-87c9-37b3b029b57c tempest-VolumesActionsTest-1819912924 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:24:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9cbb74c4-e9b7-4e27-87c9-37b3b029b57c tempest-VolumesActionsTest-1819912924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-90e9c355-04c1-4ac4-9bd9-6711e562cdf6 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:27 devstack sudo[92102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-90e9c355-04c1-4ac4-9bd9-6711e562cdf6 1073741824 Nov 01 12:24:27 devstack sudo[92102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:28 devstack sudo[92102]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9cbb74c4-e9b7-4e27-87c9-37b3b029b57c tempest-VolumesActionsTest-1819912924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-90e9c355-04c1-4ac4-9bd9-6711e562cdf6 1073741824" returned: 0 in 0.646s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9cbb74c4-e9b7-4e27-87c9-37b3b029b57c tempest-VolumesActionsTest-1819912924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-90e9c355-04c1-4ac4-9bd9-6711e562cdf6 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:28 devstack sudo[92115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-90e9c355-04c1-4ac4-9bd9-6711e562cdf6 Nov 01 12:24:28 devstack sudo[92115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:28 devstack sudo[92115]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9cbb74c4-e9b7-4e27-87c9-37b3b029b57c tempest-VolumesActionsTest-1819912924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-90e9c355-04c1-4ac4-9bd9-6711e562cdf6" returned: 0 in 0.539s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:28 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-9cbb74c4-e9b7-4e27-87c9-37b3b029b57c tempest-VolumesActionsTest-1819912924 None] <== create_volume: return (1245ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:24:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-9cbb74c4-e9b7-4e27-87c9-37b3b029b57c tempest-VolumesActionsTest-1819912924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.255s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9cbb74c4-e9b7-4e27-87c9-37b3b029b57c tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (06747fcc-2ac6-4751-996a-9024319db7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-90e9c355-04c1-4ac4-9bd9-6711e562cdf6', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9cbb74c4-e9b7-4e27-87c9-37b3b029b57c tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9878e23b-a63c-4733-bc3f-009db0cf6b74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:28 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-9cbb74c4-e9b7-4e27-87c9-37b3b029b57c tempest-VolumesActionsTest-1819912924 None] Volume volume-90e9c355-04c1-4ac4-9bd9-6711e562cdf6 (90e9c355-04c1-4ac4-9bd9-6711e562cdf6): created successfully Nov 01 12:24:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9cbb74c4-e9b7-4e27-87c9-37b3b029b57c tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9878e23b-a63c-4733-bc3f-009db0cf6b74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9cbb74c4-e9b7-4e27-87c9-37b3b029b57c tempest-VolumesActionsTest-1819912924 None] Flow 'volume_create_manager' (1bbbddbc-4aa9-42b6-8514-3585c87de6d2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:24:28 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-9cbb74c4-e9b7-4e27-87c9-37b3b029b57c tempest-VolumesActionsTest-1819912924 None] Created volume successfully. Nov 01 12:24:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-edc197c2-5e6c-4bed-91a6-61da9f44bed9 req-b4728204-b4a6-4954-9293-324a56d933fe tempest-AttachVolumeTestJSON-2012429887 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-edc197c2-5e6c-4bed-91a6-61da9f44bed9 req-b4728204-b4a6-4954-9293-324a56d933fe tempest-AttachVolumeTestJSON-2012429887 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-edc197c2-5e6c-4bed-91a6-61da9f44bed9 req-b4728204-b4a6-4954-9293-324a56d933fe tempest-AttachVolumeTestJSON-2012429887 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-edc197c2-5e6c-4bed-91a6-61da9f44bed9 req-b4728204-b4a6-4954-9293-324a56d933fe tempest-AttachVolumeTestJSON-2012429887 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb', 'name': 'volume-1ac4439c-b395-45af-8418-1af176debce4', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '760e40db-95f2-46ce-b505-e7ad49050ca6', 'enforce_multipath': True} {{(pid=86574) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 12:24:29 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-edc197c2-5e6c-4bed-91a6-61da9f44bed9 req-b4728204-b4a6-4954-9293-324a56d933fe tempest-AttachVolumeTestJSON-2012429887 None] attachment_update completed successfully. Nov 01 12:24:29 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-95040971-6542-493f-b53f-f8b13fb3a304 tempest-VolumesActionsTest-1819912924 None] Acquiring lock "cinder-90e9c355-04c1-4ac4-9bd9-6711e562cdf6" by "attach_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:24:29 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-95040971-6542-493f-b53f-f8b13fb3a304 tempest-VolumesActionsTest-1819912924 None] Lock "cinder-90e9c355-04c1-4ac4-9bd9-6711e562cdf6" acquired by "attach_volume" :: waited 0.067s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:24:30 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-95040971-6542-493f-b53f-f8b13fb3a304 tempest-VolumesActionsTest-1819912924 None] Attaching volume 90e9c355-04c1-4ac4-9bd9-6711e562cdf6 to instance d08e9187-ea68-44cd-8643-a7b1f2c6bcf5 at mountpoint /dev/vdb on host None. Nov 01 12:24:30 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-95040971-6542-493f-b53f-f8b13fb3a304 tempest-VolumesActionsTest-1819912924 None] Attach volume completed successfully. Nov 01 12:24:30 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-95040971-6542-493f-b53f-f8b13fb3a304 tempest-VolumesActionsTest-1819912924 None] Lock "cinder-90e9c355-04c1-4ac4-9bd9-6711e562cdf6" released by "attach_volume" :: held 0.334s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:24:31 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-3c5c0c70-83e7-4b5a-b3bf-4ee14fde9251 tempest-VolumesActionsTest-668469899 None] Terminate volume connection completed successfully. Nov 01 12:24:32 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-3c5c0c70-83e7-4b5a-b3bf-4ee14fde9251 tempest-VolumesActionsTest-668469899 None] Acquiring lock "cinder-90e9c355-04c1-4ac4-9bd9-6711e562cdf6-detach_volume" by "detach_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:24:32 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-3c5c0c70-83e7-4b5a-b3bf-4ee14fde9251 tempest-VolumesActionsTest-668469899 None] Lock "cinder-90e9c355-04c1-4ac4-9bd9-6711e562cdf6-detach_volume" acquired by "detach_volume" :: waited 0.044s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:24:32 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-3c5c0c70-83e7-4b5a-b3bf-4ee14fde9251 tempest-VolumesActionsTest-668469899 None] Detaching volume 90e9c355-04c1-4ac4-9bd9-6711e562cdf6 from instance d08e9187-ea68-44cd-8643-a7b1f2c6bcf5. Nov 01 12:24:32 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-3c5c0c70-83e7-4b5a-b3bf-4ee14fde9251 tempest-VolumesActionsTest-668469899 None] Detach volume completed successfully. Nov 01 12:24:32 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-3c5c0c70-83e7-4b5a-b3bf-4ee14fde9251 tempest-VolumesActionsTest-668469899 None] Lock "cinder-90e9c355-04c1-4ac4-9bd9-6711e562cdf6-detach_volume" released by "detach_volume" :: held 0.205s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:24:32 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6adece71-cb83-49d7-875c-5ea2a49929c8 tempest-VolumesActionsTest-1819912924 None] Acquiring lock "cinder-90e9c355-04c1-4ac4-9bd9-6711e562cdf6-detach_volume" by "detach_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:24:32 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6adece71-cb83-49d7-875c-5ea2a49929c8 tempest-VolumesActionsTest-1819912924 None] Lock "cinder-90e9c355-04c1-4ac4-9bd9-6711e562cdf6-detach_volume" acquired by "detach_volume" :: waited 0.038s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:24:32 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-6adece71-cb83-49d7-875c-5ea2a49929c8 tempest-VolumesActionsTest-1819912924 None] Volume detach called, but volume not attached. Nov 01 12:24:32 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6adece71-cb83-49d7-875c-5ea2a49929c8 tempest-VolumesActionsTest-1819912924 None] Lock "cinder-90e9c355-04c1-4ac4-9bd9-6711e562cdf6-detach_volume" released by "detach_volume" :: held 0.032s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:24:33 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-06af4616-72ca-483d-9916-6927a025d5fb tempest-VolumesActionsTest-1819912924 None] Acquiring lock "cinder-90e9c355-04c1-4ac4-9bd9-6711e562cdf6-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:24:33 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-06af4616-72ca-483d-9916-6927a025d5fb tempest-VolumesActionsTest-1819912924 None] Lock "cinder-90e9c355-04c1-4ac4-9bd9-6711e562cdf6-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:24:33 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-06af4616-72ca-483d-9916-6927a025d5fb tempest-VolumesActionsTest-1819912924 None] Acquiring lock "cinder-quobyte-90e9c355-04c1-4ac4-9bd9-6711e562cdf6" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:24:33 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-06af4616-72ca-483d-9916-6927a025d5fb tempest-VolumesActionsTest-1819912924 None] Lock "cinder-quobyte-90e9c355-04c1-4ac4-9bd9-6711e562cdf6" acquired by "delete_volume" :: waited 0.026s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:24:33 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f0e0110-36da-4b97-aa7b-164ffb7e8df7]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:24:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-06af4616-72ca-483d-9916-6927a025d5fb tempest-VolumesActionsTest-1819912924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-90e9c355-04c1-4ac4-9bd9-6711e562cdf6 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:33 devstack sudo[92224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-90e9c355-04c1-4ac4-9bd9-6711e562cdf6 Nov 01 12:24:33 devstack sudo[92224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:33 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-b40c7a01-b3bf-4c7d-861c-bdbe7ae0d047 req-86cac27d-c03f-42eb-8920-606cf631c6b0 tempest-AttachVolumeTestJSON-2012429887 None] Terminate volume connection completed successfully. Nov 01 12:24:33 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-b40c7a01-b3bf-4c7d-861c-bdbe7ae0d047 req-86cac27d-c03f-42eb-8920-606cf631c6b0 tempest-AttachVolumeTestJSON-2012429887 None] Deleting attachment 6acdbbef-e130-47c7-a95e-c42f9e4b7f27. {{(pid=86574) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 12:24:33 devstack sudo[92224]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-06af4616-72ca-483d-9916-6927a025d5fb tempest-VolumesActionsTest-1819912924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-90e9c355-04c1-4ac4-9bd9-6711e562cdf6" returned: 0 in 0.633s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-06af4616-72ca-483d-9916-6927a025d5fb tempest-VolumesActionsTest-1819912924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-90e9c355-04c1-4ac4-9bd9-6711e562cdf6 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:33 devstack sudo[92231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-90e9c355-04c1-4ac4-9bd9-6711e562cdf6 Nov 01 12:24:33 devstack sudo[92231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:34 devstack sudo[92231]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-06af4616-72ca-483d-9916-6927a025d5fb tempest-VolumesActionsTest-1819912924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-90e9c355-04c1-4ac4-9bd9-6711e562cdf6" returned: 0 in 0.403s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:34 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-06af4616-72ca-483d-9916-6927a025d5fb tempest-VolumesActionsTest-1819912924 None] Lock "cinder-quobyte-90e9c355-04c1-4ac4-9bd9-6711e562cdf6" released by "delete_volume" :: held 1.135s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:24:34 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-06af4616-72ca-483d-9916-6927a025d5fb tempest-VolumesActionsTest-1819912924 None] Created reservations ['81e01cab-1508-4164-ae41-f7a92bbf77d4', '1a74fc62-f608-4e52-8356-7e3ed2fe3f02', 'ee55e6a1-4e02-4875-ab9d-32dadee2fcf1', '14b086bf-66f2-4923-a5ef-87b5f8cc5047'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:24:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-06af4616-72ca-483d-9916-6927a025d5fb tempest-VolumesActionsTest-1819912924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-06af4616-72ca-483d-9916-6927a025d5fb tempest-VolumesActionsTest-1819912924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:34 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-06af4616-72ca-483d-9916-6927a025d5fb tempest-VolumesActionsTest-1819912924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:24:34 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-06af4616-72ca-483d-9916-6927a025d5fb tempest-VolumesActionsTest-1819912924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:24:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-06af4616-72ca-483d-9916-6927a025d5fb tempest-VolumesActionsTest-1819912924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-06af4616-72ca-483d-9916-6927a025d5fb tempest-VolumesActionsTest-1819912924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:34 devstack sudo[92235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:24:34 devstack sudo[92235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:34 devstack sudo[92235]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-06af4616-72ca-483d-9916-6927a025d5fb tempest-VolumesActionsTest-1819912924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.370s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:34 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-06af4616-72ca-483d-9916-6927a025d5fb tempest-VolumesActionsTest-1819912924 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:24:34 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-06af4616-72ca-483d-9916-6927a025d5fb tempest-VolumesActionsTest-1819912924 None] Deleted volume successfully. Nov 01 12:24:35 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-06af4616-72ca-483d-9916-6927a025d5fb tempest-VolumesActionsTest-1819912924 None] Lock "cinder-90e9c355-04c1-4ac4-9bd9-6711e562cdf6-delete_volume" released by "delete_volume" :: held 1.919s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:24:35 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-7381e343-2244-4e83-b6d9-5f854b170a30 req-21bc5379-b1ea-443e-9ae6-6c2a7d505153 tempest-AttachVolumeTestJSON-2012429887 None] Terminate volume connection completed successfully. Nov 01 12:24:35 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-7381e343-2244-4e83-b6d9-5f854b170a30 req-21bc5379-b1ea-443e-9ae6-6c2a7d505153 tempest-AttachVolumeTestJSON-2012429887 None] Deleting attachment 760e40db-95f2-46ce-b505-e7ad49050ca6. {{(pid=86574) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 12:24:36 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-8c1579b9-0c57-4ed8-bd17-dcf6f60a66c4 req-ad9a1fff-cf4d-472b-b90d-97064a104194 tempest-AttachVolumeNegativeTest-245012374 None] Terminate volume connection completed successfully. Nov 01 12:24:36 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-8c1579b9-0c57-4ed8-bd17-dcf6f60a66c4 req-ad9a1fff-cf4d-472b-b90d-97064a104194 tempest-AttachVolumeNegativeTest-245012374 None] Deleting attachment 26bfe721-5a48-4b82-be7c-d9756faac386. {{(pid=86574) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 12:24:39 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5bc1928-2839-4f86-b0cd-9c67881ae4a3 tempest-VolumesActionsTest-1819912924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:24:39 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b5bc1928-2839-4f86-b0cd-9c67881ae4a3 tempest-VolumesActionsTest-1819912924 None] Flow 'volume_create_manager' (b137f164-ec86-4c81-b4ef-42b14aab379d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:24:39 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b5bc1928-2839-4f86-b0cd-9c67881ae4a3 tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f0c8c0d-52f8-4c4f-a64b-8a6810a15d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:39 devstack cinder-volume[86574]: DEBUG oslo_service.periodic_task [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86574) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:24:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:24:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:24:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:39 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b5bc1928-2839-4f86-b0cd-9c67881ae4a3 tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f0c8c0d-52f8-4c4f-a64b-8a6810a15d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:24:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1518064395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c6cb175-f4f3-4a6c-b5aa-9678863ba2c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5cd945732ab40d48b81f8b28fba5d49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:24:40Z,use_quota=True,user_id='5814ea32a9b6456cbd80202cda2cdb14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:39 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b5bc1928-2839-4f86-b0cd-9c67881ae4a3 tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44a3ebcc-41a7-47eb-b09d-cad150176435) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:39 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b5bc1928-2839-4f86-b0cd-9c67881ae4a3 tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (44a3ebcc-41a7-47eb-b09d-cad150176435) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:39 devstack sudo[92320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:24:39 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b5bc1928-2839-4f86-b0cd-9c67881ae4a3 tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebc7876b-3cb1-4039-944f-1e69bdc637e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:39 devstack sudo[92320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:39 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b5bc1928-2839-4f86-b0cd-9c67881ae4a3 tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ebc7876b-3cb1-4039-944f-1e69bdc637e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1c6cb175-f4f3-4a6c-b5aa-9678863ba2c3', 'volume_name': 'volume-1c6cb175-f4f3-4a6c-b5aa-9678863ba2c3', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:39 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b5bc1928-2839-4f86-b0cd-9c67881ae4a3 tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78253a7c-44de-4ec4-9033-43032fa6c3e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:39 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b5bc1928-2839-4f86-b0cd-9c67881ae4a3 tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (78253a7c-44de-4ec4-9033-43032fa6c3e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:39 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b5bc1928-2839-4f86-b0cd-9c67881ae4a3 tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f52373e-7e86-45b0-9d31-3730ce4a34be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:39 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-b5bc1928-2839-4f86-b0cd-9c67881ae4a3 tempest-VolumesActionsTest-1819912924 None] Volume 1c6cb175-f4f3-4a6c-b5aa-9678863ba2c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1c6cb175-f4f3-4a6c-b5aa-9678863ba2c3', 'volume_size': 1} Nov 01 12:24:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b5bc1928-2839-4f86-b0cd-9c67881ae4a3 tempest-VolumesActionsTest-1819912924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b5bc1928-2839-4f86-b0cd-9c67881ae4a3 tempest-VolumesActionsTest-1819912924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-b5bc1928-2839-4f86-b0cd-9c67881ae4a3 tempest-VolumesActionsTest-1819912924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:24:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1518064395',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1c6cb175-f4f3-4a6c-b5aa-9678863ba2c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5cd945732ab40d48b81f8b28fba5d49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:24:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:24:40Z,use_quota=True,user_id='5814ea32a9b6456cbd80202cda2cdb14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:24:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-b5bc1928-2839-4f86-b0cd-9c67881ae4a3 tempest-VolumesActionsTest-1819912924 None] Creating volume 1c6cb175-f4f3-4a6c-b5aa-9678863ba2c3 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:24:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b5bc1928-2839-4f86-b0cd-9c67881ae4a3 tempest-VolumesActionsTest-1819912924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b5bc1928-2839-4f86-b0cd-9c67881ae4a3 tempest-VolumesActionsTest-1819912924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-b5bc1928-2839-4f86-b0cd-9c67881ae4a3 tempest-VolumesActionsTest-1819912924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:24:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-b5bc1928-2839-4f86-b0cd-9c67881ae4a3 tempest-VolumesActionsTest-1819912924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:24:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b5bc1928-2839-4f86-b0cd-9c67881ae4a3 tempest-VolumesActionsTest-1819912924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-b5bc1928-2839-4f86-b0cd-9c67881ae4a3 tempest-VolumesActionsTest-1819912924 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:24:39 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-b5bc1928-2839-4f86-b0cd-9c67881ae4a3 tempest-VolumesActionsTest-1819912924 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:24:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b5bc1928-2839-4f86-b0cd-9c67881ae4a3 tempest-VolumesActionsTest-1819912924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1c6cb175-f4f3-4a6c-b5aa-9678863ba2c3 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:39 devstack sudo[92323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1c6cb175-f4f3-4a6c-b5aa-9678863ba2c3 1073741824 Nov 01 12:24:39 devstack sudo[92323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:40 devstack sudo[92320]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.393s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:40 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:24:40 devstack cinder-volume[86574]: DEBUG oslo_service.periodic_task [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running periodic task VolumeManager._thread_info {{(pid=86574) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:24:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] thread count: 8 {{(pid=86574) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 12:24:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] thread info: [<_MainThread(MainThread, started 131331184930944)>, , , , , , , ] {{(pid=86574) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 12:24:40 devstack sudo[92323]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b5bc1928-2839-4f86-b0cd-9c67881ae4a3 tempest-VolumesActionsTest-1819912924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1c6cb175-f4f3-4a6c-b5aa-9678863ba2c3 1073741824" returned: 0 in 0.611s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b5bc1928-2839-4f86-b0cd-9c67881ae4a3 tempest-VolumesActionsTest-1819912924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1c6cb175-f4f3-4a6c-b5aa-9678863ba2c3 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:40 devstack sudo[92332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1c6cb175-f4f3-4a6c-b5aa-9678863ba2c3 Nov 01 12:24:40 devstack sudo[92332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:41 devstack sudo[92332]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b5bc1928-2839-4f86-b0cd-9c67881ae4a3 tempest-VolumesActionsTest-1819912924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1c6cb175-f4f3-4a6c-b5aa-9678863ba2c3" returned: 0 in 0.459s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:41 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-b5bc1928-2839-4f86-b0cd-9c67881ae4a3 tempest-VolumesActionsTest-1819912924 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:24:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b5bc1928-2839-4f86-b0cd-9c67881ae4a3 tempest-VolumesActionsTest-1819912924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.145s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b5bc1928-2839-4f86-b0cd-9c67881ae4a3 tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f52373e-7e86-45b0-9d31-3730ce4a34be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1c6cb175-f4f3-4a6c-b5aa-9678863ba2c3', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b5bc1928-2839-4f86-b0cd-9c67881ae4a3 tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e522d3f2-2b19-4357-91ee-ce40fee2c232) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:41 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-b5bc1928-2839-4f86-b0cd-9c67881ae4a3 tempest-VolumesActionsTest-1819912924 None] Volume volume-1c6cb175-f4f3-4a6c-b5aa-9678863ba2c3 (1c6cb175-f4f3-4a6c-b5aa-9678863ba2c3): created successfully Nov 01 12:24:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b5bc1928-2839-4f86-b0cd-9c67881ae4a3 tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e522d3f2-2b19-4357-91ee-ce40fee2c232) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b5bc1928-2839-4f86-b0cd-9c67881ae4a3 tempest-VolumesActionsTest-1819912924 None] Flow 'volume_create_manager' (b137f164-ec86-4c81-b4ef-42b14aab379d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:24:41 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-b5bc1928-2839-4f86-b0cd-9c67881ae4a3 tempest-VolumesActionsTest-1819912924 None] Created volume successfully. Nov 01 12:24:41 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-bdcb3cee-1f23-4aa4-b083-f609d3ef2a2f tempest-AttachVolumeTestJSON-2012429887 None] Acquiring lock "cinder-1ac4439c-b395-45af-8418-1af176debce4-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:24:41 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-bdcb3cee-1f23-4aa4-b083-f609d3ef2a2f tempest-AttachVolumeTestJSON-2012429887 None] Lock "cinder-1ac4439c-b395-45af-8418-1af176debce4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:24:42 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-8799e8f6-e43a-422b-8677-8f181d9d8c97 tempest-VolumesActionsTest-668469899 None] Acquiring lock "cinder-1c6cb175-f4f3-4a6c-b5aa-9678863ba2c3-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:24:42 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-bdcb3cee-1f23-4aa4-b083-f609d3ef2a2f tempest-AttachVolumeTestJSON-2012429887 None] Acquiring lock "cinder-quobyte-1ac4439c-b395-45af-8418-1af176debce4" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:24:42 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-bdcb3cee-1f23-4aa4-b083-f609d3ef2a2f tempest-AttachVolumeTestJSON-2012429887 None] Lock "cinder-quobyte-1ac4439c-b395-45af-8418-1af176debce4" acquired by "delete_volume" :: waited 0.018s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:24:42 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-8799e8f6-e43a-422b-8677-8f181d9d8c97 tempest-VolumesActionsTest-668469899 None] Lock "cinder-1c6cb175-f4f3-4a6c-b5aa-9678863ba2c3-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:24:42 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[1e967439-3a17-4a25-b299-82e14fcffdd6]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:24:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bdcb3cee-1f23-4aa4-b083-f609d3ef2a2f tempest-AttachVolumeTestJSON-2012429887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1ac4439c-b395-45af-8418-1af176debce4 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:42 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-8799e8f6-e43a-422b-8677-8f181d9d8c97 tempest-VolumesActionsTest-668469899 None] Acquiring lock "cinder-quobyte-1c6cb175-f4f3-4a6c-b5aa-9678863ba2c3" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:24:42 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-8799e8f6-e43a-422b-8677-8f181d9d8c97 tempest-VolumesActionsTest-668469899 None] Lock "cinder-quobyte-1c6cb175-f4f3-4a6c-b5aa-9678863ba2c3" acquired by "delete_volume" :: waited 0.024s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:24:42 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[beddf85b-5a7f-42d0-a05a-cee8fee904d9]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:24:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8799e8f6-e43a-422b-8677-8f181d9d8c97 tempest-VolumesActionsTest-668469899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1c6cb175-f4f3-4a6c-b5aa-9678863ba2c3 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:42 devstack sudo[92335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1ac4439c-b395-45af-8418-1af176debce4 Nov 01 12:24:42 devstack sudo[92335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:42 devstack sudo[92336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1c6cb175-f4f3-4a6c-b5aa-9678863ba2c3 Nov 01 12:24:42 devstack sudo[92336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:42 devstack sudo[92335]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bdcb3cee-1f23-4aa4-b083-f609d3ef2a2f tempest-AttachVolumeTestJSON-2012429887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1ac4439c-b395-45af-8418-1af176debce4" returned: 0 in 0.467s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bdcb3cee-1f23-4aa4-b083-f609d3ef2a2f tempest-AttachVolumeTestJSON-2012429887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1ac4439c-b395-45af-8418-1af176debce4 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:42 devstack sudo[92342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1ac4439c-b395-45af-8418-1af176debce4 Nov 01 12:24:42 devstack sudo[92342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:42 devstack sudo[92336]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8799e8f6-e43a-422b-8677-8f181d9d8c97 tempest-VolumesActionsTest-668469899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1c6cb175-f4f3-4a6c-b5aa-9678863ba2c3" returned: 0 in 0.515s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8799e8f6-e43a-422b-8677-8f181d9d8c97 tempest-VolumesActionsTest-668469899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1c6cb175-f4f3-4a6c-b5aa-9678863ba2c3 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:42 devstack sudo[92347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1c6cb175-f4f3-4a6c-b5aa-9678863ba2c3 Nov 01 12:24:42 devstack sudo[92347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:42 devstack sudo[92342]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bdcb3cee-1f23-4aa4-b083-f609d3ef2a2f tempest-AttachVolumeTestJSON-2012429887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1ac4439c-b395-45af-8418-1af176debce4" returned: 0 in 0.321s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:42 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-bdcb3cee-1f23-4aa4-b083-f609d3ef2a2f tempest-AttachVolumeTestJSON-2012429887 None] Lock "cinder-quobyte-1ac4439c-b395-45af-8418-1af176debce4" released by "delete_volume" :: held 0.852s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:24:42 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-bdcb3cee-1f23-4aa4-b083-f609d3ef2a2f tempest-AttachVolumeTestJSON-2012429887 None] Created reservations ['8b3cecc4-c448-4c1c-bba3-662573e23319', '6efaf05c-ddbe-446d-8b5e-8020dc51c237', 'e1ed24cd-2c03-4049-823a-a9ecd40a16af', '8fa3c80a-acbc-45b3-9134-6fcc5bfc74a6'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:24:43 devstack sudo[92347]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8799e8f6-e43a-422b-8677-8f181d9d8c97 tempest-VolumesActionsTest-668469899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1c6cb175-f4f3-4a6c-b5aa-9678863ba2c3" returned: 0 in 0.294s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:43 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-8799e8f6-e43a-422b-8677-8f181d9d8c97 tempest-VolumesActionsTest-668469899 None] Lock "cinder-quobyte-1c6cb175-f4f3-4a6c-b5aa-9678863ba2c3" released by "delete_volume" :: held 0.870s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:24:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-bdcb3cee-1f23-4aa4-b083-f609d3ef2a2f tempest-AttachVolumeTestJSON-2012429887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-bdcb3cee-1f23-4aa4-b083-f609d3ef2a2f tempest-AttachVolumeTestJSON-2012429887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:43 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-bdcb3cee-1f23-4aa4-b083-f609d3ef2a2f tempest-AttachVolumeTestJSON-2012429887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:24:43 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-bdcb3cee-1f23-4aa4-b083-f609d3ef2a2f tempest-AttachVolumeTestJSON-2012429887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:24:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-bdcb3cee-1f23-4aa4-b083-f609d3ef2a2f tempest-AttachVolumeTestJSON-2012429887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bdcb3cee-1f23-4aa4-b083-f609d3ef2a2f tempest-AttachVolumeTestJSON-2012429887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:43 devstack sudo[92351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:24:43 devstack sudo[92351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:43 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-8799e8f6-e43a-422b-8677-8f181d9d8c97 tempest-VolumesActionsTest-668469899 None] Created reservations ['4077bbcf-0974-48ca-a641-ce19843e092c', '1be0c16b-c10e-4ef7-9624-973f89357679', '9dab1532-8343-40e7-9fd8-db9f11feafa4', '210a85c9-66f5-4187-a8d9-b8c0a8f13f05'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:24:43 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-73241c64-6f45-4200-8c99-acc79c33992d tempest-AttachVolumeTestJSON-2012429887 None] Acquiring lock "cinder-fa01e09c-9f3f-4b8a-9529-0e4d59030af9-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:24:43 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-73241c64-6f45-4200-8c99-acc79c33992d tempest-AttachVolumeTestJSON-2012429887 None] Lock "cinder-fa01e09c-9f3f-4b8a-9529-0e4d59030af9-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:24:43 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-73241c64-6f45-4200-8c99-acc79c33992d tempest-AttachVolumeTestJSON-2012429887 None] Acquiring lock "cinder-quobyte-fa01e09c-9f3f-4b8a-9529-0e4d59030af9" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:24:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8799e8f6-e43a-422b-8677-8f181d9d8c97 tempest-VolumesActionsTest-668469899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8799e8f6-e43a-422b-8677-8f181d9d8c97 tempest-VolumesActionsTest-668469899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:43 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-8799e8f6-e43a-422b-8677-8f181d9d8c97 tempest-VolumesActionsTest-668469899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:24:43 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-8799e8f6-e43a-422b-8677-8f181d9d8c97 tempest-VolumesActionsTest-668469899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:24:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8799e8f6-e43a-422b-8677-8f181d9d8c97 tempest-VolumesActionsTest-668469899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8799e8f6-e43a-422b-8677-8f181d9d8c97 tempest-VolumesActionsTest-668469899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:43 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-73241c64-6f45-4200-8c99-acc79c33992d tempest-AttachVolumeTestJSON-2012429887 None] Lock "cinder-quobyte-fa01e09c-9f3f-4b8a-9529-0e4d59030af9" acquired by "delete_volume" :: waited 0.042s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:24:43 devstack sudo[92353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:24:43 devstack sudo[92353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:43 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[b57f9918-6c30-443e-a473-ee2ffa29456b]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:24:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-73241c64-6f45-4200-8c99-acc79c33992d tempest-AttachVolumeTestJSON-2012429887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa01e09c-9f3f-4b8a-9529-0e4d59030af9 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:43 devstack sudo[92351]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bdcb3cee-1f23-4aa4-b083-f609d3ef2a2f tempest-AttachVolumeTestJSON-2012429887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.371s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:43 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-bdcb3cee-1f23-4aa4-b083-f609d3ef2a2f tempest-AttachVolumeTestJSON-2012429887 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:24:43 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-bdcb3cee-1f23-4aa4-b083-f609d3ef2a2f tempest-AttachVolumeTestJSON-2012429887 None] Deleted volume successfully. Nov 01 12:24:43 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-bdcb3cee-1f23-4aa4-b083-f609d3ef2a2f tempest-AttachVolumeTestJSON-2012429887 None] Lock "cinder-1ac4439c-b395-45af-8418-1af176debce4-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:24:43 devstack sudo[92356]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa01e09c-9f3f-4b8a-9529-0e4d59030af9 Nov 01 12:24:43 devstack sudo[92356]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:43 devstack sudo[92353]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8799e8f6-e43a-422b-8677-8f181d9d8c97 tempest-VolumesActionsTest-668469899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.296s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:43 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-8799e8f6-e43a-422b-8677-8f181d9d8c97 tempest-VolumesActionsTest-668469899 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:24:43 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-8799e8f6-e43a-422b-8677-8f181d9d8c97 tempest-VolumesActionsTest-668469899 None] Deleted volume successfully. Nov 01 12:24:43 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-8799e8f6-e43a-422b-8677-8f181d9d8c97 tempest-VolumesActionsTest-668469899 None] Lock "cinder-1c6cb175-f4f3-4a6c-b5aa-9678863ba2c3-delete_volume" released by "delete_volume" :: held 1.659s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:24:43 devstack sudo[92356]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-73241c64-6f45-4200-8c99-acc79c33992d tempest-AttachVolumeTestJSON-2012429887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa01e09c-9f3f-4b8a-9529-0e4d59030af9" returned: 0 in 0.408s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-73241c64-6f45-4200-8c99-acc79c33992d tempest-AttachVolumeTestJSON-2012429887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa01e09c-9f3f-4b8a-9529-0e4d59030af9 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:43 devstack sudo[92362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa01e09c-9f3f-4b8a-9529-0e4d59030af9 Nov 01 12:24:43 devstack sudo[92362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:44 devstack sudo[92362]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-73241c64-6f45-4200-8c99-acc79c33992d tempest-AttachVolumeTestJSON-2012429887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa01e09c-9f3f-4b8a-9529-0e4d59030af9" returned: 0 in 0.262s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:44 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-73241c64-6f45-4200-8c99-acc79c33992d tempest-AttachVolumeTestJSON-2012429887 None] Lock "cinder-quobyte-fa01e09c-9f3f-4b8a-9529-0e4d59030af9" released by "delete_volume" :: held 0.725s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:24:44 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-73241c64-6f45-4200-8c99-acc79c33992d tempest-AttachVolumeTestJSON-2012429887 None] Created reservations ['7861f8b4-57a3-49b2-9b3d-34049b9014c4', '10241e89-0cf1-4d88-870f-6a0c5bfea98f', '9fe3e8fb-b641-4a61-be8e-f40bfa56ff73', '097dbf60-9309-41d5-9f4b-88ef608af987'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:24:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-73241c64-6f45-4200-8c99-acc79c33992d tempest-AttachVolumeTestJSON-2012429887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-73241c64-6f45-4200-8c99-acc79c33992d tempest-AttachVolumeTestJSON-2012429887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:44 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-73241c64-6f45-4200-8c99-acc79c33992d tempest-AttachVolumeTestJSON-2012429887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:24:44 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-73241c64-6f45-4200-8c99-acc79c33992d tempest-AttachVolumeTestJSON-2012429887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:24:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-73241c64-6f45-4200-8c99-acc79c33992d tempest-AttachVolumeTestJSON-2012429887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-73241c64-6f45-4200-8c99-acc79c33992d tempest-AttachVolumeTestJSON-2012429887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:44 devstack sudo[92367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:24:44 devstack sudo[92367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:44 devstack sudo[92367]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-73241c64-6f45-4200-8c99-acc79c33992d tempest-AttachVolumeTestJSON-2012429887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.335s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:44 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-73241c64-6f45-4200-8c99-acc79c33992d tempest-AttachVolumeTestJSON-2012429887 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:24:44 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-73241c64-6f45-4200-8c99-acc79c33992d tempest-AttachVolumeTestJSON-2012429887 None] Deleted volume successfully. Nov 01 12:24:44 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-88f5fd37-6bb9-42f6-a0c2-b1489acaba13 tempest-AttachVolumeTestJSON-2012429887 None] Acquiring lock "cinder-453c1c8a-2a14-4043-ae4f-320d720921a8-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:24:44 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-73241c64-6f45-4200-8c99-acc79c33992d tempest-AttachVolumeTestJSON-2012429887 None] Lock "cinder-fa01e09c-9f3f-4b8a-9529-0e4d59030af9-delete_volume" released by "delete_volume" :: held 1.384s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:24:44 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-88f5fd37-6bb9-42f6-a0c2-b1489acaba13 tempest-AttachVolumeTestJSON-2012429887 None] Lock "cinder-453c1c8a-2a14-4043-ae4f-320d720921a8-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:24:44 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-88f5fd37-6bb9-42f6-a0c2-b1489acaba13 tempest-AttachVolumeTestJSON-2012429887 None] Acquiring lock "cinder-quobyte-453c1c8a-2a14-4043-ae4f-320d720921a8" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:24:44 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-88f5fd37-6bb9-42f6-a0c2-b1489acaba13 tempest-AttachVolumeTestJSON-2012429887 None] Lock "cinder-quobyte-453c1c8a-2a14-4043-ae4f-320d720921a8" acquired by "delete_volume" :: waited 0.017s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:24:44 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff024f38-dd9f-48c5-9627-178bb0c1684b]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:24:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-88f5fd37-6bb9-42f6-a0c2-b1489acaba13 tempest-AttachVolumeTestJSON-2012429887 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-453c1c8a-2a14-4043-ae4f-320d720921a8 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:45 devstack sudo[92370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-453c1c8a-2a14-4043-ae4f-320d720921a8 Nov 01 12:24:45 devstack sudo[92370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:45 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-c1cf3bb5-7d5d-4d74-a4f9-601c5c10a7ce tempest-VolumesActionsTest-1819912924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:24:45 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c1cf3bb5-7d5d-4d74-a4f9-601c5c10a7ce tempest-VolumesActionsTest-1819912924 None] Flow 'volume_create_manager' (a7efab20-e532-4615-b8f8-262d4ab5cb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:24:45 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c1cf3bb5-7d5d-4d74-a4f9-601c5c10a7ce tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7085c67-1e5f-4885-a3ad-7ffeb057b538) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:45 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c1cf3bb5-7d5d-4d74-a4f9-601c5c10a7ce tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7085c67-1e5f-4885-a3ad-7ffeb057b538) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1424201799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=995b7235-e797-4efa-b725-7a56cd54b245,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5cd945732ab40d48b81f8b28fba5d49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:24:45Z,use_quota=True,user_id='5814ea32a9b6456cbd80202cda2cdb14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:45 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c1cf3bb5-7d5d-4d74-a4f9-601c5c10a7ce tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2b4eb1c-1513-4ba6-8592-3ebfe21bf8ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:45 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c1cf3bb5-7d5d-4d74-a4f9-601c5c10a7ce tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2b4eb1c-1513-4ba6-8592-3ebfe21bf8ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:45 devstack sudo[92370]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:45 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c1cf3bb5-7d5d-4d74-a4f9-601c5c10a7ce tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c91072e9-980b-4d7d-b269-541d7f951652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:45 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c1cf3bb5-7d5d-4d74-a4f9-601c5c10a7ce tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c91072e9-980b-4d7d-b269-541d7f951652) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '995b7235-e797-4efa-b725-7a56cd54b245', 'volume_name': 'volume-995b7235-e797-4efa-b725-7a56cd54b245', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:45 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c1cf3bb5-7d5d-4d74-a4f9-601c5c10a7ce tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81ff2115-8a35-43f7-b031-db5b0e240c23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:45 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c1cf3bb5-7d5d-4d74-a4f9-601c5c10a7ce tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (81ff2115-8a35-43f7-b031-db5b0e240c23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:45 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c1cf3bb5-7d5d-4d74-a4f9-601c5c10a7ce tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd700f06-7f21-487b-8d02-01539a7cc606) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:45 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-c1cf3bb5-7d5d-4d74-a4f9-601c5c10a7ce tempest-VolumesActionsTest-1819912924 None] Volume 995b7235-e797-4efa-b725-7a56cd54b245: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-995b7235-e797-4efa-b725-7a56cd54b245', 'volume_size': 1} Nov 01 12:24:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-c1cf3bb5-7d5d-4d74-a4f9-601c5c10a7ce tempest-VolumesActionsTest-1819912924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-c1cf3bb5-7d5d-4d74-a4f9-601c5c10a7ce tempest-VolumesActionsTest-1819912924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:45 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-c1cf3bb5-7d5d-4d74-a4f9-601c5c10a7ce tempest-VolumesActionsTest-1819912924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:24:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1424201799',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=995b7235-e797-4efa-b725-7a56cd54b245,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5cd945732ab40d48b81f8b28fba5d49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:24:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:24:45Z,use_quota=True,user_id='5814ea32a9b6456cbd80202cda2cdb14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:24:45 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-c1cf3bb5-7d5d-4d74-a4f9-601c5c10a7ce tempest-VolumesActionsTest-1819912924 None] Creating volume 995b7235-e797-4efa-b725-7a56cd54b245 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:24:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-c1cf3bb5-7d5d-4d74-a4f9-601c5c10a7ce tempest-VolumesActionsTest-1819912924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-c1cf3bb5-7d5d-4d74-a4f9-601c5c10a7ce tempest-VolumesActionsTest-1819912924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:45 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-c1cf3bb5-7d5d-4d74-a4f9-601c5c10a7ce tempest-VolumesActionsTest-1819912924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:24:45 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-c1cf3bb5-7d5d-4d74-a4f9-601c5c10a7ce tempest-VolumesActionsTest-1819912924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:24:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-c1cf3bb5-7d5d-4d74-a4f9-601c5c10a7ce tempest-VolumesActionsTest-1819912924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:45 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-c1cf3bb5-7d5d-4d74-a4f9-601c5c10a7ce tempest-VolumesActionsTest-1819912924 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:24:45 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-c1cf3bb5-7d5d-4d74-a4f9-601c5c10a7ce tempest-VolumesActionsTest-1819912924 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:24:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c1cf3bb5-7d5d-4d74-a4f9-601c5c10a7ce tempest-VolumesActionsTest-1819912924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-995b7235-e797-4efa-b725-7a56cd54b245 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-88f5fd37-6bb9-42f6-a0c2-b1489acaba13 tempest-AttachVolumeTestJSON-2012429887 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-453c1c8a-2a14-4043-ae4f-320d720921a8" returned: 0 in 0.661s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-88f5fd37-6bb9-42f6-a0c2-b1489acaba13 tempest-AttachVolumeTestJSON-2012429887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-453c1c8a-2a14-4043-ae4f-320d720921a8 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:45 devstack sudo[92379]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-995b7235-e797-4efa-b725-7a56cd54b245 1073741824 Nov 01 12:24:45 devstack sudo[92379]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:45 devstack sudo[92380]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-453c1c8a-2a14-4043-ae4f-320d720921a8 Nov 01 12:24:45 devstack sudo[92380]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:45 devstack sudo[92380]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-88f5fd37-6bb9-42f6-a0c2-b1489acaba13 tempest-AttachVolumeTestJSON-2012429887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-453c1c8a-2a14-4043-ae4f-320d720921a8" returned: 0 in 0.345s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:45 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-88f5fd37-6bb9-42f6-a0c2-b1489acaba13 tempest-AttachVolumeTestJSON-2012429887 None] Lock "cinder-quobyte-453c1c8a-2a14-4043-ae4f-320d720921a8" released by "delete_volume" :: held 1.092s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:24:45 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-88f5fd37-6bb9-42f6-a0c2-b1489acaba13 tempest-AttachVolumeTestJSON-2012429887 None] Created reservations ['20d812d6-4555-478e-a0ff-12c670f5240c', 'fcdf1b4c-a619-4007-a758-c217823dacc7', '2f5fbf32-b51a-405f-ba15-089f17edc63b', '4239213a-e7f8-495c-9c71-45e55035d943'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:24:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-88f5fd37-6bb9-42f6-a0c2-b1489acaba13 tempest-AttachVolumeTestJSON-2012429887 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-88f5fd37-6bb9-42f6-a0c2-b1489acaba13 tempest-AttachVolumeTestJSON-2012429887 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:46 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-88f5fd37-6bb9-42f6-a0c2-b1489acaba13 tempest-AttachVolumeTestJSON-2012429887 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:24:46 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-88f5fd37-6bb9-42f6-a0c2-b1489acaba13 tempest-AttachVolumeTestJSON-2012429887 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:24:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-88f5fd37-6bb9-42f6-a0c2-b1489acaba13 tempest-AttachVolumeTestJSON-2012429887 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-88f5fd37-6bb9-42f6-a0c2-b1489acaba13 tempest-AttachVolumeTestJSON-2012429887 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:46 devstack sudo[92397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:24:46 devstack sudo[92397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-94b9ac8f-1955-4618-b402-6a6fcacef872 req-ac2cdd36-b0d6-4e29-af4b-26d45b07779b tempest-ServerActionsTestOtherA-2064758512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:46 devstack sudo[92379]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c1cf3bb5-7d5d-4d74-a4f9-601c5c10a7ce tempest-VolumesActionsTest-1819912924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-995b7235-e797-4efa-b725-7a56cd54b245 1073741824" returned: 0 in 0.665s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c1cf3bb5-7d5d-4d74-a4f9-601c5c10a7ce tempest-VolumesActionsTest-1819912924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-995b7235-e797-4efa-b725-7a56cd54b245 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:46 devstack sudo[92399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-995b7235-e797-4efa-b725-7a56cd54b245 Nov 01 12:24:46 devstack sudo[92399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:46 devstack sudo[92397]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-88f5fd37-6bb9-42f6-a0c2-b1489acaba13 tempest-AttachVolumeTestJSON-2012429887 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.297s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:46 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-88f5fd37-6bb9-42f6-a0c2-b1489acaba13 tempest-AttachVolumeTestJSON-2012429887 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:24:46 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-88f5fd37-6bb9-42f6-a0c2-b1489acaba13 tempest-AttachVolumeTestJSON-2012429887 None] Deleted volume successfully. Nov 01 12:24:46 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-88f5fd37-6bb9-42f6-a0c2-b1489acaba13 tempest-AttachVolumeTestJSON-2012429887 None] Lock "cinder-453c1c8a-2a14-4043-ae4f-320d720921a8-delete_volume" released by "delete_volume" :: held 1.669s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:24:46 devstack sudo[92399]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c1cf3bb5-7d5d-4d74-a4f9-601c5c10a7ce tempest-VolumesActionsTest-1819912924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-995b7235-e797-4efa-b725-7a56cd54b245" returned: 0 in 0.274s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:46 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-c1cf3bb5-7d5d-4d74-a4f9-601c5c10a7ce tempest-VolumesActionsTest-1819912924 None] <== create_volume: return (994ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:24:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-c1cf3bb5-7d5d-4d74-a4f9-601c5c10a7ce tempest-VolumesActionsTest-1819912924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.996s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-94b9ac8f-1955-4618-b402-6a6fcacef872 req-ac2cdd36-b0d6-4e29-af4b-26d45b07779b tempest-ServerActionsTestOtherA-2064758512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.367s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c1cf3bb5-7d5d-4d74-a4f9-601c5c10a7ce tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd700f06-7f21-487b-8d02-01539a7cc606) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-995b7235-e797-4efa-b725-7a56cd54b245', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c1cf3bb5-7d5d-4d74-a4f9-601c5c10a7ce tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5394812b-048f-4bee-bc71-db5dd9c021de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-94b9ac8f-1955-4618-b402-6a6fcacef872 req-ac2cdd36-b0d6-4e29-af4b-26d45b07779b tempest-ServerActionsTestOtherA-2064758512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:46 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-c1cf3bb5-7d5d-4d74-a4f9-601c5c10a7ce tempest-VolumesActionsTest-1819912924 None] Volume volume-995b7235-e797-4efa-b725-7a56cd54b245 (995b7235-e797-4efa-b725-7a56cd54b245): created successfully Nov 01 12:24:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c1cf3bb5-7d5d-4d74-a4f9-601c5c10a7ce tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5394812b-048f-4bee-bc71-db5dd9c021de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c1cf3bb5-7d5d-4d74-a4f9-601c5c10a7ce tempest-VolumesActionsTest-1819912924 None] Flow 'volume_create_manager' (a7efab20-e532-4615-b8f8-262d4ab5cb25) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:24:46 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-c1cf3bb5-7d5d-4d74-a4f9-601c5c10a7ce tempest-VolumesActionsTest-1819912924 None] Created volume successfully. Nov 01 12:24:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-94b9ac8f-1955-4618-b402-6a6fcacef872 req-ac2cdd36-b0d6-4e29-af4b-26d45b07779b tempest-ServerActionsTestOtherA-2064758512 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb', 'name': 'volume-c8d23fa1-7cea-46a1-b22f-31e8dd59cdd5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5d6a67e4-de79-4126-bccf-2f0645f8e67b', 'enforce_multipath': True} {{(pid=86574) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 12:24:46 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-94b9ac8f-1955-4618-b402-6a6fcacef872 req-ac2cdd36-b0d6-4e29-af4b-26d45b07779b tempest-ServerActionsTestOtherA-2064758512 None] attachment_update completed successfully. Nov 01 12:24:47 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a6eac779-7ddd-46e0-b764-89355e1e3e14 tempest-VolumesActionsTest-668469899 None] Acquiring lock "cinder-995b7235-e797-4efa-b725-7a56cd54b245-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:24:47 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a6eac779-7ddd-46e0-b764-89355e1e3e14 tempest-VolumesActionsTest-668469899 None] Lock "cinder-995b7235-e797-4efa-b725-7a56cd54b245-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:24:47 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a6eac779-7ddd-46e0-b764-89355e1e3e14 tempest-VolumesActionsTest-668469899 None] Acquiring lock "cinder-quobyte-995b7235-e797-4efa-b725-7a56cd54b245" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:24:47 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a6eac779-7ddd-46e0-b764-89355e1e3e14 tempest-VolumesActionsTest-668469899 None] Lock "cinder-quobyte-995b7235-e797-4efa-b725-7a56cd54b245" acquired by "delete_volume" :: waited 0.023s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:24:47 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[70a7f913-b61c-4e6c-9542-d4caca9ec8b5]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:24:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a6eac779-7ddd-46e0-b764-89355e1e3e14 tempest-VolumesActionsTest-668469899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-995b7235-e797-4efa-b725-7a56cd54b245 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:47 devstack sudo[92822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-995b7235-e797-4efa-b725-7a56cd54b245 Nov 01 12:24:47 devstack sudo[92822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:48 devstack sudo[92822]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a6eac779-7ddd-46e0-b764-89355e1e3e14 tempest-VolumesActionsTest-668469899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-995b7235-e797-4efa-b725-7a56cd54b245" returned: 0 in 0.608s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a6eac779-7ddd-46e0-b764-89355e1e3e14 tempest-VolumesActionsTest-668469899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-995b7235-e797-4efa-b725-7a56cd54b245 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:48 devstack sudo[92828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-995b7235-e797-4efa-b725-7a56cd54b245 Nov 01 12:24:48 devstack sudo[92828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:48 devstack sudo[92828]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a6eac779-7ddd-46e0-b764-89355e1e3e14 tempest-VolumesActionsTest-668469899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-995b7235-e797-4efa-b725-7a56cd54b245" returned: 0 in 0.331s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:48 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a6eac779-7ddd-46e0-b764-89355e1e3e14 tempest-VolumesActionsTest-668469899 None] Lock "cinder-quobyte-995b7235-e797-4efa-b725-7a56cd54b245" released by "delete_volume" :: held 1.029s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:24:48 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-a6eac779-7ddd-46e0-b764-89355e1e3e14 tempest-VolumesActionsTest-668469899 None] Created reservations ['fea71224-d35b-4e49-b1fe-a621c3be9bc6', '5efdaab1-e890-4687-ab14-5adc7638692f', '3bda612d-8cea-4f8d-a81c-726bcb68e639', 'a7366ccf-62b3-49ca-bafc-0c56891373f5'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:24:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a6eac779-7ddd-46e0-b764-89355e1e3e14 tempest-VolumesActionsTest-668469899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a6eac779-7ddd-46e0-b764-89355e1e3e14 tempest-VolumesActionsTest-668469899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:49 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a6eac779-7ddd-46e0-b764-89355e1e3e14 tempest-VolumesActionsTest-668469899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:24:49 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a6eac779-7ddd-46e0-b764-89355e1e3e14 tempest-VolumesActionsTest-668469899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:24:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a6eac779-7ddd-46e0-b764-89355e1e3e14 tempest-VolumesActionsTest-668469899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a6eac779-7ddd-46e0-b764-89355e1e3e14 tempest-VolumesActionsTest-668469899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:49 devstack sudo[92832]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:24:49 devstack sudo[92832]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:49 devstack sudo[92832]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a6eac779-7ddd-46e0-b764-89355e1e3e14 tempest-VolumesActionsTest-668469899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.417s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:49 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-a6eac779-7ddd-46e0-b764-89355e1e3e14 tempest-VolumesActionsTest-668469899 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:24:49 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-a6eac779-7ddd-46e0-b764-89355e1e3e14 tempest-VolumesActionsTest-668469899 None] Deleted volume successfully. Nov 01 12:24:49 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a6eac779-7ddd-46e0-b764-89355e1e3e14 tempest-VolumesActionsTest-668469899 None] Lock "cinder-995b7235-e797-4efa-b725-7a56cd54b245-delete_volume" released by "delete_volume" :: held 1.831s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:24:50 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-c6976d90-4544-4c1f-b722-6180ecc2b397 req-9838ea29-b25e-4e2a-aeec-88f2645a22fa tempest-ServerActionsTestOtherA-2064758512 None] Terminate volume connection completed successfully. Nov 01 12:24:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-c6976d90-4544-4c1f-b722-6180ecc2b397 req-9838ea29-b25e-4e2a-aeec-88f2645a22fa tempest-ServerActionsTestOtherA-2064758512 None] Deleting attachment 5d6a67e4-de79-4126-bccf-2f0645f8e67b. {{(pid=86574) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 12:24:50 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-a98b3f42-1d2c-4cda-889c-a9f1473fddf0 tempest-VolumesActionsTest-1819912924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:24:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a98b3f42-1d2c-4cda-889c-a9f1473fddf0 tempest-VolumesActionsTest-1819912924 None] Flow 'volume_create_manager' (adedc31c-cc3c-468a-9147-dbd0847a216f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:24:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a98b3f42-1d2c-4cda-889c-a9f1473fddf0 tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a0d7368-2e6a-4daa-8a23-4235b3a63d95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a98b3f42-1d2c-4cda-889c-a9f1473fddf0 tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3a0d7368-2e6a-4daa-8a23-4235b3a63d95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1039392356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ff8784a-4870-4a41-a1d9-fc0c44cbfd62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5cd945732ab40d48b81f8b28fba5d49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:24:51Z,use_quota=True,user_id='5814ea32a9b6456cbd80202cda2cdb14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a98b3f42-1d2c-4cda-889c-a9f1473fddf0 tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a46988d6-4b35-4ad9-a7ec-b0fb46d6c0b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a98b3f42-1d2c-4cda-889c-a9f1473fddf0 tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a46988d6-4b35-4ad9-a7ec-b0fb46d6c0b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a98b3f42-1d2c-4cda-889c-a9f1473fddf0 tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d4efbc7-e01c-45e5-9d77-899891386cdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a98b3f42-1d2c-4cda-889c-a9f1473fddf0 tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d4efbc7-e01c-45e5-9d77-899891386cdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ff8784a-4870-4a41-a1d9-fc0c44cbfd62', 'volume_name': 'volume-7ff8784a-4870-4a41-a1d9-fc0c44cbfd62', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a98b3f42-1d2c-4cda-889c-a9f1473fddf0 tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecb1dfd4-246e-4439-b587-eb8ea36b7aa6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a98b3f42-1d2c-4cda-889c-a9f1473fddf0 tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ecb1dfd4-246e-4439-b587-eb8ea36b7aa6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:51 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a98b3f42-1d2c-4cda-889c-a9f1473fddf0 tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5339d8dd-b31d-47da-8bf8-6725cff21a41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:51 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-a98b3f42-1d2c-4cda-889c-a9f1473fddf0 tempest-VolumesActionsTest-1819912924 None] Volume 7ff8784a-4870-4a41-a1d9-fc0c44cbfd62: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ff8784a-4870-4a41-a1d9-fc0c44cbfd62', 'volume_size': 1} Nov 01 12:24:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a98b3f42-1d2c-4cda-889c-a9f1473fddf0 tempest-VolumesActionsTest-1819912924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a98b3f42-1d2c-4cda-889c-a9f1473fddf0 tempest-VolumesActionsTest-1819912924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:51 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a98b3f42-1d2c-4cda-889c-a9f1473fddf0 tempest-VolumesActionsTest-1819912924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:24:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1039392356',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ff8784a-4870-4a41-a1d9-fc0c44cbfd62,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5cd945732ab40d48b81f8b28fba5d49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:24:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:24:51Z,use_quota=True,user_id='5814ea32a9b6456cbd80202cda2cdb14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:24:51 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-a98b3f42-1d2c-4cda-889c-a9f1473fddf0 tempest-VolumesActionsTest-1819912924 None] Creating volume 7ff8784a-4870-4a41-a1d9-fc0c44cbfd62 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:24:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a98b3f42-1d2c-4cda-889c-a9f1473fddf0 tempest-VolumesActionsTest-1819912924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a98b3f42-1d2c-4cda-889c-a9f1473fddf0 tempest-VolumesActionsTest-1819912924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:51 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a98b3f42-1d2c-4cda-889c-a9f1473fddf0 tempest-VolumesActionsTest-1819912924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:24:51 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a98b3f42-1d2c-4cda-889c-a9f1473fddf0 tempest-VolumesActionsTest-1819912924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:24:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a98b3f42-1d2c-4cda-889c-a9f1473fddf0 tempest-VolumesActionsTest-1819912924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:51 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a98b3f42-1d2c-4cda-889c-a9f1473fddf0 tempest-VolumesActionsTest-1819912924 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:24:51 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-a98b3f42-1d2c-4cda-889c-a9f1473fddf0 tempest-VolumesActionsTest-1819912924 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:24:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a98b3f42-1d2c-4cda-889c-a9f1473fddf0 tempest-VolumesActionsTest-1819912924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7ff8784a-4870-4a41-a1d9-fc0c44cbfd62 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:51 devstack sudo[92893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7ff8784a-4870-4a41-a1d9-fc0c44cbfd62 1073741824 Nov 01 12:24:51 devstack sudo[92893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:51 devstack sudo[92893]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a98b3f42-1d2c-4cda-889c-a9f1473fddf0 tempest-VolumesActionsTest-1819912924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7ff8784a-4870-4a41-a1d9-fc0c44cbfd62 1073741824" returned: 0 in 0.711s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-c6976d90-4544-4c1f-b722-6180ecc2b397 req-b88313d8-06b2-408a-bdbd-2a2291b930fe tempest-ServerActionsTestOtherA-2064758512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a98b3f42-1d2c-4cda-889c-a9f1473fddf0 tempest-VolumesActionsTest-1819912924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7ff8784a-4870-4a41-a1d9-fc0c44cbfd62 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:51 devstack sudo[92919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7ff8784a-4870-4a41-a1d9-fc0c44cbfd62 Nov 01 12:24:51 devstack sudo[92919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:52 devstack sudo[92919]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a98b3f42-1d2c-4cda-889c-a9f1473fddf0 tempest-VolumesActionsTest-1819912924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7ff8784a-4870-4a41-a1d9-fc0c44cbfd62" returned: 0 in 0.264s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:52 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a98b3f42-1d2c-4cda-889c-a9f1473fddf0 tempest-VolumesActionsTest-1819912924 None] <== create_volume: return (1069ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:24:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a98b3f42-1d2c-4cda-889c-a9f1473fddf0 tempest-VolumesActionsTest-1819912924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.073s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-c6976d90-4544-4c1f-b722-6180ecc2b397 req-b88313d8-06b2-408a-bdbd-2a2291b930fe tempest-ServerActionsTestOtherA-2064758512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.290s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a98b3f42-1d2c-4cda-889c-a9f1473fddf0 tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5339d8dd-b31d-47da-8bf8-6725cff21a41) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ff8784a-4870-4a41-a1d9-fc0c44cbfd62', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a98b3f42-1d2c-4cda-889c-a9f1473fddf0 tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f31cd0e-00a9-4e1e-b57f-a61cf9c0d1f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-c6976d90-4544-4c1f-b722-6180ecc2b397 req-b88313d8-06b2-408a-bdbd-2a2291b930fe tempest-ServerActionsTestOtherA-2064758512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.038s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:52 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-a98b3f42-1d2c-4cda-889c-a9f1473fddf0 tempest-VolumesActionsTest-1819912924 None] Volume volume-7ff8784a-4870-4a41-a1d9-fc0c44cbfd62 (7ff8784a-4870-4a41-a1d9-fc0c44cbfd62): created successfully Nov 01 12:24:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a98b3f42-1d2c-4cda-889c-a9f1473fddf0 tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f31cd0e-00a9-4e1e-b57f-a61cf9c0d1f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a98b3f42-1d2c-4cda-889c-a9f1473fddf0 tempest-VolumesActionsTest-1819912924 None] Flow 'volume_create_manager' (adedc31c-cc3c-468a-9147-dbd0847a216f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:24:52 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-a98b3f42-1d2c-4cda-889c-a9f1473fddf0 tempest-VolumesActionsTest-1819912924 None] Created volume successfully. Nov 01 12:24:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-c6976d90-4544-4c1f-b722-6180ecc2b397 req-b88313d8-06b2-408a-bdbd-2a2291b930fe tempest-ServerActionsTestOtherA-2064758512 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb', 'name': 'volume-c8d23fa1-7cea-46a1-b22f-31e8dd59cdd5', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '65311274-a71a-4e68-b8bd-becfa7d97e3e', 'enforce_multipath': True} {{(pid=86574) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 12:24:52 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-c6976d90-4544-4c1f-b722-6180ecc2b397 req-b88313d8-06b2-408a-bdbd-2a2291b930fe tempest-ServerActionsTestOtherA-2064758512 None] attachment_update completed successfully. Nov 01 12:24:53 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-691a3106-6038-4c68-a375-387545be7382 tempest-VolumesActionsTest-668469899 None] Acquiring lock "cinder-7ff8784a-4870-4a41-a1d9-fc0c44cbfd62-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:24:53 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-691a3106-6038-4c68-a375-387545be7382 tempest-VolumesActionsTest-668469899 None] Lock "cinder-7ff8784a-4870-4a41-a1d9-fc0c44cbfd62-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:24:53 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-691a3106-6038-4c68-a375-387545be7382 tempest-VolumesActionsTest-668469899 None] Acquiring lock "cinder-quobyte-7ff8784a-4870-4a41-a1d9-fc0c44cbfd62" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:24:53 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-691a3106-6038-4c68-a375-387545be7382 tempest-VolumesActionsTest-668469899 None] Lock "cinder-quobyte-7ff8784a-4870-4a41-a1d9-fc0c44cbfd62" acquired by "delete_volume" :: waited 0.021s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:24:53 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[ca7dc207-5680-4a90-b6a8-0f93332c07fb]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:24:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-691a3106-6038-4c68-a375-387545be7382 tempest-VolumesActionsTest-668469899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7ff8784a-4870-4a41-a1d9-fc0c44cbfd62 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:53 devstack sudo[92930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7ff8784a-4870-4a41-a1d9-fc0c44cbfd62 Nov 01 12:24:53 devstack sudo[92930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:54 devstack sudo[92930]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-691a3106-6038-4c68-a375-387545be7382 tempest-VolumesActionsTest-668469899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7ff8784a-4870-4a41-a1d9-fc0c44cbfd62" returned: 0 in 0.835s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-691a3106-6038-4c68-a375-387545be7382 tempest-VolumesActionsTest-668469899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7ff8784a-4870-4a41-a1d9-fc0c44cbfd62 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:54 devstack sudo[92980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7ff8784a-4870-4a41-a1d9-fc0c44cbfd62 Nov 01 12:24:54 devstack sudo[92980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:54 devstack sudo[92980]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-691a3106-6038-4c68-a375-387545be7382 tempest-VolumesActionsTest-668469899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7ff8784a-4870-4a41-a1d9-fc0c44cbfd62" returned: 0 in 0.742s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:54 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-691a3106-6038-4c68-a375-387545be7382 tempest-VolumesActionsTest-668469899 None] Lock "cinder-quobyte-7ff8784a-4870-4a41-a1d9-fc0c44cbfd62" released by "delete_volume" :: held 1.645s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:24:54 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-691a3106-6038-4c68-a375-387545be7382 tempest-VolumesActionsTest-668469899 None] Created reservations ['085113f6-ba3f-45fa-8b9f-d32535622d93', 'a279fc29-c200-4994-ae97-1c89bd0fe731', 'd9c03ea6-fd97-47ef-ae18-09c408c10b56', '32263a8e-b3e9-45ec-a3ce-96aa3c298e06'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:24:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-691a3106-6038-4c68-a375-387545be7382 tempest-VolumesActionsTest-668469899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-691a3106-6038-4c68-a375-387545be7382 tempest-VolumesActionsTest-668469899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:55 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-691a3106-6038-4c68-a375-387545be7382 tempest-VolumesActionsTest-668469899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:24:55 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-691a3106-6038-4c68-a375-387545be7382 tempest-VolumesActionsTest-668469899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:24:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-691a3106-6038-4c68-a375-387545be7382 tempest-VolumesActionsTest-668469899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-691a3106-6038-4c68-a375-387545be7382 tempest-VolumesActionsTest-668469899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:55 devstack sudo[93324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:24:55 devstack sudo[93324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:55 devstack sudo[93324]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-691a3106-6038-4c68-a375-387545be7382 tempest-VolumesActionsTest-668469899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.608s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:55 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-691a3106-6038-4c68-a375-387545be7382 tempest-VolumesActionsTest-668469899 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:24:55 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-691a3106-6038-4c68-a375-387545be7382 tempest-VolumesActionsTest-668469899 None] Deleted volume successfully. Nov 01 12:24:55 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-691a3106-6038-4c68-a375-387545be7382 tempest-VolumesActionsTest-668469899 None] Lock "cinder-7ff8784a-4870-4a41-a1d9-fc0c44cbfd62-delete_volume" released by "delete_volume" :: held 2.665s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:24:56 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-57997946-6958-4553-b864-d5082ac2a0be tempest-VolumesActionsTest-1819912924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:24:56 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-57997946-6958-4553-b864-d5082ac2a0be tempest-VolumesActionsTest-1819912924 None] Flow 'volume_create_manager' (0f207bab-95fd-4812-bf0c-9c082a21679e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:24:56 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-57997946-6958-4553-b864-d5082ac2a0be tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (884a8fd4-3fd9-400c-ab8e-9f0576a9eb12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:56 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-57997946-6958-4553-b864-d5082ac2a0be tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (884a8fd4-3fd9-400c-ab8e-9f0576a9eb12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-439995951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b4f3c22-9a27-4f34-9049-fb38883fcdf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5cd945732ab40d48b81f8b28fba5d49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:24:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:24:57Z,use_quota=True,user_id='5814ea32a9b6456cbd80202cda2cdb14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:56 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-57997946-6958-4553-b864-d5082ac2a0be tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (649a35b4-39f0-490c-937e-5320c656a863) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:56 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-57997946-6958-4553-b864-d5082ac2a0be tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (649a35b4-39f0-490c-937e-5320c656a863) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:56 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-57997946-6958-4553-b864-d5082ac2a0be tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dafc80f-a57e-4a40-bf56-154a285fbdb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:56 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-57997946-6958-4553-b864-d5082ac2a0be tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dafc80f-a57e-4a40-bf56-154a285fbdb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b4f3c22-9a27-4f34-9049-fb38883fcdf5', 'volume_name': 'volume-4b4f3c22-9a27-4f34-9049-fb38883fcdf5', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:56 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-57997946-6958-4553-b864-d5082ac2a0be tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93f541c9-5ca3-42b2-b66a-f7acf88220d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:56 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-57997946-6958-4553-b864-d5082ac2a0be tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (93f541c9-5ca3-42b2-b66a-f7acf88220d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:56 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-57997946-6958-4553-b864-d5082ac2a0be tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cd86ac0-c247-4679-a087-0a9608d90788) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:56 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-57997946-6958-4553-b864-d5082ac2a0be tempest-VolumesActionsTest-1819912924 None] Volume 4b4f3c22-9a27-4f34-9049-fb38883fcdf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b4f3c22-9a27-4f34-9049-fb38883fcdf5', 'volume_size': 1} Nov 01 12:24:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-57997946-6958-4553-b864-d5082ac2a0be tempest-VolumesActionsTest-1819912924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-57997946-6958-4553-b864-d5082ac2a0be tempest-VolumesActionsTest-1819912924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:56 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-57997946-6958-4553-b864-d5082ac2a0be tempest-VolumesActionsTest-1819912924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:24:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-439995951',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b4f3c22-9a27-4f34-9049-fb38883fcdf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5cd945732ab40d48b81f8b28fba5d49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:24:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:24:57Z,use_quota=True,user_id='5814ea32a9b6456cbd80202cda2cdb14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:24:56 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-57997946-6958-4553-b864-d5082ac2a0be tempest-VolumesActionsTest-1819912924 None] Creating volume 4b4f3c22-9a27-4f34-9049-fb38883fcdf5 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:24:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-57997946-6958-4553-b864-d5082ac2a0be tempest-VolumesActionsTest-1819912924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:24:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-57997946-6958-4553-b864-d5082ac2a0be tempest-VolumesActionsTest-1819912924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:24:56 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-57997946-6958-4553-b864-d5082ac2a0be tempest-VolumesActionsTest-1819912924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:24:56 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-57997946-6958-4553-b864-d5082ac2a0be tempest-VolumesActionsTest-1819912924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:24:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-57997946-6958-4553-b864-d5082ac2a0be tempest-VolumesActionsTest-1819912924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:56 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-57997946-6958-4553-b864-d5082ac2a0be tempest-VolumesActionsTest-1819912924 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:24:56 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-57997946-6958-4553-b864-d5082ac2a0be tempest-VolumesActionsTest-1819912924 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:24:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-57997946-6958-4553-b864-d5082ac2a0be tempest-VolumesActionsTest-1819912924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4b4f3c22-9a27-4f34-9049-fb38883fcdf5 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:56 devstack sudo[93468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4b4f3c22-9a27-4f34-9049-fb38883fcdf5 1073741824 Nov 01 12:24:56 devstack sudo[93468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:57 devstack sudo[93468]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-57997946-6958-4553-b864-d5082ac2a0be tempest-VolumesActionsTest-1819912924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4b4f3c22-9a27-4f34-9049-fb38883fcdf5 1073741824" returned: 0 in 1.303s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-57997946-6958-4553-b864-d5082ac2a0be tempest-VolumesActionsTest-1819912924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4b4f3c22-9a27-4f34-9049-fb38883fcdf5 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:24:58 devstack sudo[93479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4b4f3c22-9a27-4f34-9049-fb38883fcdf5 Nov 01 12:24:58 devstack sudo[93479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:24:58 devstack sudo[93479]: pam_unix(sudo:session): session closed for user root Nov 01 12:24:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-57997946-6958-4553-b864-d5082ac2a0be tempest-VolumesActionsTest-1819912924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4b4f3c22-9a27-4f34-9049-fb38883fcdf5" returned: 0 in 0.474s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:24:58 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-57997946-6958-4553-b864-d5082ac2a0be tempest-VolumesActionsTest-1819912924 None] <== create_volume: return (1945ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:24:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-57997946-6958-4553-b864-d5082ac2a0be tempest-VolumesActionsTest-1819912924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.947s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:24:58 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-57997946-6958-4553-b864-d5082ac2a0be tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2cd86ac0-c247-4679-a087-0a9608d90788) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b4f3c22-9a27-4f34-9049-fb38883fcdf5', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:58 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-57997946-6958-4553-b864-d5082ac2a0be tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2822c3ec-0429-41e4-85e2-1568d409a390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:24:58 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-57997946-6958-4553-b864-d5082ac2a0be tempest-VolumesActionsTest-1819912924 None] Volume volume-4b4f3c22-9a27-4f34-9049-fb38883fcdf5 (4b4f3c22-9a27-4f34-9049-fb38883fcdf5): created successfully Nov 01 12:24:58 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-57997946-6958-4553-b864-d5082ac2a0be tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2822c3ec-0429-41e4-85e2-1568d409a390) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:24:58 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-57997946-6958-4553-b864-d5082ac2a0be tempest-VolumesActionsTest-1819912924 None] Flow 'volume_create_manager' (0f207bab-95fd-4812-bf0c-9c082a21679e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:24:58 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-57997946-6958-4553-b864-d5082ac2a0be tempest-VolumesActionsTest-1819912924 None] Created volume successfully. Nov 01 12:25:00 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-73059167-b221-4683-bf12-61e91c7b49e8 tempest-VolumesActionsTest-668469899 None] Acquiring lock "cinder-4b4f3c22-9a27-4f34-9049-fb38883fcdf5-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:25:00 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-73059167-b221-4683-bf12-61e91c7b49e8 tempest-VolumesActionsTest-668469899 None] Lock "cinder-4b4f3c22-9a27-4f34-9049-fb38883fcdf5-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:25:00 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-73059167-b221-4683-bf12-61e91c7b49e8 tempest-VolumesActionsTest-668469899 None] Acquiring lock "cinder-quobyte-4b4f3c22-9a27-4f34-9049-fb38883fcdf5" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:25:00 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-73059167-b221-4683-bf12-61e91c7b49e8 tempest-VolumesActionsTest-668469899 None] Lock "cinder-quobyte-4b4f3c22-9a27-4f34-9049-fb38883fcdf5" acquired by "delete_volume" :: waited 0.056s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:25:00 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a99d85c-80a3-4e47-b07a-1ba1c59ae74d]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:25:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-73059167-b221-4683-bf12-61e91c7b49e8 tempest-VolumesActionsTest-668469899 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4b4f3c22-9a27-4f34-9049-fb38883fcdf5 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:00 devstack sudo[93637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4b4f3c22-9a27-4f34-9049-fb38883fcdf5 Nov 01 12:25:00 devstack sudo[93637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:01 devstack sudo[93637]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-73059167-b221-4683-bf12-61e91c7b49e8 tempest-VolumesActionsTest-668469899 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4b4f3c22-9a27-4f34-9049-fb38883fcdf5" returned: 0 in 0.671s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-73059167-b221-4683-bf12-61e91c7b49e8 tempest-VolumesActionsTest-668469899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4b4f3c22-9a27-4f34-9049-fb38883fcdf5 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:01 devstack sudo[93801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4b4f3c22-9a27-4f34-9049-fb38883fcdf5 Nov 01 12:25:01 devstack sudo[93801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:01 devstack sudo[93801]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-73059167-b221-4683-bf12-61e91c7b49e8 tempest-VolumesActionsTest-668469899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4b4f3c22-9a27-4f34-9049-fb38883fcdf5" returned: 0 in 0.578s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:01 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-73059167-b221-4683-bf12-61e91c7b49e8 tempest-VolumesActionsTest-668469899 None] Lock "cinder-quobyte-4b4f3c22-9a27-4f34-9049-fb38883fcdf5" released by "delete_volume" :: held 1.389s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:25:01 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-73059167-b221-4683-bf12-61e91c7b49e8 tempest-VolumesActionsTest-668469899 None] Created reservations ['4e185e6d-34ea-4b15-89c4-40424acf7ce1', '9be64758-38a2-4dd6-bab3-8adb44afe9c5', '14fcacc9-e07d-4672-b770-6d0b7c6e4dc5', 'dba55cbf-72bb-43b5-a030-e3284dea0deb'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:25:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-73059167-b221-4683-bf12-61e91c7b49e8 tempest-VolumesActionsTest-668469899 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:25:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-73059167-b221-4683-bf12-61e91c7b49e8 tempest-VolumesActionsTest-668469899 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:25:02 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-73059167-b221-4683-bf12-61e91c7b49e8 tempest-VolumesActionsTest-668469899 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:25:02 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-73059167-b221-4683-bf12-61e91c7b49e8 tempest-VolumesActionsTest-668469899 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:25:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-73059167-b221-4683-bf12-61e91c7b49e8 tempest-VolumesActionsTest-668469899 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:25:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-73059167-b221-4683-bf12-61e91c7b49e8 tempest-VolumesActionsTest-668469899 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:02 devstack sudo[93825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:25:02 devstack sudo[93825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:02 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-539faf5a-7946-41be-9034-71614302a14e tempest-GroupSnapshotsTest-1246896825 None] Group tempest-GroupSnapshotsTest-Group-626328619: creating Nov 01 12:25:02 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-539faf5a-7946-41be-9034-71614302a14e tempest-GroupSnapshotsTest-1246896825 None] Group tempest-GroupSnapshotsTest-Group-626328619: created successfully Nov 01 12:25:02 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-539faf5a-7946-41be-9034-71614302a14e tempest-GroupSnapshotsTest-1246896825 None] Create group completed successfully. Nov 01 12:25:02 devstack sudo[93825]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-73059167-b221-4683-bf12-61e91c7b49e8 tempest-VolumesActionsTest-668469899 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.429s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:02 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-73059167-b221-4683-bf12-61e91c7b49e8 tempest-VolumesActionsTest-668469899 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:25:02 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-73059167-b221-4683-bf12-61e91c7b49e8 tempest-VolumesActionsTest-668469899 None] Deleted volume successfully. Nov 01 12:25:02 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-73059167-b221-4683-bf12-61e91c7b49e8 tempest-VolumesActionsTest-668469899 None] Lock "cinder-4b4f3c22-9a27-4f34-9049-fb38883fcdf5-delete_volume" released by "delete_volume" :: held 2.329s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:25:03 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-b4f3def5-1510-4958-989d-ed64f786392b tempest-VolumesActionsTest-1819912924 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:25:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b4f3def5-1510-4958-989d-ed64f786392b tempest-VolumesActionsTest-1819912924 None] Flow 'volume_create_manager' (d2acdff4-67bb-4990-91ce-a4dc87c0a9bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:25:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b4f3def5-1510-4958-989d-ed64f786392b tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba5cce02-811f-421b-93c7-1a7239b007bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b4f3def5-1510-4958-989d-ed64f786392b tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ba5cce02-811f-421b-93c7-1a7239b007bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-463007842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b6f8328-5875-468a-9bc2-4776e91cf0e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5cd945732ab40d48b81f8b28fba5d49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:25:03Z,use_quota=True,user_id='5814ea32a9b6456cbd80202cda2cdb14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b4f3def5-1510-4958-989d-ed64f786392b tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b03be877-e61a-4c90-9f65-f39cbce0c611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b4f3def5-1510-4958-989d-ed64f786392b tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b03be877-e61a-4c90-9f65-f39cbce0c611) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b4f3def5-1510-4958-989d-ed64f786392b tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3c7ee72-b3c7-4cd8-94c6-99e55a307bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b4f3def5-1510-4958-989d-ed64f786392b tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b3c7ee72-b3c7-4cd8-94c6-99e55a307bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3b6f8328-5875-468a-9bc2-4776e91cf0e4', 'volume_name': 'volume-3b6f8328-5875-468a-9bc2-4776e91cf0e4', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b4f3def5-1510-4958-989d-ed64f786392b tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (badf99c4-430c-4f3d-bfe8-56e46e14972b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b4f3def5-1510-4958-989d-ed64f786392b tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (badf99c4-430c-4f3d-bfe8-56e46e14972b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b4f3def5-1510-4958-989d-ed64f786392b tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ce96395-c589-4e6e-a6c2-6337ed58c087) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:03 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-b4f3def5-1510-4958-989d-ed64f786392b tempest-VolumesActionsTest-1819912924 None] Volume 3b6f8328-5875-468a-9bc2-4776e91cf0e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3b6f8328-5875-468a-9bc2-4776e91cf0e4', 'volume_size': 1} Nov 01 12:25:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b4f3def5-1510-4958-989d-ed64f786392b tempest-VolumesActionsTest-1819912924 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:25:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b4f3def5-1510-4958-989d-ed64f786392b tempest-VolumesActionsTest-1819912924 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:25:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-b4f3def5-1510-4958-989d-ed64f786392b tempest-VolumesActionsTest-1819912924 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:25:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-463007842',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b6f8328-5875-468a-9bc2-4776e91cf0e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a5cd945732ab40d48b81f8b28fba5d49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:25:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:25:03Z,use_quota=True,user_id='5814ea32a9b6456cbd80202cda2cdb14',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:25:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-b4f3def5-1510-4958-989d-ed64f786392b tempest-VolumesActionsTest-1819912924 None] Creating volume 3b6f8328-5875-468a-9bc2-4776e91cf0e4 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:25:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b4f3def5-1510-4958-989d-ed64f786392b tempest-VolumesActionsTest-1819912924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:25:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b4f3def5-1510-4958-989d-ed64f786392b tempest-VolumesActionsTest-1819912924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:25:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-b4f3def5-1510-4958-989d-ed64f786392b tempest-VolumesActionsTest-1819912924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:25:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-b4f3def5-1510-4958-989d-ed64f786392b tempest-VolumesActionsTest-1819912924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:25:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b4f3def5-1510-4958-989d-ed64f786392b tempest-VolumesActionsTest-1819912924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:25:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-b4f3def5-1510-4958-989d-ed64f786392b tempest-VolumesActionsTest-1819912924 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:25:03 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-b4f3def5-1510-4958-989d-ed64f786392b tempest-VolumesActionsTest-1819912924 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:25:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b4f3def5-1510-4958-989d-ed64f786392b tempest-VolumesActionsTest-1819912924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3b6f8328-5875-468a-9bc2-4776e91cf0e4 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:03 devstack sudo[93829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3b6f8328-5875-468a-9bc2-4776e91cf0e4 1073741824 Nov 01 12:25:03 devstack sudo[93829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:03 devstack sudo[93829]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b4f3def5-1510-4958-989d-ed64f786392b tempest-VolumesActionsTest-1819912924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3b6f8328-5875-468a-9bc2-4776e91cf0e4 1073741824" returned: 0 in 0.528s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b4f3def5-1510-4958-989d-ed64f786392b tempest-VolumesActionsTest-1819912924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3b6f8328-5875-468a-9bc2-4776e91cf0e4 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:04 devstack sudo[93836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3b6f8328-5875-468a-9bc2-4776e91cf0e4 Nov 01 12:25:04 devstack sudo[93836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:04 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bceab44-06a0-4ac5-9aab-d203517fef3b tempest-GroupSnapshotsTest-1246896825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:25:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0bceab44-06a0-4ac5-9aab-d203517fef3b tempest-GroupSnapshotsTest-1246896825 None] Flow 'volume_create_manager' (5337edba-9c6c-4961-8a81-cc32039bc4fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:25:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0bceab44-06a0-4ac5-9aab-d203517fef3b tempest-GroupSnapshotsTest-1246896825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abb97507-e9e8-43cc-87bf-998232590960) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0bceab44-06a0-4ac5-9aab-d203517fef3b tempest-GroupSnapshotsTest-1246896825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abb97507-e9e8-43cc-87bf-998232590960) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2051594712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4eb48709-6b15-462e-84a8-c91b01612653,host='devstack@QuobyteHD#QuobyteHD',id=0a776822-1c62-40e1-816e-bddf6fe2f672,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4fc678ab60641eca0ae492c65b6be49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:25:04Z,use_quota=True,user_id='b04fe47e77f14940b3f73a971b0e2339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef726aa5-63ce-447c-9942-ce07265f8045),volume_type_id=ef726aa5-63ce-447c-9942-ce07265f8045)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:04 devstack sudo[93836]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0bceab44-06a0-4ac5-9aab-d203517fef3b tempest-GroupSnapshotsTest-1246896825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de98bc75-4271-4a91-b146-51cc6046af8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0bceab44-06a0-4ac5-9aab-d203517fef3b tempest-GroupSnapshotsTest-1246896825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de98bc75-4271-4a91-b146-51cc6046af8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0bceab44-06a0-4ac5-9aab-d203517fef3b tempest-GroupSnapshotsTest-1246896825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb0a99f6-17c3-4c13-b3ec-cf932b23f7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0bceab44-06a0-4ac5-9aab-d203517fef3b tempest-GroupSnapshotsTest-1246896825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb0a99f6-17c3-4c13-b3ec-cf932b23f7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a776822-1c62-40e1-816e-bddf6fe2f672', 'volume_name': 'volume-0a776822-1c62-40e1-816e-bddf6fe2f672', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0bceab44-06a0-4ac5-9aab-d203517fef3b tempest-GroupSnapshotsTest-1246896825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1873335-23e3-43d5-8794-0e3a1e3c65ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0bceab44-06a0-4ac5-9aab-d203517fef3b tempest-GroupSnapshotsTest-1246896825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f1873335-23e3-43d5-8794-0e3a1e3c65ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0bceab44-06a0-4ac5-9aab-d203517fef3b tempest-GroupSnapshotsTest-1246896825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9a3379d-0699-43ac-bbd2-b81cc138be3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:04 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-0bceab44-06a0-4ac5-9aab-d203517fef3b tempest-GroupSnapshotsTest-1246896825 None] Volume 0a776822-1c62-40e1-816e-bddf6fe2f672: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a776822-1c62-40e1-816e-bddf6fe2f672', 'volume_size': 1} Nov 01 12:25:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0bceab44-06a0-4ac5-9aab-d203517fef3b tempest-GroupSnapshotsTest-1246896825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:25:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b4f3def5-1510-4958-989d-ed64f786392b tempest-VolumesActionsTest-1819912924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3b6f8328-5875-468a-9bc2-4776e91cf0e4" returned: 0 in 0.515s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:04 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-b4f3def5-1510-4958-989d-ed64f786392b tempest-VolumesActionsTest-1819912924 None] <== create_volume: return (1132ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:25:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b4f3def5-1510-4958-989d-ed64f786392b tempest-VolumesActionsTest-1819912924 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.135s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:25:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0bceab44-06a0-4ac5-9aab-d203517fef3b tempest-GroupSnapshotsTest-1246896825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:25:04 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-0bceab44-06a0-4ac5-9aab-d203517fef3b tempest-GroupSnapshotsTest-1246896825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=4eb48709-6b15-462e-84a8-c91b01612653,created_at=2026-11-01T11:25:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-2051594712',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=4eb48709-6b15-462e-84a8-c91b01612653,host='devstack@QuobyteHD#QuobyteHD',id=0a776822-1c62-40e1-816e-bddf6fe2f672,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4fc678ab60641eca0ae492c65b6be49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:25:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:25:04Z,use_quota=True,user_id='b04fe47e77f14940b3f73a971b0e2339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(ef726aa5-63ce-447c-9942-ce07265f8045),volume_type_id=ef726aa5-63ce-447c-9942-ce07265f8045)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:25:04 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-0bceab44-06a0-4ac5-9aab-d203517fef3b tempest-GroupSnapshotsTest-1246896825 None] Creating volume 0a776822-1c62-40e1-816e-bddf6fe2f672 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:25:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0bceab44-06a0-4ac5-9aab-d203517fef3b tempest-GroupSnapshotsTest-1246896825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:25:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0bceab44-06a0-4ac5-9aab-d203517fef3b tempest-GroupSnapshotsTest-1246896825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:25:04 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-0bceab44-06a0-4ac5-9aab-d203517fef3b tempest-GroupSnapshotsTest-1246896825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:25:04 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-0bceab44-06a0-4ac5-9aab-d203517fef3b tempest-GroupSnapshotsTest-1246896825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:25:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0bceab44-06a0-4ac5-9aab-d203517fef3b tempest-GroupSnapshotsTest-1246896825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:25:04 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-0bceab44-06a0-4ac5-9aab-d203517fef3b tempest-GroupSnapshotsTest-1246896825 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:25:04 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-0bceab44-06a0-4ac5-9aab-d203517fef3b tempest-GroupSnapshotsTest-1246896825 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:25:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0bceab44-06a0-4ac5-9aab-d203517fef3b tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:04 devstack sudo[93839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672 1073741824 Nov 01 12:25:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b4f3def5-1510-4958-989d-ed64f786392b tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ce96395-c589-4e6e-a6c2-6337ed58c087) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b6f8328-5875-468a-9bc2-4776e91cf0e4', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:04 devstack sudo[93839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b4f3def5-1510-4958-989d-ed64f786392b tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e97e2f4-4801-4756-a6bd-77e36492cdc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:04 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-b4f3def5-1510-4958-989d-ed64f786392b tempest-VolumesActionsTest-1819912924 None] Volume volume-3b6f8328-5875-468a-9bc2-4776e91cf0e4 (3b6f8328-5875-468a-9bc2-4776e91cf0e4): created successfully Nov 01 12:25:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b4f3def5-1510-4958-989d-ed64f786392b tempest-VolumesActionsTest-1819912924 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0e97e2f4-4801-4756-a6bd-77e36492cdc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b4f3def5-1510-4958-989d-ed64f786392b tempest-VolumesActionsTest-1819912924 None] Flow 'volume_create_manager' (d2acdff4-67bb-4990-91ce-a4dc87c0a9bc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:25:04 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-b4f3def5-1510-4958-989d-ed64f786392b tempest-VolumesActionsTest-1819912924 None] Created volume successfully. Nov 01 12:25:05 devstack sudo[93839]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0bceab44-06a0-4ac5-9aab-d203517fef3b tempest-GroupSnapshotsTest-1246896825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672 1073741824" returned: 0 in 0.486s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0bceab44-06a0-4ac5-9aab-d203517fef3b tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:05 devstack sudo[93846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672 Nov 01 12:25:05 devstack sudo[93846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:05 devstack sudo[93846]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0bceab44-06a0-4ac5-9aab-d203517fef3b tempest-GroupSnapshotsTest-1246896825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672" returned: 0 in 0.291s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:05 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-0bceab44-06a0-4ac5-9aab-d203517fef3b tempest-GroupSnapshotsTest-1246896825 None] <== create_volume: return (846ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:25:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0bceab44-06a0-4ac5-9aab-d203517fef3b tempest-GroupSnapshotsTest-1246896825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.848s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:25:05 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0bceab44-06a0-4ac5-9aab-d203517fef3b tempest-GroupSnapshotsTest-1246896825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c9a3379d-0699-43ac-bbd2-b81cc138be3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a776822-1c62-40e1-816e-bddf6fe2f672', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:05 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0bceab44-06a0-4ac5-9aab-d203517fef3b tempest-GroupSnapshotsTest-1246896825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c94d8f8-cc08-431e-a076-422ae87183a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:05 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-0bceab44-06a0-4ac5-9aab-d203517fef3b tempest-GroupSnapshotsTest-1246896825 None] Volume volume-0a776822-1c62-40e1-816e-bddf6fe2f672 (0a776822-1c62-40e1-816e-bddf6fe2f672): created successfully Nov 01 12:25:05 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0bceab44-06a0-4ac5-9aab-d203517fef3b tempest-GroupSnapshotsTest-1246896825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5c94d8f8-cc08-431e-a076-422ae87183a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:05 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0bceab44-06a0-4ac5-9aab-d203517fef3b tempest-GroupSnapshotsTest-1246896825 None] Flow 'volume_create_manager' (5337edba-9c6c-4961-8a81-cc32039bc4fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:25:05 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-0bceab44-06a0-4ac5-9aab-d203517fef3b tempest-GroupSnapshotsTest-1246896825 None] Created volume successfully. Nov 01 12:25:06 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-a1670022-c07c-4952-9a83-435149a95279 tempest-GroupSnapshotsTest-1246896825 None] GroupSnapshot 8cfaa564-6b42-4e07-9884-bf84291688bf: creating. Nov 01 12:25:06 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a1670022-c07c-4952-9a83-435149a95279 tempest-GroupSnapshotsTest-1246896825 None] Group snapshot 8cfaa564-6b42-4e07-9884-bf84291688bf: creating. {{(pid=86574) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 01 12:25:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a1670022-c07c-4952-9a83-435149a95279 tempest-GroupSnapshotsTest-1246896825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:25:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a1670022-c07c-4952-9a83-435149a95279 tempest-GroupSnapshotsTest-1246896825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:25:06 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-a1670022-c07c-4952-9a83-435149a95279 tempest-GroupSnapshotsTest-1246896825 None] Creating offline snapshot 448ae313-27b4-4dc2-b128-c0cd450f171a of volume 0a776822-1c62-40e1-816e-bddf6fe2f672 {{(pid=86574) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:25:06 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[51ab79a1-2976-47fd-8c0c-1b58b76c5fb6]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:25:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a1670022-c07c-4952-9a83-435149a95279 tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:06 devstack sudo[93869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672 Nov 01 12:25:06 devstack sudo[93869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:06 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-07db23ea-9eca-4c18-b3c0-23737275a281 tempest-VolumesActionsTest-1819912924 None] Acquiring lock "cinder-3b6f8328-5875-468a-9bc2-4776e91cf0e4-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:25:06 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-07db23ea-9eca-4c18-b3c0-23737275a281 tempest-VolumesActionsTest-1819912924 None] Lock "cinder-3b6f8328-5875-468a-9bc2-4776e91cf0e4-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:25:06 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-07db23ea-9eca-4c18-b3c0-23737275a281 tempest-VolumesActionsTest-1819912924 None] Acquiring lock "cinder-quobyte-3b6f8328-5875-468a-9bc2-4776e91cf0e4" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:25:06 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-07db23ea-9eca-4c18-b3c0-23737275a281 tempest-VolumesActionsTest-1819912924 None] Lock "cinder-quobyte-3b6f8328-5875-468a-9bc2-4776e91cf0e4" acquired by "delete_volume" :: waited 0.041s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:25:06 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[397af02a-4ef0-43c6-9e5c-074881d74f93]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:25:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-07db23ea-9eca-4c18-b3c0-23737275a281 tempest-VolumesActionsTest-1819912924 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3b6f8328-5875-468a-9bc2-4776e91cf0e4 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:07 devstack sudo[93874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3b6f8328-5875-468a-9bc2-4776e91cf0e4 Nov 01 12:25:07 devstack sudo[93874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:07 devstack sudo[93869]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a1670022-c07c-4952-9a83-435149a95279 tempest-GroupSnapshotsTest-1246896825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672" returned: 0 in 0.754s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a1670022-c07c-4952-9a83-435149a95279 tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672.448ae313-27b4-4dc2-b128-c0cd450f171a 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:07 devstack sudo[93879]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672.448ae313-27b4-4dc2-b128-c0cd450f171a 1G Nov 01 12:25:07 devstack sudo[93879]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:07 devstack sudo[93874]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-07db23ea-9eca-4c18-b3c0-23737275a281 tempest-VolumesActionsTest-1819912924 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3b6f8328-5875-468a-9bc2-4776e91cf0e4" returned: 0 in 0.610s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-07db23ea-9eca-4c18-b3c0-23737275a281 tempest-VolumesActionsTest-1819912924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3b6f8328-5875-468a-9bc2-4776e91cf0e4 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:07 devstack sudo[93887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3b6f8328-5875-468a-9bc2-4776e91cf0e4 Nov 01 12:25:07 devstack sudo[93887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:07 devstack sudo[93879]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a1670022-c07c-4952-9a83-435149a95279 tempest-GroupSnapshotsTest-1246896825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672.448ae313-27b4-4dc2-b128-c0cd450f171a 1G" returned: 0 in 0.636s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a1670022-c07c-4952-9a83-435149a95279 tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a776822-1c62-40e1-816e-bddf6fe2f672 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672.448ae313-27b4-4dc2-b128-c0cd450f171a {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:07 devstack sudo[93891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a776822-1c62-40e1-816e-bddf6fe2f672 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672.448ae313-27b4-4dc2-b128-c0cd450f171a Nov 01 12:25:07 devstack sudo[93891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:07 devstack sudo[93887]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-07db23ea-9eca-4c18-b3c0-23737275a281 tempest-VolumesActionsTest-1819912924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3b6f8328-5875-468a-9bc2-4776e91cf0e4" returned: 0 in 0.303s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:07 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-07db23ea-9eca-4c18-b3c0-23737275a281 tempest-VolumesActionsTest-1819912924 None] Lock "cinder-quobyte-3b6f8328-5875-468a-9bc2-4776e91cf0e4" released by "delete_volume" :: held 1.004s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:25:08 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-07db23ea-9eca-4c18-b3c0-23737275a281 tempest-VolumesActionsTest-1819912924 None] Created reservations ['75996a96-647e-4729-845d-172c297f5dc2', '0f81d685-b58e-49d0-a95b-bb8ffd8876a4', 'bb93526b-0458-4a63-8169-3d72d320b4f9', '8e2c0901-c776-4ab6-ad57-6aefaef722bb'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:25:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-07db23ea-9eca-4c18-b3c0-23737275a281 tempest-VolumesActionsTest-1819912924 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:25:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-07db23ea-9eca-4c18-b3c0-23737275a281 tempest-VolumesActionsTest-1819912924 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:25:08 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-07db23ea-9eca-4c18-b3c0-23737275a281 tempest-VolumesActionsTest-1819912924 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:25:08 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-07db23ea-9eca-4c18-b3c0-23737275a281 tempest-VolumesActionsTest-1819912924 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:25:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-07db23ea-9eca-4c18-b3c0-23737275a281 tempest-VolumesActionsTest-1819912924 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:25:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-07db23ea-9eca-4c18-b3c0-23737275a281 tempest-VolumesActionsTest-1819912924 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:08 devstack sudo[93893]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:25:08 devstack sudo[93893]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:08 devstack sudo[93891]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a1670022-c07c-4952-9a83-435149a95279 tempest-GroupSnapshotsTest-1246896825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a776822-1c62-40e1-816e-bddf6fe2f672 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672.448ae313-27b4-4dc2-b128-c0cd450f171a" returned: 0 in 0.427s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:08 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-a1670022-c07c-4952-9a83-435149a95279 tempest-GroupSnapshotsTest-1246896825 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672.448ae313-27b4-4dc2-b128-c0cd450f171a is being set with open permissions: ugo+rw: NotImplementedError Nov 01 12:25:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a1670022-c07c-4952-9a83-435149a95279 tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672.448ae313-27b4-4dc2-b128-c0cd450f171a {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:08 devstack sudo[93898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672.448ae313-27b4-4dc2-b128-c0cd450f171a Nov 01 12:25:08 devstack sudo[93898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:08 devstack sudo[93893]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-07db23ea-9eca-4c18-b3c0-23737275a281 tempest-VolumesActionsTest-1819912924 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.283s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:08 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-07db23ea-9eca-4c18-b3c0-23737275a281 tempest-VolumesActionsTest-1819912924 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:25:08 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-07db23ea-9eca-4c18-b3c0-23737275a281 tempest-VolumesActionsTest-1819912924 None] Deleted volume successfully. Nov 01 12:25:08 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-07db23ea-9eca-4c18-b3c0-23737275a281 tempest-VolumesActionsTest-1819912924 None] Lock "cinder-3b6f8328-5875-468a-9bc2-4776e91cf0e4-delete_volume" released by "delete_volume" :: held 1.703s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:25:08 devstack sudo[93898]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a1670022-c07c-4952-9a83-435149a95279 tempest-GroupSnapshotsTest-1246896825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672.448ae313-27b4-4dc2-b128-c0cd450f171a" returned: 0 in 0.350s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a1670022-c07c-4952-9a83-435149a95279 tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:08 devstack sudo[93902]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672.info Nov 01 12:25:08 devstack sudo[93902]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:08 devstack sudo[93902]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a1670022-c07c-4952-9a83-435149a95279 tempest-GroupSnapshotsTest-1246896825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672.info" returned: 0 in 0.248s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:08 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-a1670022-c07c-4952-9a83-435149a95279 tempest-GroupSnapshotsTest-1246896825 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672.info is being set with open permissions: ugo+rw: NotImplementedError Nov 01 12:25:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a1670022-c07c-4952-9a83-435149a95279 tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:08 devstack sudo[93905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672.info Nov 01 12:25:08 devstack sudo[93905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:09 devstack sudo[93905]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a1670022-c07c-4952-9a83-435149a95279 tempest-GroupSnapshotsTest-1246896825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672.info" returned: 0 in 0.265s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a1670022-c07c-4952-9a83-435149a95279 tempest-GroupSnapshotsTest-1246896825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.815s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:25:09 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-a1670022-c07c-4952-9a83-435149a95279 tempest-GroupSnapshotsTest-1246896825 None] group_snapshot 8cfaa564-6b42-4e07-9884-bf84291688bf: created successfully Nov 01 12:25:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-6fea06e6-2d15-4800-baf8-2758c0932fbd tempest-GroupSnapshotsTest-1246896825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:25:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-6fea06e6-2d15-4800-baf8-2758c0932fbd tempest-GroupSnapshotsTest-1246896825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:25:10 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6fea06e6-2d15-4800-baf8-2758c0932fbd tempest-GroupSnapshotsTest-1246896825 None] Acquiring lock "cinder-quobyte-448ae313-27b4-4dc2-b128-c0cd450f171a-614e6a60-bae3-4c72-b4fa-5cec03b0f3f6" by "_create_volume_from_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:25:10 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6fea06e6-2d15-4800-baf8-2758c0932fbd tempest-GroupSnapshotsTest-1246896825 None] Lock "cinder-quobyte-448ae313-27b4-4dc2-b128-c0cd450f171a-614e6a60-bae3-4c72-b4fa-5cec03b0f3f6" acquired by "_create_volume_from_snapshot" :: waited 0.021s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:25:10 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-6fea06e6-2d15-4800-baf8-2758c0932fbd tempest-GroupSnapshotsTest-1246896825 None] Creating volume 614e6a60-bae3-4c72-b4fa-5cec03b0f3f6 from snapshot 448ae313-27b4-4dc2-b128-c0cd450f171a {{(pid=86574) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 01 12:25:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-6fea06e6-2d15-4800-baf8-2758c0932fbd tempest-GroupSnapshotsTest-1246896825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:25:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-6fea06e6-2d15-4800-baf8-2758c0932fbd tempest-GroupSnapshotsTest-1246896825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:25:10 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-6fea06e6-2d15-4800-baf8-2758c0932fbd tempest-GroupSnapshotsTest-1246896825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:25:10 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-6fea06e6-2d15-4800-baf8-2758c0932fbd tempest-GroupSnapshotsTest-1246896825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:25:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-6fea06e6-2d15-4800-baf8-2758c0932fbd tempest-GroupSnapshotsTest-1246896825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:25:10 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-6fea06e6-2d15-4800-baf8-2758c0932fbd tempest-GroupSnapshotsTest-1246896825 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:25:10 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6fea06e6-2d15-4800-baf8-2758c0932fbd tempest-GroupSnapshotsTest-1246896825 None] Acquiring lock "cinder-quobyte-614e6a60-bae3-4c72-b4fa-5cec03b0f3f6" by "_copy_volume_from_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:25:10 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6fea06e6-2d15-4800-baf8-2758c0932fbd tempest-GroupSnapshotsTest-1246896825 None] Lock "cinder-quobyte-614e6a60-bae3-4c72-b4fa-5cec03b0f3f6" acquired by "_copy_volume_from_snapshot" :: waited 0.038s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:25:10 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-6fea06e6-2d15-4800-baf8-2758c0932fbd tempest-GroupSnapshotsTest-1246896825 None] snapshot: 448ae313-27b4-4dc2-b128-c0cd450f171a, volume: 614e6a60-bae3-4c72-b4fa-5cec03b0f3f6, {{(pid=86574) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 01 12:25:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-6fea06e6-2d15-4800-baf8-2758c0932fbd tempest-GroupSnapshotsTest-1246896825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:25:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-6fea06e6-2d15-4800-baf8-2758c0932fbd tempest-GroupSnapshotsTest-1246896825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:25:10 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-6fea06e6-2d15-4800-baf8-2758c0932fbd tempest-GroupSnapshotsTest-1246896825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:25:10 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-6fea06e6-2d15-4800-baf8-2758c0932fbd tempest-GroupSnapshotsTest-1246896825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:25:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-6fea06e6-2d15-4800-baf8-2758c0932fbd tempest-GroupSnapshotsTest-1246896825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:25:10 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[91c00e72-9d50-43b8-82b4-656ea5e03128]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:25:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6fea06e6-2d15-4800-baf8-2758c0932fbd tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672.448ae313-27b4-4dc2-b128-c0cd450f171a {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:11 devstack sudo[93909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672.448ae313-27b4-4dc2-b128-c0cd450f171a Nov 01 12:25:11 devstack sudo[93909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:11 devstack sudo[93909]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6fea06e6-2d15-4800-baf8-2758c0932fbd tempest-GroupSnapshotsTest-1246896825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672.448ae313-27b4-4dc2-b128-c0cd450f171a" returned: 0 in 0.684s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:11 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-6fea06e6-2d15-4800-baf8-2758c0932fbd tempest-GroupSnapshotsTest-1246896825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a776822-1c62-40e1-816e-bddf6fe2f672(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:25:11 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[fcea9662-cbf1-4244-ac6c-c90229d0fb14]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:25:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6fea06e6-2d15-4800-baf8-2758c0932fbd tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:11 devstack sudo[94006]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672 Nov 01 12:25:11 devstack sudo[94006]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:12 devstack sudo[94006]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6fea06e6-2d15-4800-baf8-2758c0932fbd tempest-GroupSnapshotsTest-1246896825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672" returned: 0 in 0.462s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:12 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-6fea06e6-2d15-4800-baf8-2758c0932fbd tempest-GroupSnapshotsTest-1246896825 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672 {{(pid=86574) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 01 12:25:12 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-6fea06e6-2d15-4800-baf8-2758c0932fbd tempest-GroupSnapshotsTest-1246896825 None] Creating direct copy from snapshot {{(pid=86574) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 01 12:25:12 devstack cinder-volume[86574]: DEBUG cinder.utils [None req-6fea06e6-2d15-4800-baf8-2758c0932fbd tempest-GroupSnapshotsTest-1246896825 None] Path /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-614e6a60-bae3-4c72-b4fa-5cec03b0f3f6 not found in is_blk_device check {{(pid=86574) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 01 12:25:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6fea06e6-2d15-4800-baf8-2758c0932fbd tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-614e6a60-bae3-4c72-b4fa-5cec03b0f3f6 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:12 devstack sudo[94051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-614e6a60-bae3-4c72-b4fa-5cec03b0f3f6 Nov 01 12:25:12 devstack sudo[94051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:20 devstack sudo[94051]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6fea06e6-2d15-4800-baf8-2758c0932fbd tempest-GroupSnapshotsTest-1246896825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-614e6a60-bae3-4c72-b4fa-5cec03b0f3f6" returned: 0 in 7.983s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:20 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-6fea06e6-2d15-4800-baf8-2758c0932fbd tempest-GroupSnapshotsTest-1246896825 None] Image conversion details: src /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672, size 1024.00 MB, duration 7.99 sec, destination /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-614e6a60-bae3-4c72-b4fa-5cec03b0f3f6 {{(pid=86574) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 12:25:20 devstack cinder-volume[86574]: INFO cinder.image.image_utils [None req-6fea06e6-2d15-4800-baf8-2758c0932fbd tempest-GroupSnapshotsTest-1246896825 None] Converted 1024.00 MB image at 128.24 MB/s Nov 01 12:25:20 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-6fea06e6-2d15-4800-baf8-2758c0932fbd tempest-GroupSnapshotsTest-1246896825 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-614e6a60-bae3-4c72-b4fa-5cec03b0f3f6 is being set with open permissions: ugo+rw: NotImplementedError Nov 01 12:25:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6fea06e6-2d15-4800-baf8-2758c0932fbd tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-614e6a60-bae3-4c72-b4fa-5cec03b0f3f6 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:20 devstack sudo[94104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-614e6a60-bae3-4c72-b4fa-5cec03b0f3f6 Nov 01 12:25:20 devstack sudo[94104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:20 devstack sudo[94104]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6fea06e6-2d15-4800-baf8-2758c0932fbd tempest-GroupSnapshotsTest-1246896825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-614e6a60-bae3-4c72-b4fa-5cec03b0f3f6" returned: 0 in 0.273s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:20 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6fea06e6-2d15-4800-baf8-2758c0932fbd tempest-GroupSnapshotsTest-1246896825 None] Lock "cinder-quobyte-614e6a60-bae3-4c72-b4fa-5cec03b0f3f6" released by "_copy_volume_from_snapshot" :: held 9.499s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:25:20 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:SELECT=113,cinder:UPDATE=114,cinder:DELETE=9,cinder:INSERT=22 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:25:20 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:SELECT=110,cinder:INSERT=26,cinder:UPDATE=111,cinder:DELETE=9 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:25:20 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6fea06e6-2d15-4800-baf8-2758c0932fbd tempest-GroupSnapshotsTest-1246896825 None] Lock "cinder-quobyte-448ae313-27b4-4dc2-b128-c0cd450f171a-614e6a60-bae3-4c72-b4fa-5cec03b0f3f6" released by "_create_volume_from_snapshot" :: held 9.611s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:25:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-6fea06e6-2d15-4800-baf8-2758c0932fbd tempest-GroupSnapshotsTest-1246896825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.634s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:25:20 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-6fea06e6-2d15-4800-baf8-2758c0932fbd tempest-GroupSnapshotsTest-1246896825 None] Create group from source-snapshot-8cfaa564-6b42-4e07-9884-bf84291688bf completed successfully. Nov 01 12:25:21 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-4306cfd3-f77f-42f5-a0cd-6a1c69841b30 tempest-GroupSnapshotsTest-1246896825 None] Acquiring lock "cinder-quobyte-614e6a60-bae3-4c72-b4fa-5cec03b0f3f6" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:25:21 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-4306cfd3-f77f-42f5-a0cd-6a1c69841b30 tempest-GroupSnapshotsTest-1246896825 None] Lock "cinder-quobyte-614e6a60-bae3-4c72-b4fa-5cec03b0f3f6" acquired by "delete_volume" :: waited 0.018s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:25:21 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc18afdc-c83f-4d2a-8eb4-c60a0e535cf7]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:25:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4306cfd3-f77f-42f5-a0cd-6a1c69841b30 tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-614e6a60-bae3-4c72-b4fa-5cec03b0f3f6 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:22 devstack sudo[94111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-614e6a60-bae3-4c72-b4fa-5cec03b0f3f6 Nov 01 12:25:22 devstack sudo[94111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:22 devstack sudo[94111]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4306cfd3-f77f-42f5-a0cd-6a1c69841b30 tempest-GroupSnapshotsTest-1246896825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-614e6a60-bae3-4c72-b4fa-5cec03b0f3f6" returned: 0 in 0.526s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4306cfd3-f77f-42f5-a0cd-6a1c69841b30 tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-614e6a60-bae3-4c72-b4fa-5cec03b0f3f6 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:22 devstack sudo[94118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-614e6a60-bae3-4c72-b4fa-5cec03b0f3f6 Nov 01 12:25:22 devstack sudo[94118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:22 devstack sudo[94118]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4306cfd3-f77f-42f5-a0cd-6a1c69841b30 tempest-GroupSnapshotsTest-1246896825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-614e6a60-bae3-4c72-b4fa-5cec03b0f3f6" returned: 0 in 0.329s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:22 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-4306cfd3-f77f-42f5-a0cd-6a1c69841b30 tempest-GroupSnapshotsTest-1246896825 None] Lock "cinder-quobyte-614e6a60-bae3-4c72-b4fa-5cec03b0f3f6" released by "delete_volume" :: held 0.936s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:25:22 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-813e7816-89fa-4301-8890-5c904757a963 tempest-AttachVolumeNegativeTest-245012374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:25:22 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-813e7816-89fa-4301-8890-5c904757a963 tempest-AttachVolumeNegativeTest-245012374 None] Flow 'volume_create_manager' (c43b50a3-29f0-40d6-b0bc-f9fdb294c6c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:25:22 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-813e7816-89fa-4301-8890-5c904757a963 tempest-AttachVolumeNegativeTest-245012374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bb07683-e112-4b4a-bc17-666e1c054727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:22 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-813e7816-89fa-4301-8890-5c904757a963 tempest-AttachVolumeNegativeTest-245012374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3bb07683-e112-4b4a-bc17-666e1c054727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1257491344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec55a935-dc22-4dee-95e8-b0c90326849b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33bece50a475457daaa280199a8d84b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:25:23Z,use_quota=True,user_id='5e41c2cf7aa144d488e34538a0804726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:22 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-813e7816-89fa-4301-8890-5c904757a963 tempest-AttachVolumeNegativeTest-245012374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49979613-59e1-4ad9-b63a-1d340b0222fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:22 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-813e7816-89fa-4301-8890-5c904757a963 tempest-AttachVolumeNegativeTest-245012374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (49979613-59e1-4ad9-b63a-1d340b0222fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:22 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-813e7816-89fa-4301-8890-5c904757a963 tempest-AttachVolumeNegativeTest-245012374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34c5cf40-79fe-4484-8775-50988ab4f4e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:22 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-813e7816-89fa-4301-8890-5c904757a963 tempest-AttachVolumeNegativeTest-245012374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (34c5cf40-79fe-4484-8775-50988ab4f4e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ec55a935-dc22-4dee-95e8-b0c90326849b', 'volume_name': 'volume-ec55a935-dc22-4dee-95e8-b0c90326849b', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:22 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-813e7816-89fa-4301-8890-5c904757a963 tempest-AttachVolumeNegativeTest-245012374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7997993b-437a-4e33-9999-477e03cc33eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:22 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-813e7816-89fa-4301-8890-5c904757a963 tempest-AttachVolumeNegativeTest-245012374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7997993b-437a-4e33-9999-477e03cc33eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:22 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-813e7816-89fa-4301-8890-5c904757a963 tempest-AttachVolumeNegativeTest-245012374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38f88a43-07e9-4931-a0ab-bc482b182b9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:22 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-813e7816-89fa-4301-8890-5c904757a963 tempest-AttachVolumeNegativeTest-245012374 None] Volume ec55a935-dc22-4dee-95e8-b0c90326849b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ec55a935-dc22-4dee-95e8-b0c90326849b', 'volume_size': 1} Nov 01 12:25:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-813e7816-89fa-4301-8890-5c904757a963 tempest-AttachVolumeNegativeTest-245012374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:25:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-813e7816-89fa-4301-8890-5c904757a963 tempest-AttachVolumeNegativeTest-245012374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:25:22 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-813e7816-89fa-4301-8890-5c904757a963 tempest-AttachVolumeNegativeTest-245012374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:25:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1257491344',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ec55a935-dc22-4dee-95e8-b0c90326849b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33bece50a475457daaa280199a8d84b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:25:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:25:23Z,use_quota=True,user_id='5e41c2cf7aa144d488e34538a0804726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:25:22 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-813e7816-89fa-4301-8890-5c904757a963 tempest-AttachVolumeNegativeTest-245012374 None] Creating volume ec55a935-dc22-4dee-95e8-b0c90326849b {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:25:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-813e7816-89fa-4301-8890-5c904757a963 tempest-AttachVolumeNegativeTest-245012374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:25:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-813e7816-89fa-4301-8890-5c904757a963 tempest-AttachVolumeNegativeTest-245012374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:25:22 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-813e7816-89fa-4301-8890-5c904757a963 tempest-AttachVolumeNegativeTest-245012374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:25:22 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-813e7816-89fa-4301-8890-5c904757a963 tempest-AttachVolumeNegativeTest-245012374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:25:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-813e7816-89fa-4301-8890-5c904757a963 tempest-AttachVolumeNegativeTest-245012374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:25:22 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-813e7816-89fa-4301-8890-5c904757a963 tempest-AttachVolumeNegativeTest-245012374 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:25:22 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-813e7816-89fa-4301-8890-5c904757a963 tempest-AttachVolumeNegativeTest-245012374 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:25:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-813e7816-89fa-4301-8890-5c904757a963 tempest-AttachVolumeNegativeTest-245012374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ec55a935-dc22-4dee-95e8-b0c90326849b 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:23 devstack sudo[94121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ec55a935-dc22-4dee-95e8-b0c90326849b 1073741824 Nov 01 12:25:23 devstack sudo[94121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:23 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-4306cfd3-f77f-42f5-a0cd-6a1c69841b30 tempest-GroupSnapshotsTest-1246896825 None] Created reservations ['d434a530-82ab-4f5e-80ce-7c83811796b8'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:25:23 devstack cinder-volume[86574]: WARNING cinder.quota [None req-4306cfd3-f77f-42f5-a0cd-6a1c69841b30 tempest-GroupSnapshotsTest-1246896825 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-860059187 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-860059187, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:25:23 devstack cinder-volume[86574]: WARNING cinder.quota [None req-4306cfd3-f77f-42f5-a0cd-6a1c69841b30 tempest-GroupSnapshotsTest-1246896825 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-860059187 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-860059187, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:25:23 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-4306cfd3-f77f-42f5-a0cd-6a1c69841b30 tempest-GroupSnapshotsTest-1246896825 None] Created reservations ['34b66ce8-528e-4fc6-acd1-85187da55058', 'f2e43e1d-9ba5-4bc9-b345-5738ec7ffb12', '12301a2d-1359-424d-a3f0-75ebed312609', 'a97e6561-863c-45ad-93c0-3eb4ea028021'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:25:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4306cfd3-f77f-42f5-a0cd-6a1c69841b30 tempest-GroupSnapshotsTest-1246896825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:25:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4306cfd3-f77f-42f5-a0cd-6a1c69841b30 tempest-GroupSnapshotsTest-1246896825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:25:23 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-4306cfd3-f77f-42f5-a0cd-6a1c69841b30 tempest-GroupSnapshotsTest-1246896825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:25:23 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-4306cfd3-f77f-42f5-a0cd-6a1c69841b30 tempest-GroupSnapshotsTest-1246896825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:25:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4306cfd3-f77f-42f5-a0cd-6a1c69841b30 tempest-GroupSnapshotsTest-1246896825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:25:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4306cfd3-f77f-42f5-a0cd-6a1c69841b30 tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:23 devstack sudo[94124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:25:23 devstack sudo[94124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:23 devstack sudo[94124]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4306cfd3-f77f-42f5-a0cd-6a1c69841b30 tempest-GroupSnapshotsTest-1246896825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.353s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:23 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-4306cfd3-f77f-42f5-a0cd-6a1c69841b30 tempest-GroupSnapshotsTest-1246896825 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:25:23 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-4306cfd3-f77f-42f5-a0cd-6a1c69841b30 tempest-GroupSnapshotsTest-1246896825 None] Delete group completed successfully. Nov 01 12:25:23 devstack sudo[94121]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-813e7816-89fa-4301-8890-5c904757a963 tempest-AttachVolumeNegativeTest-245012374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ec55a935-dc22-4dee-95e8-b0c90326849b 1073741824" returned: 0 in 0.647s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-813e7816-89fa-4301-8890-5c904757a963 tempest-AttachVolumeNegativeTest-245012374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ec55a935-dc22-4dee-95e8-b0c90326849b {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:23 devstack sudo[94131]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ec55a935-dc22-4dee-95e8-b0c90326849b Nov 01 12:25:23 devstack sudo[94131]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:23 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-a3139304-a121-454a-878d-24293727de28 req-fb272281-ab95-426a-aa40-52d22784de92 tempest-ServerActionsTestOtherA-2064758512 None] Terminate volume connection completed successfully. Nov 01 12:25:23 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-a3139304-a121-454a-878d-24293727de28 req-fb272281-ab95-426a-aa40-52d22784de92 tempest-ServerActionsTestOtherA-2064758512 None] Deleting attachment 65311274-a71a-4e68-b8bd-becfa7d97e3e. {{(pid=86574) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 12:25:24 devstack sudo[94131]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-813e7816-89fa-4301-8890-5c904757a963 tempest-AttachVolumeNegativeTest-245012374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ec55a935-dc22-4dee-95e8-b0c90326849b" returned: 0 in 0.321s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:24 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-813e7816-89fa-4301-8890-5c904757a963 tempest-AttachVolumeNegativeTest-245012374 None] <== create_volume: return (1025ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:25:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-813e7816-89fa-4301-8890-5c904757a963 tempest-AttachVolumeNegativeTest-245012374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.028s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:25:24 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-813e7816-89fa-4301-8890-5c904757a963 tempest-AttachVolumeNegativeTest-245012374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (38f88a43-07e9-4931-a0ab-bc482b182b9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ec55a935-dc22-4dee-95e8-b0c90326849b', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:24 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-813e7816-89fa-4301-8890-5c904757a963 tempest-AttachVolumeNegativeTest-245012374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (788f8b9b-ca62-43b1-834f-eec340b7f936) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:24 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-813e7816-89fa-4301-8890-5c904757a963 tempest-AttachVolumeNegativeTest-245012374 None] Volume volume-ec55a935-dc22-4dee-95e8-b0c90326849b (ec55a935-dc22-4dee-95e8-b0c90326849b): created successfully Nov 01 12:25:24 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-813e7816-89fa-4301-8890-5c904757a963 tempest-AttachVolumeNegativeTest-245012374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (788f8b9b-ca62-43b1-834f-eec340b7f936) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:24 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-813e7816-89fa-4301-8890-5c904757a963 tempest-AttachVolumeNegativeTest-245012374 None] Flow 'volume_create_manager' (c43b50a3-29f0-40d6-b0bc-f9fdb294c6c4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:25:24 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-813e7816-89fa-4301-8890-5c904757a963 tempest-AttachVolumeNegativeTest-245012374 None] Created volume successfully. Nov 01 12:25:24 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-9014f154-a008-490a-b367-a7a5be88c2fc tempest-GroupSnapshotsTest-1246896825 None] group_snapshot 8cfaa564-6b42-4e07-9884-bf84291688bf: deleting Nov 01 12:25:24 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9014f154-a008-490a-b367-a7a5be88c2fc tempest-GroupSnapshotsTest-1246896825 None] group_snapshot 8cfaa564-6b42-4e07-9884-bf84291688bf: deleting {{(pid=86574) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 01 12:25:24 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-9014f154-a008-490a-b367-a7a5be88c2fc tempest-GroupSnapshotsTest-1246896825 None] Acquiring lock "cinder-quobyte-0a776822-1c62-40e1-816e-bddf6fe2f672" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:25:24 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-9014f154-a008-490a-b367-a7a5be88c2fc tempest-GroupSnapshotsTest-1246896825 None] Lock "cinder-quobyte-0a776822-1c62-40e1-816e-bddf6fe2f672" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:25:24 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-9014f154-a008-490a-b367-a7a5be88c2fc tempest-GroupSnapshotsTest-1246896825 None] Acquiring lock "cinder-quobyte-448ae313-27b4-4dc2-b128-c0cd450f171a" by "_delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:25:24 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-9014f154-a008-490a-b367-a7a5be88c2fc tempest-GroupSnapshotsTest-1246896825 None] Lock "cinder-quobyte-448ae313-27b4-4dc2-b128-c0cd450f171a" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:25:24 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-9014f154-a008-490a-b367-a7a5be88c2fc tempest-GroupSnapshotsTest-1246896825 None] Deleting offline snapshot 448ae313-27b4-4dc2-b128-c0cd450f171a of volume 0a776822-1c62-40e1-816e-bddf6fe2f672 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:25:24 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-9014f154-a008-490a-b367-a7a5be88c2fc tempest-GroupSnapshotsTest-1246896825 None] snapshot_file for this snap is: volume-0a776822-1c62-40e1-816e-bddf6fe2f672.448ae313-27b4-4dc2-b128-c0cd450f171a {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:25:24 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a8fb236-8f78-4f6c-bb16-8b1ebeebfcc2]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:25:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9014f154-a008-490a-b367-a7a5be88c2fc tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672.448ae313-27b4-4dc2-b128-c0cd450f171a {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:24 devstack sudo[94137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672.448ae313-27b4-4dc2-b128-c0cd450f171a Nov 01 12:25:24 devstack sudo[94137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:24 devstack sudo[94137]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9014f154-a008-490a-b367-a7a5be88c2fc tempest-GroupSnapshotsTest-1246896825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672.448ae313-27b4-4dc2-b128-c0cd450f171a" returned: 0 in 0.442s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:24 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-9014f154-a008-490a-b367-a7a5be88c2fc tempest-GroupSnapshotsTest-1246896825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a776822-1c62-40e1-816e-bddf6fe2f672(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:25:24 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b2e88a2-49bf-48d8-b972-714981bfb45d]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:25:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9014f154-a008-490a-b367-a7a5be88c2fc tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:25 devstack sudo[94146]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672 Nov 01 12:25:25 devstack sudo[94146]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:26 devstack sudo[94146]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9014f154-a008-490a-b367-a7a5be88c2fc tempest-GroupSnapshotsTest-1246896825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672" returned: 0 in 1.040s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9014f154-a008-490a-b367-a7a5be88c2fc tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672.448ae313-27b4-4dc2-b128-c0cd450f171a {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:26 devstack sudo[94185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672.448ae313-27b4-4dc2-b128-c0cd450f171a Nov 01 12:25:26 devstack sudo[94185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-ccfda8ac-2a5b-4f72-8c2d-f2628ff68f75 req-3a06d115-683d-42a6-83a6-03ec9bf2591e tempest-AttachVolumeNegativeTest-245012374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:25:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-ccfda8ac-2a5b-4f72-8c2d-f2628ff68f75 req-3a06d115-683d-42a6-83a6-03ec9bf2591e tempest-AttachVolumeNegativeTest-245012374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:25:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-ccfda8ac-2a5b-4f72-8c2d-f2628ff68f75 req-3a06d115-683d-42a6-83a6-03ec9bf2591e tempest-AttachVolumeNegativeTest-245012374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:25:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-ccfda8ac-2a5b-4f72-8c2d-f2628ff68f75 req-3a06d115-683d-42a6-83a6-03ec9bf2591e tempest-AttachVolumeNegativeTest-245012374 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb', 'name': 'volume-ec55a935-dc22-4dee-95e8-b0c90326849b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '860f9587-0192-4420-b76c-aef1bc1e0cc6', 'enforce_multipath': True} {{(pid=86574) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 12:25:26 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-ccfda8ac-2a5b-4f72-8c2d-f2628ff68f75 req-3a06d115-683d-42a6-83a6-03ec9bf2591e tempest-AttachVolumeNegativeTest-245012374 None] attachment_update completed successfully. Nov 01 12:25:26 devstack sudo[94185]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9014f154-a008-490a-b367-a7a5be88c2fc tempest-GroupSnapshotsTest-1246896825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672.448ae313-27b4-4dc2-b128-c0cd450f171a" returned: 0 in 0.553s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9014f154-a008-490a-b367-a7a5be88c2fc tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672.448ae313-27b4-4dc2-b128-c0cd450f171a {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:26 devstack sudo[94289]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672.448ae313-27b4-4dc2-b128-c0cd450f171a Nov 01 12:25:26 devstack sudo[94289]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:26 devstack sudo[94289]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9014f154-a008-490a-b367-a7a5be88c2fc tempest-GroupSnapshotsTest-1246896825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672.448ae313-27b4-4dc2-b128-c0cd450f171a" returned: 0 in 0.363s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:27 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-9014f154-a008-490a-b367-a7a5be88c2fc tempest-GroupSnapshotsTest-1246896825 None] Lock "cinder-quobyte-448ae313-27b4-4dc2-b128-c0cd450f171a" released by "_delete_snapshot" :: held 2.560s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:25:27 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-9014f154-a008-490a-b367-a7a5be88c2fc tempest-GroupSnapshotsTest-1246896825 None] Lock "cinder-quobyte-0a776822-1c62-40e1-816e-bddf6fe2f672" released by "delete_snapshot" :: held 2.589s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:25:27 devstack cinder-volume[86574]: WARNING cinder.quota [None req-9014f154-a008-490a-b367-a7a5be88c2fc tempest-GroupSnapshotsTest-1246896825 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-860059187 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-860059187, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:25:27 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-9014f154-a008-490a-b367-a7a5be88c2fc tempest-GroupSnapshotsTest-1246896825 None] Created reservations ['7da43f01-258a-49b7-9db1-96054c4f667f', '69bfae7e-8ca6-4cd1-a168-e39b823da2a7', '9eb699bc-f61e-4d8e-8f9a-920c6b2db289', '848b9a15-45b2-48a4-9e67-e57013796e4f'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:25:27 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-9014f154-a008-490a-b367-a7a5be88c2fc tempest-GroupSnapshotsTest-1246896825 None] group_snapshot 8cfaa564-6b42-4e07-9884-bf84291688bf: deleted successfully Nov 01 12:25:27 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-2c8a5a23-60ac-401b-ba27-3e4bdcece613 tempest-SnapshotMetadataTestJSON-1328037073 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:25:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2c8a5a23-60ac-401b-ba27-3e4bdcece613 tempest-SnapshotMetadataTestJSON-1328037073 None] Flow 'volume_create_manager' (da4db481-e1e8-4bbd-b6d1-bd589e126fdd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:25:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2c8a5a23-60ac-401b-ba27-3e4bdcece613 tempest-SnapshotMetadataTestJSON-1328037073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9710628f-fb17-4642-a611-c77df5c0e0be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2c8a5a23-60ac-401b-ba27-3e4bdcece613 tempest-SnapshotMetadataTestJSON-1328037073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9710628f-fb17-4642-a611-c77df5c0e0be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-694059960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40da4098-e6e0-4b77-97a4-c6cd17c856a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca04060f42ad47848a8c001e151388da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:25:28Z,use_quota=True,user_id='40ac94941a744e598eda5b9a3ad8ae80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2c8a5a23-60ac-401b-ba27-3e4bdcece613 tempest-SnapshotMetadataTestJSON-1328037073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b16e0e0e-90a9-4f8a-8687-17504da84011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2c8a5a23-60ac-401b-ba27-3e4bdcece613 tempest-SnapshotMetadataTestJSON-1328037073 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b16e0e0e-90a9-4f8a-8687-17504da84011) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2c8a5a23-60ac-401b-ba27-3e4bdcece613 tempest-SnapshotMetadataTestJSON-1328037073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9654a61-feaf-4488-a89c-aa1a184bc7e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2c8a5a23-60ac-401b-ba27-3e4bdcece613 tempest-SnapshotMetadataTestJSON-1328037073 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9654a61-feaf-4488-a89c-aa1a184bc7e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40da4098-e6e0-4b77-97a4-c6cd17c856a3', 'volume_name': 'volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2c8a5a23-60ac-401b-ba27-3e4bdcece613 tempest-SnapshotMetadataTestJSON-1328037073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (845fced0-7c9f-4e13-9f74-1e509aa9a735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2c8a5a23-60ac-401b-ba27-3e4bdcece613 tempest-SnapshotMetadataTestJSON-1328037073 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (845fced0-7c9f-4e13-9f74-1e509aa9a735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2c8a5a23-60ac-401b-ba27-3e4bdcece613 tempest-SnapshotMetadataTestJSON-1328037073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1fd1932-7253-429d-baf4-d640d06932d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:27 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-2c8a5a23-60ac-401b-ba27-3e4bdcece613 tempest-SnapshotMetadataTestJSON-1328037073 None] Volume 40da4098-e6e0-4b77-97a4-c6cd17c856a3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3', 'volume_size': 1} Nov 01 12:25:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-2c8a5a23-60ac-401b-ba27-3e4bdcece613 tempest-SnapshotMetadataTestJSON-1328037073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:25:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-2c8a5a23-60ac-401b-ba27-3e4bdcece613 tempest-SnapshotMetadataTestJSON-1328037073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:25:27 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-2c8a5a23-60ac-401b-ba27-3e4bdcece613 tempest-SnapshotMetadataTestJSON-1328037073 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:25:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-694059960',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40da4098-e6e0-4b77-97a4-c6cd17c856a3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ca04060f42ad47848a8c001e151388da',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:25:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:25:28Z,use_quota=True,user_id='40ac94941a744e598eda5b9a3ad8ae80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:25:27 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-2c8a5a23-60ac-401b-ba27-3e4bdcece613 tempest-SnapshotMetadataTestJSON-1328037073 None] Creating volume 40da4098-e6e0-4b77-97a4-c6cd17c856a3 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:25:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-2c8a5a23-60ac-401b-ba27-3e4bdcece613 tempest-SnapshotMetadataTestJSON-1328037073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:25:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-2c8a5a23-60ac-401b-ba27-3e4bdcece613 tempest-SnapshotMetadataTestJSON-1328037073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:25:27 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-2c8a5a23-60ac-401b-ba27-3e4bdcece613 tempest-SnapshotMetadataTestJSON-1328037073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:25:27 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-2c8a5a23-60ac-401b-ba27-3e4bdcece613 tempest-SnapshotMetadataTestJSON-1328037073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:25:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-2c8a5a23-60ac-401b-ba27-3e4bdcece613 tempest-SnapshotMetadataTestJSON-1328037073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:25:27 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-2c8a5a23-60ac-401b-ba27-3e4bdcece613 tempest-SnapshotMetadataTestJSON-1328037073 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:25:27 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-2c8a5a23-60ac-401b-ba27-3e4bdcece613 tempest-SnapshotMetadataTestJSON-1328037073 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:25:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2c8a5a23-60ac-401b-ba27-3e4bdcece613 tempest-SnapshotMetadataTestJSON-1328037073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:27 devstack sudo[94613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3 1073741824 Nov 01 12:25:27 devstack sudo[94613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:28 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-9bda9e3b-565c-4308-a216-6e5c0a6a6f4f tempest-GroupSnapshotsTest-1246896825 None] Acquiring lock "cinder-quobyte-0a776822-1c62-40e1-816e-bddf6fe2f672" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:25:28 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-9bda9e3b-565c-4308-a216-6e5c0a6a6f4f tempest-GroupSnapshotsTest-1246896825 None] Lock "cinder-quobyte-0a776822-1c62-40e1-816e-bddf6fe2f672" acquired by "delete_volume" :: waited 0.020s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:25:28 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c29fd28-d9db-4198-a17b-47068eee70d4]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:25:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9bda9e3b-565c-4308-a216-6e5c0a6a6f4f tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:28 devstack sudo[94613]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2c8a5a23-60ac-401b-ba27-3e4bdcece613 tempest-SnapshotMetadataTestJSON-1328037073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3 1073741824" returned: 0 in 0.555s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2c8a5a23-60ac-401b-ba27-3e4bdcece613 tempest-SnapshotMetadataTestJSON-1328037073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:28 devstack sudo[94620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3 Nov 01 12:25:28 devstack sudo[94620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:28 devstack sudo[94619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672 Nov 01 12:25:28 devstack sudo[94619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:28 devstack sudo[94620]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2c8a5a23-60ac-401b-ba27-3e4bdcece613 tempest-SnapshotMetadataTestJSON-1328037073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3" returned: 0 in 0.284s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:28 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-2c8a5a23-60ac-401b-ba27-3e4bdcece613 tempest-SnapshotMetadataTestJSON-1328037073 None] <== create_volume: return (892ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:25:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-2c8a5a23-60ac-401b-ba27-3e4bdcece613 tempest-SnapshotMetadataTestJSON-1328037073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:25:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2c8a5a23-60ac-401b-ba27-3e4bdcece613 tempest-SnapshotMetadataTestJSON-1328037073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1fd1932-7253-429d-baf4-d640d06932d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2c8a5a23-60ac-401b-ba27-3e4bdcece613 tempest-SnapshotMetadataTestJSON-1328037073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a5c8bd-a5f5-45dc-90b4-a9695a4ac1a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:28 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-2c8a5a23-60ac-401b-ba27-3e4bdcece613 tempest-SnapshotMetadataTestJSON-1328037073 None] Volume volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3 (40da4098-e6e0-4b77-97a4-c6cd17c856a3): created successfully Nov 01 12:25:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2c8a5a23-60ac-401b-ba27-3e4bdcece613 tempest-SnapshotMetadataTestJSON-1328037073 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50a5c8bd-a5f5-45dc-90b4-a9695a4ac1a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2c8a5a23-60ac-401b-ba27-3e4bdcece613 tempest-SnapshotMetadataTestJSON-1328037073 None] Flow 'volume_create_manager' (da4db481-e1e8-4bbd-b6d1-bd589e126fdd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:25:28 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-2c8a5a23-60ac-401b-ba27-3e4bdcece613 tempest-SnapshotMetadataTestJSON-1328037073 None] Created volume successfully. Nov 01 12:25:28 devstack sudo[94619]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9bda9e3b-565c-4308-a216-6e5c0a6a6f4f tempest-GroupSnapshotsTest-1246896825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672" returned: 0 in 0.461s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9bda9e3b-565c-4308-a216-6e5c0a6a6f4f tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:28 devstack sudo[94628]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672 Nov 01 12:25:28 devstack sudo[94628]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:28 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-ef58652d-9f45-420e-b75c-34221b3a14fe req-67a020b3-bee1-40cb-ad6b-016a58c5a22e tempest-AttachVolumeNegativeTest-245012374 None] Terminate volume connection completed successfully. Nov 01 12:25:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-ef58652d-9f45-420e-b75c-34221b3a14fe req-67a020b3-bee1-40cb-ad6b-016a58c5a22e tempest-AttachVolumeNegativeTest-245012374 None] Deleting attachment 860f9587-0192-4420-b76c-aef1bc1e0cc6. {{(pid=86574) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 12:25:29 devstack sudo[94628]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9bda9e3b-565c-4308-a216-6e5c0a6a6f4f tempest-GroupSnapshotsTest-1246896825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a776822-1c62-40e1-816e-bddf6fe2f672" returned: 0 in 0.284s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:29 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-9bda9e3b-565c-4308-a216-6e5c0a6a6f4f tempest-GroupSnapshotsTest-1246896825 None] Lock "cinder-quobyte-0a776822-1c62-40e1-816e-bddf6fe2f672" released by "delete_volume" :: held 0.829s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:25:29 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-9bda9e3b-565c-4308-a216-6e5c0a6a6f4f tempest-GroupSnapshotsTest-1246896825 None] Created reservations ['ab71b5a7-7e2c-4017-8ec5-720c12987347'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:25:29 devstack cinder-volume[86574]: WARNING cinder.db.api [None req-9bda9e3b-565c-4308-a216-6e5c0a6a6f4f tempest-GroupSnapshotsTest-1246896825 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-860059187'] Nov 01 12:25:29 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-9bda9e3b-565c-4308-a216-6e5c0a6a6f4f tempest-GroupSnapshotsTest-1246896825 None] Created reservations ['ddbafc3d-dbc3-453f-8db8-c4d1b7c50399', 'b50dbcb1-ae84-4e55-a947-35cb78a7b8b0', '1502846b-d665-494e-9672-441a4407b114', '2a6fafb1-212c-4dde-8a1f-de5fa66cf697'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:25:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-9bda9e3b-565c-4308-a216-6e5c0a6a6f4f tempest-GroupSnapshotsTest-1246896825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:25:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-9bda9e3b-565c-4308-a216-6e5c0a6a6f4f tempest-GroupSnapshotsTest-1246896825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:25:29 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-9bda9e3b-565c-4308-a216-6e5c0a6a6f4f tempest-GroupSnapshotsTest-1246896825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:25:29 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-9bda9e3b-565c-4308-a216-6e5c0a6a6f4f tempest-GroupSnapshotsTest-1246896825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:25:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-9bda9e3b-565c-4308-a216-6e5c0a6a6f4f tempest-GroupSnapshotsTest-1246896825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:25:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9bda9e3b-565c-4308-a216-6e5c0a6a6f4f tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:29 devstack sudo[94658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:25:29 devstack sudo[94658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:29 devstack sudo[94658]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9bda9e3b-565c-4308-a216-6e5c0a6a6f4f tempest-GroupSnapshotsTest-1246896825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.324s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:29 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-9bda9e3b-565c-4308-a216-6e5c0a6a6f4f tempest-GroupSnapshotsTest-1246896825 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:25:29 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-9bda9e3b-565c-4308-a216-6e5c0a6a6f4f tempest-GroupSnapshotsTest-1246896825 None] Delete group completed successfully. Nov 01 12:25:30 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-dd790d69-a7b4-4664-adb2-6e110af15ad8 tempest-GroupSnapshotsTest-1246896825 None] Group tempest-GroupSnapshotsTest-Group-313040612: creating Nov 01 12:25:30 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-dd790d69-a7b4-4664-adb2-6e110af15ad8 tempest-GroupSnapshotsTest-1246896825 None] Group tempest-GroupSnapshotsTest-Group-313040612: created successfully Nov 01 12:25:30 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-dd790d69-a7b4-4664-adb2-6e110af15ad8 tempest-GroupSnapshotsTest-1246896825 None] Create group completed successfully. Nov 01 12:25:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f99cf945-7655-4ba2-97a6-52ba85636bce tempest-SnapshotMetadataTestJSON-1328037073 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:25:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f99cf945-7655-4ba2-97a6-52ba85636bce tempest-SnapshotMetadataTestJSON-1328037073 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:25:30 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-f99cf945-7655-4ba2-97a6-52ba85636bce tempest-SnapshotMetadataTestJSON-1328037073 None] Creating offline snapshot 9f32cc24-b562-46d1-b5ef-dccdf096363f of volume 40da4098-e6e0-4b77-97a4-c6cd17c856a3 {{(pid=86574) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:25:30 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae511ca9-8ddf-49b0-921a-8306cb876050]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:25:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f99cf945-7655-4ba2-97a6-52ba85636bce tempest-SnapshotMetadataTestJSON-1328037073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:30 devstack sudo[94662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3 Nov 01 12:25:30 devstack sudo[94662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:30 devstack sudo[94662]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f99cf945-7655-4ba2-97a6-52ba85636bce tempest-SnapshotMetadataTestJSON-1328037073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3" returned: 0 in 0.567s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f99cf945-7655-4ba2-97a6-52ba85636bce tempest-SnapshotMetadataTestJSON-1328037073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3.9f32cc24-b562-46d1-b5ef-dccdf096363f 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:30 devstack sudo[94686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3.9f32cc24-b562-46d1-b5ef-dccdf096363f 1G Nov 01 12:25:30 devstack sudo[94686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:31 devstack sudo[94686]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f99cf945-7655-4ba2-97a6-52ba85636bce tempest-SnapshotMetadataTestJSON-1328037073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3.9f32cc24-b562-46d1-b5ef-dccdf096363f 1G" returned: 0 in 0.649s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f99cf945-7655-4ba2-97a6-52ba85636bce tempest-SnapshotMetadataTestJSON-1328037073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3.9f32cc24-b562-46d1-b5ef-dccdf096363f {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:31 devstack sudo[94693]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3.9f32cc24-b562-46d1-b5ef-dccdf096363f Nov 01 12:25:31 devstack sudo[94693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:31 devstack sudo[94693]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f99cf945-7655-4ba2-97a6-52ba85636bce tempest-SnapshotMetadataTestJSON-1328037073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3.9f32cc24-b562-46d1-b5ef-dccdf096363f" returned: 0 in 0.387s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:31 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-f99cf945-7655-4ba2-97a6-52ba85636bce tempest-SnapshotMetadataTestJSON-1328037073 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3.9f32cc24-b562-46d1-b5ef-dccdf096363f is being set with open permissions: ugo+rw Nov 01 12:25:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f99cf945-7655-4ba2-97a6-52ba85636bce tempest-SnapshotMetadataTestJSON-1328037073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3.9f32cc24-b562-46d1-b5ef-dccdf096363f {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:31 devstack sudo[94699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3.9f32cc24-b562-46d1-b5ef-dccdf096363f Nov 01 12:25:31 devstack sudo[94699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:32 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-0e4fba6d-5db6-4801-9d82-ef111a949a05 tempest-GroupSnapshotsTest-1246896825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:25:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0e4fba6d-5db6-4801-9d82-ef111a949a05 tempest-GroupSnapshotsTest-1246896825 None] Flow 'volume_create_manager' (f33a391b-dc12-4b27-81f4-65dfc8056636) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:25:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0e4fba6d-5db6-4801-9d82-ef111a949a05 tempest-GroupSnapshotsTest-1246896825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa02b11e-6de9-4b94-b720-0445f8341839) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0e4fba6d-5db6-4801-9d82-ef111a949a05 tempest-GroupSnapshotsTest-1246896825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fa02b11e-6de9-4b94-b720-0445f8341839) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-906481028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fe88fd74-14a4-4023-b236-20e37dd1ad56,host='devstack@QuobyteHD#QuobyteHD',id=e23b6198-1d1a-4575-aec2-e930172d61df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4fc678ab60641eca0ae492c65b6be49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:25:32Z,use_quota=True,user_id='b04fe47e77f14940b3f73a971b0e2339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a636b839-915b-4a85-bd17-38d7dd6683e0),volume_type_id=a636b839-915b-4a85-bd17-38d7dd6683e0)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0e4fba6d-5db6-4801-9d82-ef111a949a05 tempest-GroupSnapshotsTest-1246896825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06df8878-a1ff-4416-a03b-e9c27f8ea001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0e4fba6d-5db6-4801-9d82-ef111a949a05 tempest-GroupSnapshotsTest-1246896825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (06df8878-a1ff-4416-a03b-e9c27f8ea001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0e4fba6d-5db6-4801-9d82-ef111a949a05 tempest-GroupSnapshotsTest-1246896825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed2edbdd-9435-4792-b6c1-df5598ae1e27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0e4fba6d-5db6-4801-9d82-ef111a949a05 tempest-GroupSnapshotsTest-1246896825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ed2edbdd-9435-4792-b6c1-df5598ae1e27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e23b6198-1d1a-4575-aec2-e930172d61df', 'volume_name': 'volume-e23b6198-1d1a-4575-aec2-e930172d61df', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0e4fba6d-5db6-4801-9d82-ef111a949a05 tempest-GroupSnapshotsTest-1246896825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dfefe68-ab93-4140-b076-9a3b085e1df4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0e4fba6d-5db6-4801-9d82-ef111a949a05 tempest-GroupSnapshotsTest-1246896825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8dfefe68-ab93-4140-b076-9a3b085e1df4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0e4fba6d-5db6-4801-9d82-ef111a949a05 tempest-GroupSnapshotsTest-1246896825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (705ab522-20ca-4f13-bae5-14e4550f6e47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:32 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-0e4fba6d-5db6-4801-9d82-ef111a949a05 tempest-GroupSnapshotsTest-1246896825 None] Volume e23b6198-1d1a-4575-aec2-e930172d61df: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e23b6198-1d1a-4575-aec2-e930172d61df', 'volume_size': 1} Nov 01 12:25:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0e4fba6d-5db6-4801-9d82-ef111a949a05 tempest-GroupSnapshotsTest-1246896825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:25:32 devstack sudo[94699]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f99cf945-7655-4ba2-97a6-52ba85636bce tempest-SnapshotMetadataTestJSON-1328037073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3.9f32cc24-b562-46d1-b5ef-dccdf096363f" returned: 0 in 0.398s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:32 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:25:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] Flow 'volume_create_manager' (9aa5142a-d28f-44e4-880e-aa6e2e35387a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:25:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (875d354d-378f-4b43-920b-2ff30fd592c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (875d354d-378f-4b43-920b-2ff30fd592c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-288887555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dea6740-5a36-424b-8321-cc6bf8bed2da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89fba3f7dbbe400bbdea46e735351975',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:25:32Z,use_quota=True,user_id='24a3f424962f485ba077702c2b4d6a8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f699b78b-1439-473e-91fa-010baa50bdf9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f699b78b-1439-473e-91fa-010baa50bdf9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df059217-06ac-4552-8dd6-e5e8df27b9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:32 devstack cinder-volume[86574]: DEBUG cinder.image.glance [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] Creating Keystone auth plugin from conf {{(pid=86574) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 01 12:25:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f99cf945-7655-4ba2-97a6-52ba85636bce tempest-SnapshotMetadataTestJSON-1328037073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:32 devstack sudo[94703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3.info Nov 01 12:25:32 devstack sudo[94703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:32 devstack sudo[94703]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f99cf945-7655-4ba2-97a6-52ba85636bce tempest-SnapshotMetadataTestJSON-1328037073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3.info" returned: 0 in 0.305s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:32 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-f99cf945-7655-4ba2-97a6-52ba85636bce tempest-SnapshotMetadataTestJSON-1328037073 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3.info is being set with open permissions: ugo+rw Nov 01 12:25:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f99cf945-7655-4ba2-97a6-52ba85636bce tempest-SnapshotMetadataTestJSON-1328037073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:32 devstack sudo[94740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3.info Nov 01 12:25:32 devstack sudo[94740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df059217-06ac-4552-8dd6-e5e8df27b9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '4dea6740-5a36-424b-8321-cc6bf8bed2da', 'volume_name': 'volume-4dea6740-5a36-424b-8321-cc6bf8bed2da', 'volume_size': 1, 'image_id': 'f937a0d6-76b6-4a84-a698-e474557181cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f937a0d6-76b6-4a84-a698-e474557181cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4892ea0f5a04c4d8b924ece0f60a2a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f937a0d6-76b6-4a84-a698-e474557181cd', 'created_at': datetime.datetime(2026, 11, 1, 11, 14, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 14, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f937a0d6-76b6-4a84-a698-e474557181cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19efd833-a664-46b1-b112-a7daba0b184b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (19efd833-a664-46b1-b112-a7daba0b184b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (058fc6e0-740a-4ea8-a54c-89eb29c63dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:32 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] Volume 4dea6740-5a36-424b-8321-cc6bf8bed2da: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-4dea6740-5a36-424b-8321-cc6bf8bed2da', 'volume_size': 1, 'image_id': 'f937a0d6-76b6-4a84-a698-e474557181cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f937a0d6-76b6-4a84-a698-e474557181cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4892ea0f5a04c4d8b924ece0f60a2a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f937a0d6-76b6-4a84-a698-e474557181cd', 'created_at': datetime.datetime(2026, 11, 1, 11, 14, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 14, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f937a0d6-76b6-4a84-a698-e474557181cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 01 12:25:32 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] Trying to clone 4dea6740-5a36-424b-8321-cc6bf8bed2da from image f937a0d6-76b6-4a84-a698-e474557181cd at location (None, [{'url': 'file:///opt/stack/data/glance/images/f937a0d6-76b6-4a84-a698-e474557181cd', 'metadata': {}}]). {{(pid=86574) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 01 12:25:33 devstack sudo[94740]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f99cf945-7655-4ba2-97a6-52ba85636bce tempest-SnapshotMetadataTestJSON-1328037073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3.info" returned: 0 in 0.270s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f99cf945-7655-4ba2-97a6-52ba85636bce tempest-SnapshotMetadataTestJSON-1328037073 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.829s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:25:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0e4fba6d-5db6-4801-9d82-ef111a949a05 tempest-GroupSnapshotsTest-1246896825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.013s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:25:33 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-0e4fba6d-5db6-4801-9d82-ef111a949a05 tempest-GroupSnapshotsTest-1246896825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fe88fd74-14a4-4023-b236-20e37dd1ad56,created_at=2026-11-01T11:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-906481028',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fe88fd74-14a4-4023-b236-20e37dd1ad56,host='devstack@QuobyteHD#QuobyteHD',id=e23b6198-1d1a-4575-aec2-e930172d61df,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4fc678ab60641eca0ae492c65b6be49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:25:32Z,use_quota=True,user_id='b04fe47e77f14940b3f73a971b0e2339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a636b839-915b-4a85-bd17-38d7dd6683e0),volume_type_id=a636b839-915b-4a85-bd17-38d7dd6683e0)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:25:33 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-0e4fba6d-5db6-4801-9d82-ef111a949a05 tempest-GroupSnapshotsTest-1246896825 None] Creating volume e23b6198-1d1a-4575-aec2-e930172d61df {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:25:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0e4fba6d-5db6-4801-9d82-ef111a949a05 tempest-GroupSnapshotsTest-1246896825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:25:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0e4fba6d-5db6-4801-9d82-ef111a949a05 tempest-GroupSnapshotsTest-1246896825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:25:33 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-0e4fba6d-5db6-4801-9d82-ef111a949a05 tempest-GroupSnapshotsTest-1246896825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:25:33 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-0e4fba6d-5db6-4801-9d82-ef111a949a05 tempest-GroupSnapshotsTest-1246896825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:25:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0e4fba6d-5db6-4801-9d82-ef111a949a05 tempest-GroupSnapshotsTest-1246896825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:25:33 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-0e4fba6d-5db6-4801-9d82-ef111a949a05 tempest-GroupSnapshotsTest-1246896825 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:25:33 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-0e4fba6d-5db6-4801-9d82-ef111a949a05 tempest-GroupSnapshotsTest-1246896825 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:25:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0e4fba6d-5db6-4801-9d82-ef111a949a05 tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e23b6198-1d1a-4575-aec2-e930172d61df 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:33 devstack sudo[94763]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e23b6198-1d1a-4575-aec2-e930172d61df 1073741824 Nov 01 12:25:33 devstack sudo[94763]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:33 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-f99cf945-7655-4ba2-97a6-52ba85636bce tempest-SnapshotMetadataTestJSON-1328037073 None] Create snapshot completed successfully Nov 01 12:25:33 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_si_htvvmdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86574) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 01 12:25:33 devstack cinder-volume[86574]: INFO cinder.image.image_utils [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] Image download 20.69 MB at 20.69 MB/s Nov 01 12:25:33 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[62c50281-eca8-4820-8745-1ab1b3062f38]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:25:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_si_htvvmdevstack@QuobyteHD {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:33 devstack sudo[94772]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_si_htvvmdevstack@QuobyteHD Nov 01 12:25:33 devstack sudo[94772]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:33 devstack sudo[94763]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0e4fba6d-5db6-4801-9d82-ef111a949a05 tempest-GroupSnapshotsTest-1246896825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e23b6198-1d1a-4575-aec2-e930172d61df 1073741824" returned: 0 in 0.550s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0e4fba6d-5db6-4801-9d82-ef111a949a05 tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e23b6198-1d1a-4575-aec2-e930172d61df {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:33 devstack sudo[94774]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e23b6198-1d1a-4575-aec2-e930172d61df Nov 01 12:25:33 devstack sudo[94774]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:33 devstack sudo[94772]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_si_htvvmdevstack@QuobyteHD" returned: 0 in 0.360s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:33 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] Temporary image f937a0d6-76b6-4a84-a698-e474557181cd is fetched for user 24a3f424962f485ba077702c2b4d6a8f. {{(pid=86574) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 01 12:25:33 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[7297214e-77a9-43f6-a72f-67ba25eeef9e]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:25:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_si_htvvmdevstack@QuobyteHD {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:34 devstack sudo[94774]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0e4fba6d-5db6-4801-9d82-ef111a949a05 tempest-GroupSnapshotsTest-1246896825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e23b6198-1d1a-4575-aec2-e930172d61df" returned: 0 in 0.334s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:34 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-0e4fba6d-5db6-4801-9d82-ef111a949a05 tempest-GroupSnapshotsTest-1246896825 None] <== create_volume: return (939ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:25:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0e4fba6d-5db6-4801-9d82-ef111a949a05 tempest-GroupSnapshotsTest-1246896825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.942s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:25:34 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0e4fba6d-5db6-4801-9d82-ef111a949a05 tempest-GroupSnapshotsTest-1246896825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (705ab522-20ca-4f13-bae5-14e4550f6e47) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e23b6198-1d1a-4575-aec2-e930172d61df', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:34 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0e4fba6d-5db6-4801-9d82-ef111a949a05 tempest-GroupSnapshotsTest-1246896825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49fa87e3-d3e4-4735-9df1-8d7b6d008bfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:34 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-0e4fba6d-5db6-4801-9d82-ef111a949a05 tempest-GroupSnapshotsTest-1246896825 None] Volume volume-e23b6198-1d1a-4575-aec2-e930172d61df (e23b6198-1d1a-4575-aec2-e930172d61df): created successfully Nov 01 12:25:34 devstack sudo[94780]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_si_htvvmdevstack@QuobyteHD Nov 01 12:25:34 devstack sudo[94780]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:34 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0e4fba6d-5db6-4801-9d82-ef111a949a05 tempest-GroupSnapshotsTest-1246896825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (49fa87e3-d3e4-4735-9df1-8d7b6d008bfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:34 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0e4fba6d-5db6-4801-9d82-ef111a949a05 tempest-GroupSnapshotsTest-1246896825 None] Flow 'volume_create_manager' (f33a391b-dc12-4b27-81f4-65dfc8056636) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:25:34 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-0e4fba6d-5db6-4801-9d82-ef111a949a05 tempest-GroupSnapshotsTest-1246896825 None] Created volume successfully. Nov 01 12:25:34 devstack sudo[94780]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_si_htvvmdevstack@QuobyteHD" returned: 0 in 0.386s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:25:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:25:34 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:25:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-288887555',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4dea6740-5a36-424b-8321-cc6bf8bed2da,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='89fba3f7dbbe400bbdea46e735351975',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:25:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:25:32Z,use_quota=True,user_id='24a3f424962f485ba077702c2b4d6a8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:25:34 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] Creating volume 4dea6740-5a36-424b-8321-cc6bf8bed2da {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:25:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:25:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:25:34 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:25:34 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:25:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:25:34 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:25:34 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:25:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4dea6740-5a36-424b-8321-cc6bf8bed2da 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:34 devstack sudo[94787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4dea6740-5a36-424b-8321-cc6bf8bed2da 1073741824 Nov 01 12:25:34 devstack sudo[94787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:35 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-976e203e-114a-4306-986f-4fdf47b302af tempest-SnapshotMetadataTestJSON-1328037073 None] Acquiring lock "cinder-9f32cc24-b562-46d1-b5ef-dccdf096363f-delete_snapshot" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:25:35 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-976e203e-114a-4306-986f-4fdf47b302af tempest-SnapshotMetadataTestJSON-1328037073 None] Lock "cinder-9f32cc24-b562-46d1-b5ef-dccdf096363f-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:25:35 devstack sudo[94787]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:35 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-976e203e-114a-4306-986f-4fdf47b302af tempest-SnapshotMetadataTestJSON-1328037073 None] Acquiring lock "cinder-quobyte-40da4098-e6e0-4b77-97a4-c6cd17c856a3" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:25:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4dea6740-5a36-424b-8321-cc6bf8bed2da 1073741824" returned: 0 in 0.695s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:35 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-976e203e-114a-4306-986f-4fdf47b302af tempest-SnapshotMetadataTestJSON-1328037073 None] Lock "cinder-quobyte-40da4098-e6e0-4b77-97a4-c6cd17c856a3" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:25:35 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-976e203e-114a-4306-986f-4fdf47b302af tempest-SnapshotMetadataTestJSON-1328037073 None] Acquiring lock "cinder-quobyte-9f32cc24-b562-46d1-b5ef-dccdf096363f" by "_delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:25:35 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-976e203e-114a-4306-986f-4fdf47b302af tempest-SnapshotMetadataTestJSON-1328037073 None] Lock "cinder-quobyte-9f32cc24-b562-46d1-b5ef-dccdf096363f" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:25:35 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-976e203e-114a-4306-986f-4fdf47b302af tempest-SnapshotMetadataTestJSON-1328037073 None] Deleting offline snapshot 9f32cc24-b562-46d1-b5ef-dccdf096363f of volume 40da4098-e6e0-4b77-97a4-c6cd17c856a3 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:25:35 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-976e203e-114a-4306-986f-4fdf47b302af tempest-SnapshotMetadataTestJSON-1328037073 None] snapshot_file for this snap is: volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3.9f32cc24-b562-46d1-b5ef-dccdf096363f {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:25:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4dea6740-5a36-424b-8321-cc6bf8bed2da {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:35 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d37d78c-0dba-42cf-9bbd-e6d4a14ec25b]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:25:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-976e203e-114a-4306-986f-4fdf47b302af tempest-SnapshotMetadataTestJSON-1328037073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3.9f32cc24-b562-46d1-b5ef-dccdf096363f {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:35 devstack sudo[94793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4dea6740-5a36-424b-8321-cc6bf8bed2da Nov 01 12:25:35 devstack sudo[94793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:35 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-8972653a-d0ed-4e93-9c45-cd6f3f52c49e tempest-GroupSnapshotsTest-1246896825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:25:35 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8972653a-d0ed-4e93-9c45-cd6f3f52c49e tempest-GroupSnapshotsTest-1246896825 None] Flow 'volume_create_manager' (add0b886-0373-451f-a005-884d57123374) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:25:35 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8972653a-d0ed-4e93-9c45-cd6f3f52c49e tempest-GroupSnapshotsTest-1246896825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43123a1d-d375-4547-94c4-85fe38c133cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:35 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8972653a-d0ed-4e93-9c45-cd6f3f52c49e tempest-GroupSnapshotsTest-1246896825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (43123a1d-d375-4547-94c4-85fe38c133cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-72422206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fe88fd74-14a4-4023-b236-20e37dd1ad56,host='devstack@QuobyteHD#QuobyteHD',id=c605a287-4e9e-4b95-9907-37fc65f66ecf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4fc678ab60641eca0ae492c65b6be49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:25:35Z,use_quota=True,user_id='b04fe47e77f14940b3f73a971b0e2339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a636b839-915b-4a85-bd17-38d7dd6683e0),volume_type_id=a636b839-915b-4a85-bd17-38d7dd6683e0)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:35 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8972653a-d0ed-4e93-9c45-cd6f3f52c49e tempest-GroupSnapshotsTest-1246896825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4c430ae-3fa8-47e7-b9bb-015e2566b65d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:35 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8972653a-d0ed-4e93-9c45-cd6f3f52c49e tempest-GroupSnapshotsTest-1246896825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a4c430ae-3fa8-47e7-b9bb-015e2566b65d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:35 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8972653a-d0ed-4e93-9c45-cd6f3f52c49e tempest-GroupSnapshotsTest-1246896825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d16257d7-c1ac-4806-93d8-0d9e6dbe0742) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:35 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8972653a-d0ed-4e93-9c45-cd6f3f52c49e tempest-GroupSnapshotsTest-1246896825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d16257d7-c1ac-4806-93d8-0d9e6dbe0742) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c605a287-4e9e-4b95-9907-37fc65f66ecf', 'volume_name': 'volume-c605a287-4e9e-4b95-9907-37fc65f66ecf', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:35 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8972653a-d0ed-4e93-9c45-cd6f3f52c49e tempest-GroupSnapshotsTest-1246896825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aebb9eb-e6ae-4ddf-94ec-c5209bc6ab7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:35 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8972653a-d0ed-4e93-9c45-cd6f3f52c49e tempest-GroupSnapshotsTest-1246896825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5aebb9eb-e6ae-4ddf-94ec-c5209bc6ab7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:35 devstack sudo[94794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3.9f32cc24-b562-46d1-b5ef-dccdf096363f Nov 01 12:25:35 devstack sudo[94794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:35 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8972653a-d0ed-4e93-9c45-cd6f3f52c49e tempest-GroupSnapshotsTest-1246896825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23ddf613-5c1d-4c8d-9055-32f2af36da3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:35 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-8972653a-d0ed-4e93-9c45-cd6f3f52c49e tempest-GroupSnapshotsTest-1246896825 None] Volume c605a287-4e9e-4b95-9907-37fc65f66ecf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c605a287-4e9e-4b95-9907-37fc65f66ecf', 'volume_size': 1} Nov 01 12:25:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8972653a-d0ed-4e93-9c45-cd6f3f52c49e tempest-GroupSnapshotsTest-1246896825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:25:35 devstack sudo[94793]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4dea6740-5a36-424b-8321-cc6bf8bed2da" returned: 0 in 0.339s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:35 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] <== create_volume: return (1136ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:25:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.138s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:25:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8972653a-d0ed-4e93-9c45-cd6f3f52c49e tempest-GroupSnapshotsTest-1246896825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.188s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:25:35 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-8972653a-d0ed-4e93-9c45-cd6f3f52c49e tempest-GroupSnapshotsTest-1246896825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=fe88fd74-14a4-4023-b236-20e37dd1ad56,created_at=2026-11-01T11:25:35Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-72422206',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=fe88fd74-14a4-4023-b236-20e37dd1ad56,host='devstack@QuobyteHD#QuobyteHD',id=c605a287-4e9e-4b95-9907-37fc65f66ecf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4fc678ab60641eca0ae492c65b6be49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:25:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:25:35Z,use_quota=True,user_id='b04fe47e77f14940b3f73a971b0e2339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a636b839-915b-4a85-bd17-38d7dd6683e0),volume_type_id=a636b839-915b-4a85-bd17-38d7dd6683e0)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:25:35 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-8972653a-d0ed-4e93-9c45-cd6f3f52c49e tempest-GroupSnapshotsTest-1246896825 None] Creating volume c605a287-4e9e-4b95-9907-37fc65f66ecf {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:25:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8972653a-d0ed-4e93-9c45-cd6f3f52c49e tempest-GroupSnapshotsTest-1246896825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:25:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8972653a-d0ed-4e93-9c45-cd6f3f52c49e tempest-GroupSnapshotsTest-1246896825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:25:35 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-8972653a-d0ed-4e93-9c45-cd6f3f52c49e tempest-GroupSnapshotsTest-1246896825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:25:35 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-8972653a-d0ed-4e93-9c45-cd6f3f52c49e tempest-GroupSnapshotsTest-1246896825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:25:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8972653a-d0ed-4e93-9c45-cd6f3f52c49e tempest-GroupSnapshotsTest-1246896825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:25:35 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-8972653a-d0ed-4e93-9c45-cd6f3f52c49e tempest-GroupSnapshotsTest-1246896825 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:25:35 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-8972653a-d0ed-4e93-9c45-cd6f3f52c49e tempest-GroupSnapshotsTest-1246896825 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:25:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8972653a-d0ed-4e93-9c45-cd6f3f52c49e tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c605a287-4e9e-4b95-9907-37fc65f66ecf 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:35 devstack sudo[94798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c605a287-4e9e-4b95-9907-37fc65f66ecf 1073741824 Nov 01 12:25:35 devstack sudo[94798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:35 devstack cinder-volume[86574]: DEBUG cinder.volume.volume_utils [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] Attempting download of f937a0d6-76b6-4a84-a698-e474557181cd ((None, [{'url': 'file:///opt/stack/data/glance/images/f937a0d6-76b6-4a84-a698-e474557181cd', 'metadata': {}}])) to volume 4dea6740-5a36-424b-8321-cc6bf8bed2da. {{(pid=86574) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 01 12:25:35 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[245e8844-1d7b-4abe-86b1-b60a3d5e719c]: (4, 'raw') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:25:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f937a0d6-76b6-4a84-a698-e474557181cd_2gohwimg {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:35 devstack sudo[94794]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-976e203e-114a-4306-986f-4fdf47b302af tempest-SnapshotMetadataTestJSON-1328037073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3.9f32cc24-b562-46d1-b5ef-dccdf096363f" returned: 0 in 0.453s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:35 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-976e203e-114a-4306-986f-4fdf47b302af tempest-SnapshotMetadataTestJSON-1328037073 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:25:35 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[325a860a-72c8-4e17-9aba-179cc991ed7c]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:25:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-976e203e-114a-4306-986f-4fdf47b302af tempest-SnapshotMetadataTestJSON-1328037073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:35 devstack sudo[94803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f937a0d6-76b6-4a84-a698-e474557181cd_2gohwimg Nov 01 12:25:35 devstack sudo[94803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:35 devstack sudo[94804]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3 Nov 01 12:25:35 devstack sudo[94804]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:35 devstack sudo[94803]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f937a0d6-76b6-4a84-a698-e474557181cd_2gohwimg" returned: 0 in 0.358s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f937a0d6-76b6-4a84-a698-e474557181cd_2gohwimg {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:35 devstack sudo[94798]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8972653a-d0ed-4e93-9c45-cd6f3f52c49e tempest-GroupSnapshotsTest-1246896825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c605a287-4e9e-4b95-9907-37fc65f66ecf 1073741824" returned: 0 in 0.486s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8972653a-d0ed-4e93-9c45-cd6f3f52c49e tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c605a287-4e9e-4b95-9907-37fc65f66ecf {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:36 devstack sudo[94816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c605a287-4e9e-4b95-9907-37fc65f66ecf Nov 01 12:25:36 devstack sudo[94816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:36 devstack sudo[94813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f937a0d6-76b6-4a84-a698-e474557181cd_2gohwimg Nov 01 12:25:36 devstack sudo[94813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:36 devstack sudo[94804]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-976e203e-114a-4306-986f-4fdf47b302af tempest-SnapshotMetadataTestJSON-1328037073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3" returned: 0 in 0.466s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-976e203e-114a-4306-986f-4fdf47b302af tempest-SnapshotMetadataTestJSON-1328037073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3.9f32cc24-b562-46d1-b5ef-dccdf096363f {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:36 devstack sudo[94820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3.9f32cc24-b562-46d1-b5ef-dccdf096363f Nov 01 12:25:36 devstack sudo[94820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:36 devstack sudo[94813]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f937a0d6-76b6-4a84-a698-e474557181cd_2gohwimg" returned: 1 in 0.414s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f937a0d6-76b6-4a84-a698-e474557181cd_2gohwimg' failed. Not Retrying. {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 12:25:36 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd5ccc06-268f-4dec-9a74-9044e60ab512]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:25:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_si_htvvmdevstack@QuobyteHD {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:36 devstack sudo[94816]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8972653a-d0ed-4e93-9c45-cd6f3f52c49e tempest-GroupSnapshotsTest-1246896825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c605a287-4e9e-4b95-9907-37fc65f66ecf" returned: 0 in 0.385s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:36 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-8972653a-d0ed-4e93-9c45-cd6f3f52c49e tempest-GroupSnapshotsTest-1246896825 None] <== create_volume: return (929ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:25:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8972653a-d0ed-4e93-9c45-cd6f3f52c49e tempest-GroupSnapshotsTest-1246896825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:25:36 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8972653a-d0ed-4e93-9c45-cd6f3f52c49e tempest-GroupSnapshotsTest-1246896825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (23ddf613-5c1d-4c8d-9055-32f2af36da3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c605a287-4e9e-4b95-9907-37fc65f66ecf', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:36 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8972653a-d0ed-4e93-9c45-cd6f3f52c49e tempest-GroupSnapshotsTest-1246896825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8589115d-811c-4b26-98b3-07d5140d3cec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:36 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-8972653a-d0ed-4e93-9c45-cd6f3f52c49e tempest-GroupSnapshotsTest-1246896825 None] Volume volume-c605a287-4e9e-4b95-9907-37fc65f66ecf (c605a287-4e9e-4b95-9907-37fc65f66ecf): created successfully Nov 01 12:25:36 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8972653a-d0ed-4e93-9c45-cd6f3f52c49e tempest-GroupSnapshotsTest-1246896825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8589115d-811c-4b26-98b3-07d5140d3cec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:36 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8972653a-d0ed-4e93-9c45-cd6f3f52c49e tempest-GroupSnapshotsTest-1246896825 None] Flow 'volume_create_manager' (add0b886-0373-451f-a005-884d57123374) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:25:36 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-8972653a-d0ed-4e93-9c45-cd6f3f52c49e tempest-GroupSnapshotsTest-1246896825 None] Created volume successfully. Nov 01 12:25:36 devstack sudo[94825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_si_htvvmdevstack@QuobyteHD Nov 01 12:25:36 devstack sudo[94825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:36 devstack sudo[94820]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-976e203e-114a-4306-986f-4fdf47b302af tempest-SnapshotMetadataTestJSON-1328037073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3.9f32cc24-b562-46d1-b5ef-dccdf096363f" returned: 0 in 0.441s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-976e203e-114a-4306-986f-4fdf47b302af tempest-SnapshotMetadataTestJSON-1328037073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3.9f32cc24-b562-46d1-b5ef-dccdf096363f {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:36 devstack sudo[94830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3.9f32cc24-b562-46d1-b5ef-dccdf096363f Nov 01 12:25:36 devstack sudo[94830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:36 devstack sudo[94825]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_si_htvvmdevstack@QuobyteHD" returned: 0 in 0.408s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:36 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] f937a0d6-76b6-4a84-a698-e474557181cd was qcow2, converting to qcow2 {{(pid=86574) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 01 12:25:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_si_htvvmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4dea6740-5a36-424b-8321-cc6bf8bed2da {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:36 devstack sudo[94836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_si_htvvmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4dea6740-5a36-424b-8321-cc6bf8bed2da Nov 01 12:25:36 devstack sudo[94836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:36 devstack sudo[94830]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-976e203e-114a-4306-986f-4fdf47b302af tempest-SnapshotMetadataTestJSON-1328037073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3.9f32cc24-b562-46d1-b5ef-dccdf096363f" returned: 0 in 0.279s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:36 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-976e203e-114a-4306-986f-4fdf47b302af tempest-SnapshotMetadataTestJSON-1328037073 None] Lock "cinder-quobyte-9f32cc24-b562-46d1-b5ef-dccdf096363f" released by "_delete_snapshot" :: held 1.806s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:25:36 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-976e203e-114a-4306-986f-4fdf47b302af tempest-SnapshotMetadataTestJSON-1328037073 None] Lock "cinder-quobyte-40da4098-e6e0-4b77-97a4-c6cd17c856a3" released by "delete_snapshot" :: held 1.848s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:25:36 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-976e203e-114a-4306-986f-4fdf47b302af tempest-SnapshotMetadataTestJSON-1328037073 None] Created reservations ['10b19b1b-de72-4e37-bd65-d26f40b25933', '22d1fa25-c812-4bbb-a542-910f16af9a6e', 'c2352ca5-d4fa-494c-b8b3-e1ff47b16886', 'd88d018a-b9a3-4241-a96e-a98d1f239266'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:25:37 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-976e203e-114a-4306-986f-4fdf47b302af tempest-SnapshotMetadataTestJSON-1328037073 None] Delete snapshot completed successfully. Nov 01 12:25:37 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-976e203e-114a-4306-986f-4fdf47b302af tempest-SnapshotMetadataTestJSON-1328037073 None] Lock "cinder-9f32cc24-b562-46d1-b5ef-dccdf096363f-delete_snapshot" released by "delete_snapshot" :: held 2.012s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:25:37 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-059a6648-a3ae-4a62-8a69-d2a74b6ce810 tempest-SnapshotMetadataTestJSON-1328037073 None] Acquiring lock "cinder-40da4098-e6e0-4b77-97a4-c6cd17c856a3-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:25:37 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-059a6648-a3ae-4a62-8a69-d2a74b6ce810 tempest-SnapshotMetadataTestJSON-1328037073 None] Lock "cinder-40da4098-e6e0-4b77-97a4-c6cd17c856a3-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:25:37 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-059a6648-a3ae-4a62-8a69-d2a74b6ce810 tempest-SnapshotMetadataTestJSON-1328037073 None] Acquiring lock "cinder-quobyte-40da4098-e6e0-4b77-97a4-c6cd17c856a3" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:25:37 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-059a6648-a3ae-4a62-8a69-d2a74b6ce810 tempest-SnapshotMetadataTestJSON-1328037073 None] Lock "cinder-quobyte-40da4098-e6e0-4b77-97a4-c6cd17c856a3" acquired by "delete_volume" :: waited 0.018s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:25:37 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[2e18c90f-f241-44d0-890c-f0326f48e38b]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:25:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-059a6648-a3ae-4a62-8a69-d2a74b6ce810 tempest-SnapshotMetadataTestJSON-1328037073 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:37 devstack sudo[94843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3 Nov 01 12:25:37 devstack sudo[94843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:37 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-1587555e-ada4-4c36-b5c1-566e70846280 tempest-GroupSnapshotsTest-1246896825 None] Update group completed successfully. Nov 01 12:25:37 devstack sudo[94843]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-059a6648-a3ae-4a62-8a69-d2a74b6ce810 tempest-SnapshotMetadataTestJSON-1328037073 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3" returned: 0 in 0.493s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-059a6648-a3ae-4a62-8a69-d2a74b6ce810 tempest-SnapshotMetadataTestJSON-1328037073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:37 devstack sudo[94849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3 Nov 01 12:25:37 devstack sudo[94849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:38 devstack sudo[94849]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-059a6648-a3ae-4a62-8a69-d2a74b6ce810 tempest-SnapshotMetadataTestJSON-1328037073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-40da4098-e6e0-4b77-97a4-c6cd17c856a3" returned: 0 in 0.298s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:38 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-059a6648-a3ae-4a62-8a69-d2a74b6ce810 tempest-SnapshotMetadataTestJSON-1328037073 None] Lock "cinder-quobyte-40da4098-e6e0-4b77-97a4-c6cd17c856a3" released by "delete_volume" :: held 0.880s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:25:38 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-059a6648-a3ae-4a62-8a69-d2a74b6ce810 tempest-SnapshotMetadataTestJSON-1328037073 None] Created reservations ['fdd23abd-acbe-484b-9da2-03d26308ba7e', 'd47ff37e-772f-44e2-9753-e893b638e4cc', 'dee81db1-ad6e-4fed-8d78-fd3aefd86e41', '2a7fb8cb-e466-4f4e-9e17-ca56a3aeb93d'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:25:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-059a6648-a3ae-4a62-8a69-d2a74b6ce810 tempest-SnapshotMetadataTestJSON-1328037073 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:25:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-059a6648-a3ae-4a62-8a69-d2a74b6ce810 tempest-SnapshotMetadataTestJSON-1328037073 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:25:38 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-059a6648-a3ae-4a62-8a69-d2a74b6ce810 tempest-SnapshotMetadataTestJSON-1328037073 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:25:38 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-059a6648-a3ae-4a62-8a69-d2a74b6ce810 tempest-SnapshotMetadataTestJSON-1328037073 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:25:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-059a6648-a3ae-4a62-8a69-d2a74b6ce810 tempest-SnapshotMetadataTestJSON-1328037073 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:25:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-059a6648-a3ae-4a62-8a69-d2a74b6ce810 tempest-SnapshotMetadataTestJSON-1328037073 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:38 devstack sudo[94856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:25:38 devstack sudo[94856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:38 devstack sudo[94856]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-059a6648-a3ae-4a62-8a69-d2a74b6ce810 tempest-SnapshotMetadataTestJSON-1328037073 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.326s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:38 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-059a6648-a3ae-4a62-8a69-d2a74b6ce810 tempest-SnapshotMetadataTestJSON-1328037073 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:25:38 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-059a6648-a3ae-4a62-8a69-d2a74b6ce810 tempest-SnapshotMetadataTestJSON-1328037073 None] Deleted volume successfully. Nov 01 12:25:38 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-059a6648-a3ae-4a62-8a69-d2a74b6ce810 tempest-SnapshotMetadataTestJSON-1328037073 None] Lock "cinder-40da4098-e6e0-4b77-97a4-c6cd17c856a3-delete_volume" released by "delete_volume" :: held 1.524s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:25:39 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-538db9da-d3f8-4921-93ad-baa125042d15 tempest-GroupSnapshotsTest-1246896825 None] Update group completed successfully. Nov 01 12:25:39 devstack sudo[94836]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_si_htvvmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4dea6740-5a36-424b-8321-cc6bf8bed2da" returned: 0 in 2.410s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:39 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_si_htvvmdevstack@QuobyteHD, size 112.00 MB, duration 2.41 sec, destination /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4dea6740-5a36-424b-8321-cc6bf8bed2da {{(pid=86574) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 12:25:39 devstack cinder-volume[86574]: INFO cinder.image.image_utils [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] Converted 112.00 MB image at 46.45 MB/s Nov 01 12:25:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4dea6740-5a36-424b-8321-cc6bf8bed2da 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:39 devstack sudo[94860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4dea6740-5a36-424b-8321-cc6bf8bed2da 1G Nov 01 12:25:39 devstack sudo[94860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:39 devstack sudo[94860]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4dea6740-5a36-424b-8321-cc6bf8bed2da 1G" returned: 0 in 0.434s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:39 devstack cinder-volume[86574]: DEBUG cinder.volume.volume_utils [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] Downloaded image f937a0d6-76b6-4a84-a698-e474557181cd ((None, [{'url': 'file:///opt/stack/data/glance/images/f937a0d6-76b6-4a84-a698-e474557181cd', 'metadata': {}}])) to volume 4dea6740-5a36-424b-8321-cc6bf8bed2da successfully. {{(pid=86574) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 01 12:25:39 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] Temporary image f937a0d6-76b6-4a84-a698-e474557181cd for user 24a3f424962f485ba077702c2b4d6a8f is deleted. {{(pid=86574) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 01 12:25:39 devstack cinder-volume[86574]: DEBUG cinder.volume.volume_utils [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] Marking volume 4dea6740-5a36-424b-8321-cc6bf8bed2da as bootable. {{(pid=86574) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 01 12:25:39 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] Copying metadata from image f937a0d6-76b6-4a84-a698-e474557181cd to 4dea6740-5a36-424b-8321-cc6bf8bed2da. {{(pid=86574) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 01 12:25:39 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] Creating volume glance metadata for volume 4dea6740-5a36-424b-8321-cc6bf8bed2da backed by image f937a0d6-76b6-4a84-a698-e474557181cd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f937a0d6-76b6-4a84-a698-e474557181cd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86574) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 01 12:25:39 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (058fc6e0-740a-4ea8-a54c-89eb29c63dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4dea6740-5a36-424b-8321-cc6bf8bed2da', 'volume_size': 1, 'image_id': 'f937a0d6-76b6-4a84-a698-e474557181cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f937a0d6-76b6-4a84-a698-e474557181cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4892ea0f5a04c4d8b924ece0f60a2a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f937a0d6-76b6-4a84-a698-e474557181cd', 'created_at': datetime.datetime(2026, 11, 1, 11, 14, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 14, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f937a0d6-76b6-4a84-a698-e474557181cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:39 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1186fd2a-5611-46fa-886f-343fec09a38d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:39 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] Volume volume-4dea6740-5a36-424b-8321-cc6bf8bed2da (4dea6740-5a36-424b-8321-cc6bf8bed2da): created successfully Nov 01 12:25:39 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1186fd2a-5611-46fa-886f-343fec09a38d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:39 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] Flow 'volume_create_manager' (9aa5142a-d28f-44e4-880e-aa6e2e35387a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:25:39 devstack cinder-volume[86574]: DEBUG oslo_service.periodic_task [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86574) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:25:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:25:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:25:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:25:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:25:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:25:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:39 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-e842d23e-d714-485b-b01e-039c4b1c2a13 tempest-ServerActionsTestOtherA-2064758512 None] Created volume successfully. Nov 01 12:25:39 devstack sudo[94872]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:25:39 devstack sudo[94872]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:40 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-5243e9f5-1b00-4980-8d5a-db5fd96b1cb9 tempest-GroupSnapshotsTest-1246896825 None] Update group completed successfully. Nov 01 12:25:40 devstack sudo[94872]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.462s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:40 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:25:40 devstack cinder-volume[86574]: DEBUG oslo_service.periodic_task [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running periodic task VolumeManager._thread_info {{(pid=86574) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:25:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] thread count: 28 {{(pid=86574) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 12:25:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] thread info: [<_MainThread(MainThread, started 131331184930944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86574) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 12:25:41 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-3d8f168b-c507-436c-873f-80ab170108d4 tempest-GroupSnapshotsTest-1246896825 None] Update group completed successfully. Nov 01 12:25:43 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-d3273e53-cbf6-4c01-b543-3ea6333b9d11 tempest-GroupSnapshotsTest-1246896825 None] GroupSnapshot 8a6779cf-11b0-4e48-978f-c459d9caa36d: creating. Nov 01 12:25:43 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d3273e53-cbf6-4c01-b543-3ea6333b9d11 tempest-GroupSnapshotsTest-1246896825 None] Group snapshot 8a6779cf-11b0-4e48-978f-c459d9caa36d: creating. {{(pid=86574) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 01 12:25:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d3273e53-cbf6-4c01-b543-3ea6333b9d11 tempest-GroupSnapshotsTest-1246896825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:25:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d3273e53-cbf6-4c01-b543-3ea6333b9d11 tempest-GroupSnapshotsTest-1246896825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:25:43 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-d3273e53-cbf6-4c01-b543-3ea6333b9d11 tempest-GroupSnapshotsTest-1246896825 None] Creating offline snapshot 63e0a93e-c7b9-4133-bd6f-d410f600604c of volume c605a287-4e9e-4b95-9907-37fc65f66ecf {{(pid=86574) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:25:43 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[15971088-e30f-40c5-9cd1-ea03e89f47d7]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:25:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d3273e53-cbf6-4c01-b543-3ea6333b9d11 tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c605a287-4e9e-4b95-9907-37fc65f66ecf {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:43 devstack sudo[94908]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c605a287-4e9e-4b95-9907-37fc65f66ecf Nov 01 12:25:43 devstack sudo[94908]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:44 devstack sudo[94908]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d3273e53-cbf6-4c01-b543-3ea6333b9d11 tempest-GroupSnapshotsTest-1246896825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c605a287-4e9e-4b95-9907-37fc65f66ecf" returned: 0 in 0.886s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d3273e53-cbf6-4c01-b543-3ea6333b9d11 tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c605a287-4e9e-4b95-9907-37fc65f66ecf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c605a287-4e9e-4b95-9907-37fc65f66ecf.63e0a93e-c7b9-4133-bd6f-d410f600604c 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:44 devstack sudo[94960]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c605a287-4e9e-4b95-9907-37fc65f66ecf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c605a287-4e9e-4b95-9907-37fc65f66ecf.63e0a93e-c7b9-4133-bd6f-d410f600604c 1G Nov 01 12:25:44 devstack sudo[94960]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:45 devstack sudo[94960]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d3273e53-cbf6-4c01-b543-3ea6333b9d11 tempest-GroupSnapshotsTest-1246896825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c605a287-4e9e-4b95-9907-37fc65f66ecf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c605a287-4e9e-4b95-9907-37fc65f66ecf.63e0a93e-c7b9-4133-bd6f-d410f600604c 1G" returned: 0 in 0.911s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d3273e53-cbf6-4c01-b543-3ea6333b9d11 tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c605a287-4e9e-4b95-9907-37fc65f66ecf -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c605a287-4e9e-4b95-9907-37fc65f66ecf.63e0a93e-c7b9-4133-bd6f-d410f600604c {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:45 devstack sudo[94981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c605a287-4e9e-4b95-9907-37fc65f66ecf -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c605a287-4e9e-4b95-9907-37fc65f66ecf.63e0a93e-c7b9-4133-bd6f-d410f600604c Nov 01 12:25:45 devstack sudo[94981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-552adcf3-e8f7-4938-adc7-65ba34674a27 req-b8b3ba17-cfc0-48e5-9296-b33e87e1cc39 tempest-ServerActionsTestOtherA-2064758512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:25:45 devstack sudo[94981]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d3273e53-cbf6-4c01-b543-3ea6333b9d11 tempest-GroupSnapshotsTest-1246896825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-c605a287-4e9e-4b95-9907-37fc65f66ecf -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c605a287-4e9e-4b95-9907-37fc65f66ecf.63e0a93e-c7b9-4133-bd6f-d410f600604c" returned: 0 in 0.592s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:45 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-d3273e53-cbf6-4c01-b543-3ea6333b9d11 tempest-GroupSnapshotsTest-1246896825 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c605a287-4e9e-4b95-9907-37fc65f66ecf.63e0a93e-c7b9-4133-bd6f-d410f600604c is being set with open permissions: ugo+rw: NotImplementedError Nov 01 12:25:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d3273e53-cbf6-4c01-b543-3ea6333b9d11 tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c605a287-4e9e-4b95-9907-37fc65f66ecf.63e0a93e-c7b9-4133-bd6f-d410f600604c {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:45 devstack sudo[94991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c605a287-4e9e-4b95-9907-37fc65f66ecf.63e0a93e-c7b9-4133-bd6f-d410f600604c Nov 01 12:25:45 devstack sudo[94991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:46 devstack sudo[94991]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d3273e53-cbf6-4c01-b543-3ea6333b9d11 tempest-GroupSnapshotsTest-1246896825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c605a287-4e9e-4b95-9907-37fc65f66ecf.63e0a93e-c7b9-4133-bd6f-d410f600604c" returned: 0 in 0.519s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d3273e53-cbf6-4c01-b543-3ea6333b9d11 tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c605a287-4e9e-4b95-9907-37fc65f66ecf.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:46 devstack sudo[94994]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c605a287-4e9e-4b95-9907-37fc65f66ecf.info Nov 01 12:25:46 devstack sudo[94994]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:47 devstack sudo[94994]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d3273e53-cbf6-4c01-b543-3ea6333b9d11 tempest-GroupSnapshotsTest-1246896825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c605a287-4e9e-4b95-9907-37fc65f66ecf.info" returned: 0 in 0.620s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:47 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-d3273e53-cbf6-4c01-b543-3ea6333b9d11 tempest-GroupSnapshotsTest-1246896825 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c605a287-4e9e-4b95-9907-37fc65f66ecf.info is being set with open permissions: ugo+rw: NotImplementedError Nov 01 12:25:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d3273e53-cbf6-4c01-b543-3ea6333b9d11 tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c605a287-4e9e-4b95-9907-37fc65f66ecf.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:47 devstack sudo[94997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c605a287-4e9e-4b95-9907-37fc65f66ecf.info Nov 01 12:25:47 devstack sudo[94997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:47 devstack sudo[94997]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d3273e53-cbf6-4c01-b543-3ea6333b9d11 tempest-GroupSnapshotsTest-1246896825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c605a287-4e9e-4b95-9907-37fc65f66ecf.info" returned: 0 in 0.403s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d3273e53-cbf6-4c01-b543-3ea6333b9d11 tempest-GroupSnapshotsTest-1246896825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.157s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:25:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d3273e53-cbf6-4c01-b543-3ea6333b9d11 tempest-GroupSnapshotsTest-1246896825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:25:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d3273e53-cbf6-4c01-b543-3ea6333b9d11 tempest-GroupSnapshotsTest-1246896825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:25:47 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-d3273e53-cbf6-4c01-b543-3ea6333b9d11 tempest-GroupSnapshotsTest-1246896825 None] Creating offline snapshot d0c0ad63-5c1d-4926-bd02-f261779112a5 of volume e23b6198-1d1a-4575-aec2-e930172d61df {{(pid=86574) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:25:47 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[4fc29d3e-559e-40d5-b226-d2e8014ce10b]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:25:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d3273e53-cbf6-4c01-b543-3ea6333b9d11 tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e23b6198-1d1a-4575-aec2-e930172d61df {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:47 devstack sudo[95000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e23b6198-1d1a-4575-aec2-e930172d61df Nov 01 12:25:47 devstack sudo[95000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:48 devstack sudo[95000]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d3273e53-cbf6-4c01-b543-3ea6333b9d11 tempest-GroupSnapshotsTest-1246896825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e23b6198-1d1a-4575-aec2-e930172d61df" returned: 0 in 0.651s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d3273e53-cbf6-4c01-b543-3ea6333b9d11 tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e23b6198-1d1a-4575-aec2-e930172d61df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e23b6198-1d1a-4575-aec2-e930172d61df.d0c0ad63-5c1d-4926-bd02-f261779112a5 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:48 devstack sudo[95008]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e23b6198-1d1a-4575-aec2-e930172d61df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e23b6198-1d1a-4575-aec2-e930172d61df.d0c0ad63-5c1d-4926-bd02-f261779112a5 1G Nov 01 12:25:48 devstack sudo[95008]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:48 devstack sudo[95008]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d3273e53-cbf6-4c01-b543-3ea6333b9d11 tempest-GroupSnapshotsTest-1246896825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e23b6198-1d1a-4575-aec2-e930172d61df,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e23b6198-1d1a-4575-aec2-e930172d61df.d0c0ad63-5c1d-4926-bd02-f261779112a5 1G" returned: 0 in 0.761s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d3273e53-cbf6-4c01-b543-3ea6333b9d11 tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e23b6198-1d1a-4575-aec2-e930172d61df -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e23b6198-1d1a-4575-aec2-e930172d61df.d0c0ad63-5c1d-4926-bd02-f261779112a5 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:48 devstack sudo[95014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e23b6198-1d1a-4575-aec2-e930172d61df -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e23b6198-1d1a-4575-aec2-e930172d61df.d0c0ad63-5c1d-4926-bd02-f261779112a5 Nov 01 12:25:48 devstack sudo[95014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:49 devstack sudo[95014]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d3273e53-cbf6-4c01-b543-3ea6333b9d11 tempest-GroupSnapshotsTest-1246896825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e23b6198-1d1a-4575-aec2-e930172d61df -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e23b6198-1d1a-4575-aec2-e930172d61df.d0c0ad63-5c1d-4926-bd02-f261779112a5" returned: 0 in 0.505s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:49 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-d3273e53-cbf6-4c01-b543-3ea6333b9d11 tempest-GroupSnapshotsTest-1246896825 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e23b6198-1d1a-4575-aec2-e930172d61df.d0c0ad63-5c1d-4926-bd02-f261779112a5 is being set with open permissions: ugo+rw: NotImplementedError Nov 01 12:25:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d3273e53-cbf6-4c01-b543-3ea6333b9d11 tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e23b6198-1d1a-4575-aec2-e930172d61df.d0c0ad63-5c1d-4926-bd02-f261779112a5 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:49 devstack sudo[95019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e23b6198-1d1a-4575-aec2-e930172d61df.d0c0ad63-5c1d-4926-bd02-f261779112a5 Nov 01 12:25:49 devstack sudo[95019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:49 devstack sudo[95019]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d3273e53-cbf6-4c01-b543-3ea6333b9d11 tempest-GroupSnapshotsTest-1246896825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e23b6198-1d1a-4575-aec2-e930172d61df.d0c0ad63-5c1d-4926-bd02-f261779112a5" returned: 0 in 0.486s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d3273e53-cbf6-4c01-b543-3ea6333b9d11 tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e23b6198-1d1a-4575-aec2-e930172d61df.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:50 devstack sudo[95022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e23b6198-1d1a-4575-aec2-e930172d61df.info Nov 01 12:25:50 devstack sudo[95022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:50 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-452f83e6-2fec-4308-bca3-7ee167309e9c tempest-VolumesMetadataTest-1312697690 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:25:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-452f83e6-2fec-4308-bca3-7ee167309e9c tempest-VolumesMetadataTest-1312697690 None] Flow 'volume_create_manager' (766758e9-ce74-44d6-a27e-49c6f01e2365) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:25:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-452f83e6-2fec-4308-bca3-7ee167309e9c tempest-VolumesMetadataTest-1312697690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeddcd8f-87e2-415a-a77a-d25a4d9f374f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-452f83e6-2fec-4308-bca3-7ee167309e9c tempest-VolumesMetadataTest-1312697690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aeddcd8f-87e2-415a-a77a-d25a4d9f374f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-16321195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28d75d41-7d61-4fa8-9612-3fa98f54ea5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b5d529bafba44e38facbe961e4dd720',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:25:50Z,use_quota=True,user_id='5284877587c1442bad69525011f7233f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-452f83e6-2fec-4308-bca3-7ee167309e9c tempest-VolumesMetadataTest-1312697690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c234db79-0bc2-4fe2-bd03-1184a0578baf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-452f83e6-2fec-4308-bca3-7ee167309e9c tempest-VolumesMetadataTest-1312697690 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c234db79-0bc2-4fe2-bd03-1184a0578baf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-452f83e6-2fec-4308-bca3-7ee167309e9c tempest-VolumesMetadataTest-1312697690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73b62dff-1761-408a-a174-f4c9c82f36c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-452f83e6-2fec-4308-bca3-7ee167309e9c tempest-VolumesMetadataTest-1312697690 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (73b62dff-1761-408a-a174-f4c9c82f36c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '28d75d41-7d61-4fa8-9612-3fa98f54ea5a', 'volume_name': 'volume-28d75d41-7d61-4fa8-9612-3fa98f54ea5a', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:50 devstack sudo[95022]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-452f83e6-2fec-4308-bca3-7ee167309e9c tempest-VolumesMetadataTest-1312697690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1938abb6-d9de-4b96-a9ed-684797ae0485) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-452f83e6-2fec-4308-bca3-7ee167309e9c tempest-VolumesMetadataTest-1312697690 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1938abb6-d9de-4b96-a9ed-684797ae0485) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-452f83e6-2fec-4308-bca3-7ee167309e9c tempest-VolumesMetadataTest-1312697690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a44436f-1bc5-4d99-a3ce-55585729f39c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:50 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-452f83e6-2fec-4308-bca3-7ee167309e9c tempest-VolumesMetadataTest-1312697690 None] Volume 28d75d41-7d61-4fa8-9612-3fa98f54ea5a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-28d75d41-7d61-4fa8-9612-3fa98f54ea5a', 'volume_size': 1} Nov 01 12:25:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-452f83e6-2fec-4308-bca3-7ee167309e9c tempest-VolumesMetadataTest-1312697690 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:25:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d3273e53-cbf6-4c01-b543-3ea6333b9d11 tempest-GroupSnapshotsTest-1246896825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e23b6198-1d1a-4575-aec2-e930172d61df.info" returned: 0 in 0.466s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:50 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-d3273e53-cbf6-4c01-b543-3ea6333b9d11 tempest-GroupSnapshotsTest-1246896825 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e23b6198-1d1a-4575-aec2-e930172d61df.info is being set with open permissions: ugo+rw: NotImplementedError Nov 01 12:25:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d3273e53-cbf6-4c01-b543-3ea6333b9d11 tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e23b6198-1d1a-4575-aec2-e930172d61df.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:50 devstack sudo[95026]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e23b6198-1d1a-4575-aec2-e930172d61df.info Nov 01 12:25:50 devstack sudo[95026]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:50 devstack sudo[95026]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d3273e53-cbf6-4c01-b543-3ea6333b9d11 tempest-GroupSnapshotsTest-1246896825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e23b6198-1d1a-4575-aec2-e930172d61df.info" returned: 0 in 0.288s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d3273e53-cbf6-4c01-b543-3ea6333b9d11 tempest-GroupSnapshotsTest-1246896825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.303s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:25:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-552adcf3-e8f7-4938-adc7-65ba34674a27 req-b8b3ba17-cfc0-48e5-9296-b33e87e1cc39 tempest-ServerActionsTestOtherA-2064758512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 5.215s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:25:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-552adcf3-e8f7-4938-adc7-65ba34674a27 req-b8b3ba17-cfc0-48e5-9296-b33e87e1cc39 tempest-ServerActionsTestOtherA-2064758512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.034s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:25:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-452f83e6-2fec-4308-bca3-7ee167309e9c tempest-VolumesMetadataTest-1312697690 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.365s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:25:50 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-452f83e6-2fec-4308-bca3-7ee167309e9c tempest-VolumesMetadataTest-1312697690 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:25:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-16321195',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=28d75d41-7d61-4fa8-9612-3fa98f54ea5a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0b5d529bafba44e38facbe961e4dd720',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:25:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:25:50Z,use_quota=True,user_id='5284877587c1442bad69525011f7233f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:25:50 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-452f83e6-2fec-4308-bca3-7ee167309e9c tempest-VolumesMetadataTest-1312697690 None] Creating volume 28d75d41-7d61-4fa8-9612-3fa98f54ea5a {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:25:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-452f83e6-2fec-4308-bca3-7ee167309e9c tempest-VolumesMetadataTest-1312697690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:25:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-452f83e6-2fec-4308-bca3-7ee167309e9c tempest-VolumesMetadataTest-1312697690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:25:50 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-452f83e6-2fec-4308-bca3-7ee167309e9c tempest-VolumesMetadataTest-1312697690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:25:50 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-452f83e6-2fec-4308-bca3-7ee167309e9c tempest-VolumesMetadataTest-1312697690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:25:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-452f83e6-2fec-4308-bca3-7ee167309e9c tempest-VolumesMetadataTest-1312697690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:25:50 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-452f83e6-2fec-4308-bca3-7ee167309e9c tempest-VolumesMetadataTest-1312697690 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:25:50 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-452f83e6-2fec-4308-bca3-7ee167309e9c tempest-VolumesMetadataTest-1312697690 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:25:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-452f83e6-2fec-4308-bca3-7ee167309e9c tempest-VolumesMetadataTest-1312697690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-28d75d41-7d61-4fa8-9612-3fa98f54ea5a 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:50 devstack sudo[95030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-28d75d41-7d61-4fa8-9612-3fa98f54ea5a 1073741824 Nov 01 12:25:50 devstack sudo[95030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-552adcf3-e8f7-4938-adc7-65ba34674a27 req-b8b3ba17-cfc0-48e5-9296-b33e87e1cc39 tempest-ServerActionsTestOtherA-2064758512 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb', 'name': 'volume-4dea6740-5a36-424b-8321-cc6bf8bed2da', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '599e656a-0a2c-430a-b640-9e6d13475d12', 'enforce_multipath': True} {{(pid=86574) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 12:25:51 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-d3273e53-cbf6-4c01-b543-3ea6333b9d11 tempest-GroupSnapshotsTest-1246896825 None] group_snapshot 8a6779cf-11b0-4e48-978f-c459d9caa36d: created successfully Nov 01 12:25:51 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-552adcf3-e8f7-4938-adc7-65ba34674a27 req-b8b3ba17-cfc0-48e5-9296-b33e87e1cc39 tempest-ServerActionsTestOtherA-2064758512 None] attachment_update completed successfully. Nov 01 12:25:51 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-676be82d-815d-4851-b477-d94b813804ef tempest-GroupSnapshotsTest-1246896825 None] group_snapshot 8a6779cf-11b0-4e48-978f-c459d9caa36d: deleting Nov 01 12:25:51 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-676be82d-815d-4851-b477-d94b813804ef tempest-GroupSnapshotsTest-1246896825 None] group_snapshot 8a6779cf-11b0-4e48-978f-c459d9caa36d: deleting {{(pid=86574) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 01 12:25:51 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-676be82d-815d-4851-b477-d94b813804ef tempest-GroupSnapshotsTest-1246896825 None] Acquiring lock "cinder-quobyte-c605a287-4e9e-4b95-9907-37fc65f66ecf" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:25:51 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-676be82d-815d-4851-b477-d94b813804ef tempest-GroupSnapshotsTest-1246896825 None] Lock "cinder-quobyte-c605a287-4e9e-4b95-9907-37fc65f66ecf" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:25:51 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-676be82d-815d-4851-b477-d94b813804ef tempest-GroupSnapshotsTest-1246896825 None] Acquiring lock "cinder-quobyte-63e0a93e-c7b9-4133-bd6f-d410f600604c" by "_delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:25:51 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-676be82d-815d-4851-b477-d94b813804ef tempest-GroupSnapshotsTest-1246896825 None] Lock "cinder-quobyte-63e0a93e-c7b9-4133-bd6f-d410f600604c" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:25:51 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-676be82d-815d-4851-b477-d94b813804ef tempest-GroupSnapshotsTest-1246896825 None] Deleting offline snapshot 63e0a93e-c7b9-4133-bd6f-d410f600604c of volume c605a287-4e9e-4b95-9907-37fc65f66ecf {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:25:51 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-676be82d-815d-4851-b477-d94b813804ef tempest-GroupSnapshotsTest-1246896825 None] snapshot_file for this snap is: volume-c605a287-4e9e-4b95-9907-37fc65f66ecf.63e0a93e-c7b9-4133-bd6f-d410f600604c {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:25:51 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[175ebb25-9d42-4cad-9873-4c16c670b41a]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:25:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-676be82d-815d-4851-b477-d94b813804ef tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c605a287-4e9e-4b95-9907-37fc65f66ecf.63e0a93e-c7b9-4133-bd6f-d410f600604c {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:51 devstack sudo[95030]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-452f83e6-2fec-4308-bca3-7ee167309e9c tempest-VolumesMetadataTest-1312697690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-28d75d41-7d61-4fa8-9612-3fa98f54ea5a 1073741824" returned: 0 in 0.943s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-452f83e6-2fec-4308-bca3-7ee167309e9c tempest-VolumesMetadataTest-1312697690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-28d75d41-7d61-4fa8-9612-3fa98f54ea5a {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:51 devstack sudo[95037]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-28d75d41-7d61-4fa8-9612-3fa98f54ea5a Nov 01 12:25:51 devstack sudo[95037]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:51 devstack sudo[95036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c605a287-4e9e-4b95-9907-37fc65f66ecf.63e0a93e-c7b9-4133-bd6f-d410f600604c Nov 01 12:25:51 devstack sudo[95036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:52 devstack sudo[95037]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-452f83e6-2fec-4308-bca3-7ee167309e9c tempest-VolumesMetadataTest-1312697690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-28d75d41-7d61-4fa8-9612-3fa98f54ea5a" returned: 0 in 0.362s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:52 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-452f83e6-2fec-4308-bca3-7ee167309e9c tempest-VolumesMetadataTest-1312697690 None] <== create_volume: return (1399ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:25:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-452f83e6-2fec-4308-bca3-7ee167309e9c tempest-VolumesMetadataTest-1312697690 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.405s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:25:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-452f83e6-2fec-4308-bca3-7ee167309e9c tempest-VolumesMetadataTest-1312697690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a44436f-1bc5-4d99-a3ce-55585729f39c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-28d75d41-7d61-4fa8-9612-3fa98f54ea5a', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-452f83e6-2fec-4308-bca3-7ee167309e9c tempest-VolumesMetadataTest-1312697690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23a3021d-7aef-451a-92a3-560ffdaa692f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:25:52 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-452f83e6-2fec-4308-bca3-7ee167309e9c tempest-VolumesMetadataTest-1312697690 None] Volume volume-28d75d41-7d61-4fa8-9612-3fa98f54ea5a (28d75d41-7d61-4fa8-9612-3fa98f54ea5a): created successfully Nov 01 12:25:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-452f83e6-2fec-4308-bca3-7ee167309e9c tempest-VolumesMetadataTest-1312697690 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (23a3021d-7aef-451a-92a3-560ffdaa692f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:25:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-452f83e6-2fec-4308-bca3-7ee167309e9c tempest-VolumesMetadataTest-1312697690 None] Flow 'volume_create_manager' (766758e9-ce74-44d6-a27e-49c6f01e2365) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:25:52 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-452f83e6-2fec-4308-bca3-7ee167309e9c tempest-VolumesMetadataTest-1312697690 None] Created volume successfully. Nov 01 12:25:52 devstack sudo[95036]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-676be82d-815d-4851-b477-d94b813804ef tempest-GroupSnapshotsTest-1246896825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c605a287-4e9e-4b95-9907-37fc65f66ecf.63e0a93e-c7b9-4133-bd6f-d410f600604c" returned: 0 in 0.905s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:52 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-676be82d-815d-4851-b477-d94b813804ef tempest-GroupSnapshotsTest-1246896825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c605a287-4e9e-4b95-9907-37fc65f66ecf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:25:52 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b354d91-9a73-47d0-89dd-b74fe8482cb4]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:25:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-676be82d-815d-4851-b477-d94b813804ef tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c605a287-4e9e-4b95-9907-37fc65f66ecf {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:52 devstack sudo[95161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c605a287-4e9e-4b95-9907-37fc65f66ecf Nov 01 12:25:52 devstack sudo[95161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:53 devstack sudo[95161]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-676be82d-815d-4851-b477-d94b813804ef tempest-GroupSnapshotsTest-1246896825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c605a287-4e9e-4b95-9907-37fc65f66ecf" returned: 0 in 0.702s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-676be82d-815d-4851-b477-d94b813804ef tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c605a287-4e9e-4b95-9907-37fc65f66ecf.63e0a93e-c7b9-4133-bd6f-d410f600604c {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:53 devstack sudo[95495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c605a287-4e9e-4b95-9907-37fc65f66ecf.63e0a93e-c7b9-4133-bd6f-d410f600604c Nov 01 12:25:53 devstack sudo[95495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:54 devstack sudo[95495]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-676be82d-815d-4851-b477-d94b813804ef tempest-GroupSnapshotsTest-1246896825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c605a287-4e9e-4b95-9907-37fc65f66ecf.63e0a93e-c7b9-4133-bd6f-d410f600604c" returned: 0 in 0.666s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-676be82d-815d-4851-b477-d94b813804ef tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c605a287-4e9e-4b95-9907-37fc65f66ecf.63e0a93e-c7b9-4133-bd6f-d410f600604c {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:54 devstack sudo[95507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c605a287-4e9e-4b95-9907-37fc65f66ecf.63e0a93e-c7b9-4133-bd6f-d410f600604c Nov 01 12:25:54 devstack sudo[95507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:54 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-80910094-eff8-49ff-b00d-d39e86903a62 tempest-VolumesMetadataTest-1312697690 None] Acquiring lock "cinder-28d75d41-7d61-4fa8-9612-3fa98f54ea5a-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:25:54 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-80910094-eff8-49ff-b00d-d39e86903a62 tempest-VolumesMetadataTest-1312697690 None] Lock "cinder-28d75d41-7d61-4fa8-9612-3fa98f54ea5a-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:25:54 devstack sudo[95507]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-676be82d-815d-4851-b477-d94b813804ef tempest-GroupSnapshotsTest-1246896825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c605a287-4e9e-4b95-9907-37fc65f66ecf.63e0a93e-c7b9-4133-bd6f-d410f600604c" returned: 0 in 0.393s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:54 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-676be82d-815d-4851-b477-d94b813804ef tempest-GroupSnapshotsTest-1246896825 None] Lock "cinder-quobyte-63e0a93e-c7b9-4133-bd6f-d410f600604c" released by "_delete_snapshot" :: held 2.895s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:25:54 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-80910094-eff8-49ff-b00d-d39e86903a62 tempest-VolumesMetadataTest-1312697690 None] Acquiring lock "cinder-quobyte-28d75d41-7d61-4fa8-9612-3fa98f54ea5a" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:25:54 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-676be82d-815d-4851-b477-d94b813804ef tempest-GroupSnapshotsTest-1246896825 None] Lock "cinder-quobyte-c605a287-4e9e-4b95-9907-37fc65f66ecf" released by "delete_snapshot" :: held 2.954s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:25:54 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-80910094-eff8-49ff-b00d-d39e86903a62 tempest-VolumesMetadataTest-1312697690 None] Lock "cinder-quobyte-28d75d41-7d61-4fa8-9612-3fa98f54ea5a" acquired by "delete_volume" :: waited 0.025s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:25:54 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-676be82d-815d-4851-b477-d94b813804ef tempest-GroupSnapshotsTest-1246896825 None] Acquiring lock "cinder-quobyte-e23b6198-1d1a-4575-aec2-e930172d61df" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:25:54 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-676be82d-815d-4851-b477-d94b813804ef tempest-GroupSnapshotsTest-1246896825 None] Lock "cinder-quobyte-e23b6198-1d1a-4575-aec2-e930172d61df" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:25:54 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-676be82d-815d-4851-b477-d94b813804ef tempest-GroupSnapshotsTest-1246896825 None] Acquiring lock "cinder-quobyte-d0c0ad63-5c1d-4926-bd02-f261779112a5" by "_delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:25:54 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[70dc446b-d1e3-4739-b273-21da6cbe975c]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:25:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-80910094-eff8-49ff-b00d-d39e86903a62 tempest-VolumesMetadataTest-1312697690 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-28d75d41-7d61-4fa8-9612-3fa98f54ea5a {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:54 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-676be82d-815d-4851-b477-d94b813804ef tempest-GroupSnapshotsTest-1246896825 None] Lock "cinder-quobyte-d0c0ad63-5c1d-4926-bd02-f261779112a5" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:25:54 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-676be82d-815d-4851-b477-d94b813804ef tempest-GroupSnapshotsTest-1246896825 None] Deleting offline snapshot d0c0ad63-5c1d-4926-bd02-f261779112a5 of volume e23b6198-1d1a-4575-aec2-e930172d61df {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:25:54 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-676be82d-815d-4851-b477-d94b813804ef tempest-GroupSnapshotsTest-1246896825 None] snapshot_file for this snap is: volume-e23b6198-1d1a-4575-aec2-e930172d61df.d0c0ad63-5c1d-4926-bd02-f261779112a5 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:25:54 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[c05c0780-87f4-4c32-afe3-dfaa851cdac4]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:25:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-676be82d-815d-4851-b477-d94b813804ef tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e23b6198-1d1a-4575-aec2-e930172d61df.d0c0ad63-5c1d-4926-bd02-f261779112a5 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:54 devstack sudo[95510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-28d75d41-7d61-4fa8-9612-3fa98f54ea5a Nov 01 12:25:54 devstack sudo[95510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:55 devstack sudo[95513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e23b6198-1d1a-4575-aec2-e930172d61df.d0c0ad63-5c1d-4926-bd02-f261779112a5 Nov 01 12:25:55 devstack sudo[95513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:55 devstack sudo[95510]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-80910094-eff8-49ff-b00d-d39e86903a62 tempest-VolumesMetadataTest-1312697690 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-28d75d41-7d61-4fa8-9612-3fa98f54ea5a" returned: 0 in 0.666s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-80910094-eff8-49ff-b00d-d39e86903a62 tempest-VolumesMetadataTest-1312697690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-28d75d41-7d61-4fa8-9612-3fa98f54ea5a {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:55 devstack sudo[95519]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-28d75d41-7d61-4fa8-9612-3fa98f54ea5a Nov 01 12:25:55 devstack sudo[95519]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:55 devstack sudo[95513]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-676be82d-815d-4851-b477-d94b813804ef tempest-GroupSnapshotsTest-1246896825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e23b6198-1d1a-4575-aec2-e930172d61df.d0c0ad63-5c1d-4926-bd02-f261779112a5" returned: 0 in 0.916s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:55 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-676be82d-815d-4851-b477-d94b813804ef tempest-GroupSnapshotsTest-1246896825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e23b6198-1d1a-4575-aec2-e930172d61df(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:25:55 devstack sudo[95519]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-80910094-eff8-49ff-b00d-d39e86903a62 tempest-VolumesMetadataTest-1312697690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-28d75d41-7d61-4fa8-9612-3fa98f54ea5a" returned: 0 in 0.431s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:55 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f57febc-e1f3-496d-98ab-9ce77af2bb76]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:25:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-676be82d-815d-4851-b477-d94b813804ef tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e23b6198-1d1a-4575-aec2-e930172d61df {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:55 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-80910094-eff8-49ff-b00d-d39e86903a62 tempest-VolumesMetadataTest-1312697690 None] Lock "cinder-quobyte-28d75d41-7d61-4fa8-9612-3fa98f54ea5a" released by "delete_volume" :: held 1.196s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:25:55 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-80910094-eff8-49ff-b00d-d39e86903a62 tempest-VolumesMetadataTest-1312697690 None] Created reservations ['6b0b12ee-e00d-4499-9e91-fa2d73cf225a', '2059b149-861e-42d4-aec1-c0bcb1ab18c7', 'dda017a6-7fad-4deb-8c31-6bf848f29376', 'f7984527-d4f8-4d57-9d0d-cc86309f5b19'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:25:55 devstack sudo[95526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e23b6198-1d1a-4575-aec2-e930172d61df Nov 01 12:25:55 devstack sudo[95526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-80910094-eff8-49ff-b00d-d39e86903a62 tempest-VolumesMetadataTest-1312697690 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:25:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-80910094-eff8-49ff-b00d-d39e86903a62 tempest-VolumesMetadataTest-1312697690 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:25:55 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-80910094-eff8-49ff-b00d-d39e86903a62 tempest-VolumesMetadataTest-1312697690 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:25:55 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-80910094-eff8-49ff-b00d-d39e86903a62 tempest-VolumesMetadataTest-1312697690 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:25:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-80910094-eff8-49ff-b00d-d39e86903a62 tempest-VolumesMetadataTest-1312697690 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:25:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-80910094-eff8-49ff-b00d-d39e86903a62 tempest-VolumesMetadataTest-1312697690 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:55 devstack sudo[95528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:25:55 devstack sudo[95528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:56 devstack sudo[95526]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-676be82d-815d-4851-b477-d94b813804ef tempest-GroupSnapshotsTest-1246896825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e23b6198-1d1a-4575-aec2-e930172d61df" returned: 0 in 0.539s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-676be82d-815d-4851-b477-d94b813804ef tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e23b6198-1d1a-4575-aec2-e930172d61df.d0c0ad63-5c1d-4926-bd02-f261779112a5 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:56 devstack sudo[95534]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e23b6198-1d1a-4575-aec2-e930172d61df.d0c0ad63-5c1d-4926-bd02-f261779112a5 Nov 01 12:25:56 devstack sudo[95534]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:56 devstack sudo[95528]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-80910094-eff8-49ff-b00d-d39e86903a62 tempest-VolumesMetadataTest-1312697690 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.439s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:56 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-80910094-eff8-49ff-b00d-d39e86903a62 tempest-VolumesMetadataTest-1312697690 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:25:56 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-80910094-eff8-49ff-b00d-d39e86903a62 tempest-VolumesMetadataTest-1312697690 None] Deleted volume successfully. Nov 01 12:25:56 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-80910094-eff8-49ff-b00d-d39e86903a62 tempest-VolumesMetadataTest-1312697690 None] Lock "cinder-28d75d41-7d61-4fa8-9612-3fa98f54ea5a-delete_volume" released by "delete_volume" :: held 2.024s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:25:56 devstack sudo[95534]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-676be82d-815d-4851-b477-d94b813804ef tempest-GroupSnapshotsTest-1246896825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e23b6198-1d1a-4575-aec2-e930172d61df.d0c0ad63-5c1d-4926-bd02-f261779112a5" returned: 0 in 0.662s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-676be82d-815d-4851-b477-d94b813804ef tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e23b6198-1d1a-4575-aec2-e930172d61df.d0c0ad63-5c1d-4926-bd02-f261779112a5 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:57 devstack sudo[95539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e23b6198-1d1a-4575-aec2-e930172d61df.d0c0ad63-5c1d-4926-bd02-f261779112a5 Nov 01 12:25:57 devstack sudo[95539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:25:57 devstack sudo[95539]: pam_unix(sudo:session): session closed for user root Nov 01 12:25:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-676be82d-815d-4851-b477-d94b813804ef tempest-GroupSnapshotsTest-1246896825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e23b6198-1d1a-4575-aec2-e930172d61df.d0c0ad63-5c1d-4926-bd02-f261779112a5" returned: 0 in 0.389s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:25:57 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-676be82d-815d-4851-b477-d94b813804ef tempest-GroupSnapshotsTest-1246896825 None] Lock "cinder-quobyte-d0c0ad63-5c1d-4926-bd02-f261779112a5" released by "_delete_snapshot" :: held 2.740s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:25:57 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-676be82d-815d-4851-b477-d94b813804ef tempest-GroupSnapshotsTest-1246896825 None] Lock "cinder-quobyte-e23b6198-1d1a-4575-aec2-e930172d61df" released by "delete_snapshot" :: held 2.799s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:25:57 devstack cinder-volume[86574]: WARNING cinder.quota [None req-676be82d-815d-4851-b477-d94b813804ef tempest-GroupSnapshotsTest-1246896825 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-117507148 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-117507148, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:25:57 devstack cinder-volume[86574]: WARNING cinder.quota [None req-676be82d-815d-4851-b477-d94b813804ef tempest-GroupSnapshotsTest-1246896825 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-117507148 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-117507148, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:25:57 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-676be82d-815d-4851-b477-d94b813804ef tempest-GroupSnapshotsTest-1246896825 None] Created reservations ['e2ad4cee-b10c-475c-afff-3db46e46474e', '07533f9a-1198-4f86-9011-ea2d72786e26', 'dc4eb58a-6601-4a21-8e87-a8c923bc4cd0', '6999d7f4-f9eb-4c30-829c-c6b2183c28b6'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:25:57 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-676be82d-815d-4851-b477-d94b813804ef tempest-GroupSnapshotsTest-1246896825 None] Created reservations ['9fe4d3a3-2498-4cce-bb80-abb09e796c51', 'af2008e9-2f90-4650-9299-5cf52b336ddf', '33d36478-b9cc-476a-9a7d-d800cd96e393', '8cf60899-7229-4931-8535-2ecce53d875b'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:25:58 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-676be82d-815d-4851-b477-d94b813804ef tempest-GroupSnapshotsTest-1246896825 None] group_snapshot 8a6779cf-11b0-4e48-978f-c459d9caa36d: deleted successfully Nov 01 12:25:59 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-37bb35fa-dd14-48d5-b670-248bf2d2a978 tempest-GroupSnapshotsTest-1246896825 None] Acquiring lock "cinder-quobyte-c605a287-4e9e-4b95-9907-37fc65f66ecf" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:25:59 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-37bb35fa-dd14-48d5-b670-248bf2d2a978 tempest-GroupSnapshotsTest-1246896825 None] Lock "cinder-quobyte-c605a287-4e9e-4b95-9907-37fc65f66ecf" acquired by "delete_volume" :: waited 0.025s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:25:59 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[f30d4033-cfe5-432d-ae00-75ff8813761a]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:25:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-37bb35fa-dd14-48d5-b670-248bf2d2a978 tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c605a287-4e9e-4b95-9907-37fc65f66ecf {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:25:59 devstack sudo[95580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c605a287-4e9e-4b95-9907-37fc65f66ecf Nov 01 12:25:59 devstack sudo[95580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:00 devstack sudo[95580]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-37bb35fa-dd14-48d5-b670-248bf2d2a978 tempest-GroupSnapshotsTest-1246896825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c605a287-4e9e-4b95-9907-37fc65f66ecf" returned: 0 in 0.606s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-37bb35fa-dd14-48d5-b670-248bf2d2a978 tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c605a287-4e9e-4b95-9907-37fc65f66ecf {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:00 devstack sudo[95585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c605a287-4e9e-4b95-9907-37fc65f66ecf Nov 01 12:26:00 devstack sudo[95585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:00 devstack sudo[95585]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-37bb35fa-dd14-48d5-b670-248bf2d2a978 tempest-GroupSnapshotsTest-1246896825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c605a287-4e9e-4b95-9907-37fc65f66ecf" returned: 0 in 0.411s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:00 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-37bb35fa-dd14-48d5-b670-248bf2d2a978 tempest-GroupSnapshotsTest-1246896825 None] Lock "cinder-quobyte-c605a287-4e9e-4b95-9907-37fc65f66ecf" released by "delete_volume" :: held 1.151s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:00 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-37bb35fa-dd14-48d5-b670-248bf2d2a978 tempest-GroupSnapshotsTest-1246896825 None] Acquiring lock "cinder-quobyte-e23b6198-1d1a-4575-aec2-e930172d61df" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:00 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-37bb35fa-dd14-48d5-b670-248bf2d2a978 tempest-GroupSnapshotsTest-1246896825 None] Lock "cinder-quobyte-e23b6198-1d1a-4575-aec2-e930172d61df" acquired by "delete_volume" :: waited 0.034s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:00 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd539e50-9277-466f-8dd3-bf7166408164]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-37bb35fa-dd14-48d5-b670-248bf2d2a978 tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e23b6198-1d1a-4575-aec2-e930172d61df {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:01 devstack sudo[95588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e23b6198-1d1a-4575-aec2-e930172d61df Nov 01 12:26:01 devstack sudo[95588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:01 devstack sudo[95588]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-37bb35fa-dd14-48d5-b670-248bf2d2a978 tempest-GroupSnapshotsTest-1246896825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e23b6198-1d1a-4575-aec2-e930172d61df" returned: 0 in 0.726s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-37bb35fa-dd14-48d5-b670-248bf2d2a978 tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e23b6198-1d1a-4575-aec2-e930172d61df {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:01 devstack sudo[95594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e23b6198-1d1a-4575-aec2-e930172d61df Nov 01 12:26:01 devstack sudo[95594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:01 devstack sudo[95594]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-37bb35fa-dd14-48d5-b670-248bf2d2a978 tempest-GroupSnapshotsTest-1246896825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e23b6198-1d1a-4575-aec2-e930172d61df" returned: 0 in 0.426s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:02 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-37bb35fa-dd14-48d5-b670-248bf2d2a978 tempest-GroupSnapshotsTest-1246896825 None] Lock "cinder-quobyte-e23b6198-1d1a-4575-aec2-e930172d61df" released by "delete_volume" :: held 1.255s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:02 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-37bb35fa-dd14-48d5-b670-248bf2d2a978 tempest-GroupSnapshotsTest-1246896825 None] Created reservations ['646773d8-109a-410a-94ab-34eee00989a1'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:26:02 devstack cinder-volume[86574]: WARNING cinder.quota [None req-37bb35fa-dd14-48d5-b670-248bf2d2a978 tempest-GroupSnapshotsTest-1246896825 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-117507148 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-117507148, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:26:02 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-37bb35fa-dd14-48d5-b670-248bf2d2a978 tempest-GroupSnapshotsTest-1246896825 None] Created reservations ['81380d1d-20b4-4a50-a460-6bc21fb215e4', '2e7b55f2-a555-4f78-b238-b8191be641e8', '400ff90c-81b2-4422-ba87-88f7ca1570fb', 'e44c752e-b0a9-4735-8590-cfa49a5a7a19'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:26:02 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-37bb35fa-dd14-48d5-b670-248bf2d2a978 tempest-GroupSnapshotsTest-1246896825 None] Created reservations ['e617fdef-66e0-4851-9d90-f6f4d57a0c22', '64924066-1345-4db2-a6d9-83c1193d8a3d', '37d47ba4-d7d0-4d49-a5fa-74ccbf70b470', '3a44c0dd-08d0-408e-81ea-1c40c5ee5629'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:26:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-37bb35fa-dd14-48d5-b670-248bf2d2a978 tempest-GroupSnapshotsTest-1246896825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-37bb35fa-dd14-48d5-b670-248bf2d2a978 tempest-GroupSnapshotsTest-1246896825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:02 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-37bb35fa-dd14-48d5-b670-248bf2d2a978 tempest-GroupSnapshotsTest-1246896825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:02 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-37bb35fa-dd14-48d5-b670-248bf2d2a978 tempest-GroupSnapshotsTest-1246896825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-37bb35fa-dd14-48d5-b670-248bf2d2a978 tempest-GroupSnapshotsTest-1246896825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-37bb35fa-dd14-48d5-b670-248bf2d2a978 tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:02 devstack sudo[95597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:26:02 devstack sudo[95597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:02 devstack sudo[95597]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-37bb35fa-dd14-48d5-b670-248bf2d2a978 tempest-GroupSnapshotsTest-1246896825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.288s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:02 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-37bb35fa-dd14-48d5-b670-248bf2d2a978 tempest-GroupSnapshotsTest-1246896825 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:26:02 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-37bb35fa-dd14-48d5-b670-248bf2d2a978 tempest-GroupSnapshotsTest-1246896825 None] Delete group completed successfully. Nov 01 12:26:03 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-32fadd99-c950-4214-a268-d91eb8b94650 tempest-VolumesCloneTest-1907935347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:26:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32fadd99-c950-4214-a268-d91eb8b94650 tempest-VolumesCloneTest-1907935347 None] Flow 'volume_create_manager' (af658b3c-7795-41e9-bd62-20cfb0e7c7cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32fadd99-c950-4214-a268-d91eb8b94650 tempest-VolumesCloneTest-1907935347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (034a7277-b3d1-4d95-b367-b1da3d5a105c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32fadd99-c950-4214-a268-d91eb8b94650 tempest-VolumesCloneTest-1907935347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (034a7277-b3d1-4d95-b367-b1da3d5a105c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1772531407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f035f5de-c659-41c7-bd2b-f17e6ee99e92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b6cdd6f6dc14b7486a2c0b658ca37bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:04Z,use_quota=True,user_id='72c1d58871d3462880532965da13709e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32fadd99-c950-4214-a268-d91eb8b94650 tempest-VolumesCloneTest-1907935347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07f0943d-a92a-4edf-b898-e3c302896194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32fadd99-c950-4214-a268-d91eb8b94650 tempest-VolumesCloneTest-1907935347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (07f0943d-a92a-4edf-b898-e3c302896194) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32fadd99-c950-4214-a268-d91eb8b94650 tempest-VolumesCloneTest-1907935347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f29a074-7539-4dfe-96e1-87a257ec6f3d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32fadd99-c950-4214-a268-d91eb8b94650 tempest-VolumesCloneTest-1907935347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f29a074-7539-4dfe-96e1-87a257ec6f3d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f035f5de-c659-41c7-bd2b-f17e6ee99e92', 'volume_name': 'volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32fadd99-c950-4214-a268-d91eb8b94650 tempest-VolumesCloneTest-1907935347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31780b31-192f-4731-986b-221a269d8393) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32fadd99-c950-4214-a268-d91eb8b94650 tempest-VolumesCloneTest-1907935347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (31780b31-192f-4731-986b-221a269d8393) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32fadd99-c950-4214-a268-d91eb8b94650 tempest-VolumesCloneTest-1907935347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1a1ac05-9f12-41ff-a668-8c2a9b731d60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:03 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-32fadd99-c950-4214-a268-d91eb8b94650 tempest-VolumesCloneTest-1907935347 None] Volume f035f5de-c659-41c7-bd2b-f17e6ee99e92: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92', 'volume_size': 1} Nov 01 12:26:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-32fadd99-c950-4214-a268-d91eb8b94650 tempest-VolumesCloneTest-1907935347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-32fadd99-c950-4214-a268-d91eb8b94650 tempest-VolumesCloneTest-1907935347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-32fadd99-c950-4214-a268-d91eb8b94650 tempest-VolumesCloneTest-1907935347 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1772531407',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f035f5de-c659-41c7-bd2b-f17e6ee99e92,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b6cdd6f6dc14b7486a2c0b658ca37bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:04Z,use_quota=True,user_id='72c1d58871d3462880532965da13709e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:26:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-32fadd99-c950-4214-a268-d91eb8b94650 tempest-VolumesCloneTest-1907935347 None] Creating volume f035f5de-c659-41c7-bd2b-f17e6ee99e92 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:26:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-32fadd99-c950-4214-a268-d91eb8b94650 tempest-VolumesCloneTest-1907935347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-32fadd99-c950-4214-a268-d91eb8b94650 tempest-VolumesCloneTest-1907935347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-32fadd99-c950-4214-a268-d91eb8b94650 tempest-VolumesCloneTest-1907935347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-32fadd99-c950-4214-a268-d91eb8b94650 tempest-VolumesCloneTest-1907935347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-32fadd99-c950-4214-a268-d91eb8b94650 tempest-VolumesCloneTest-1907935347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-32fadd99-c950-4214-a268-d91eb8b94650 tempest-VolumesCloneTest-1907935347 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:26:03 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-32fadd99-c950-4214-a268-d91eb8b94650 tempest-VolumesCloneTest-1907935347 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:26:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-32fadd99-c950-4214-a268-d91eb8b94650 tempest-VolumesCloneTest-1907935347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:03 devstack sudo[95603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92 1073741824 Nov 01 12:26:03 devstack sudo[95603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:04 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-43fb56fe-785a-444c-9914-a1770ac030d9 tempest-GroupSnapshotsTest-1246896825 None] Group tempest-GroupSnapshotsTest-Group-925704998: creating Nov 01 12:26:04 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-43fb56fe-785a-444c-9914-a1770ac030d9 tempest-GroupSnapshotsTest-1246896825 None] Group tempest-GroupSnapshotsTest-Group-925704998: created successfully Nov 01 12:26:04 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-43fb56fe-785a-444c-9914-a1770ac030d9 tempest-GroupSnapshotsTest-1246896825 None] Create group completed successfully. Nov 01 12:26:04 devstack sudo[95603]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-32fadd99-c950-4214-a268-d91eb8b94650 tempest-VolumesCloneTest-1907935347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92 1073741824" returned: 0 in 0.697s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-32fadd99-c950-4214-a268-d91eb8b94650 tempest-VolumesCloneTest-1907935347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:04 devstack sudo[95609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92 Nov 01 12:26:04 devstack sudo[95609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:05 devstack sudo[95609]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-32fadd99-c950-4214-a268-d91eb8b94650 tempest-VolumesCloneTest-1907935347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92" returned: 0 in 0.327s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:05 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-32fadd99-c950-4214-a268-d91eb8b94650 tempest-VolumesCloneTest-1907935347 None] <== create_volume: return (1078ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:26:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-32fadd99-c950-4214-a268-d91eb8b94650 tempest-VolumesCloneTest-1907935347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.081s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:05 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32fadd99-c950-4214-a268-d91eb8b94650 tempest-VolumesCloneTest-1907935347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b1a1ac05-9f12-41ff-a668-8c2a9b731d60) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:05 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32fadd99-c950-4214-a268-d91eb8b94650 tempest-VolumesCloneTest-1907935347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fa22c1e-e0d5-4b0d-9a8b-ac1c33437f70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:05 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-32fadd99-c950-4214-a268-d91eb8b94650 tempest-VolumesCloneTest-1907935347 None] Volume volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92 (f035f5de-c659-41c7-bd2b-f17e6ee99e92): created successfully Nov 01 12:26:05 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32fadd99-c950-4214-a268-d91eb8b94650 tempest-VolumesCloneTest-1907935347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8fa22c1e-e0d5-4b0d-9a8b-ac1c33437f70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:05 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32fadd99-c950-4214-a268-d91eb8b94650 tempest-VolumesCloneTest-1907935347 None] Flow 'volume_create_manager' (af658b3c-7795-41e9-bd62-20cfb0e7c7cf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:05 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-32fadd99-c950-4214-a268-d91eb8b94650 tempest-VolumesCloneTest-1907935347 None] Created volume successfully. Nov 01 12:26:07 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-b5b0691b-ff3a-42af-a0a0-003c4ab869fe tempest-GroupSnapshotsTest-1246896825 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:26:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b5b0691b-ff3a-42af-a0a0-003c4ab869fe tempest-GroupSnapshotsTest-1246896825 None] Flow 'volume_create_manager' (9089ae49-6c50-4730-901f-9628a6235b46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b5b0691b-ff3a-42af-a0a0-003c4ab869fe tempest-GroupSnapshotsTest-1246896825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c71603f-8f23-4385-bd79-003b5627845b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b5b0691b-ff3a-42af-a0a0-003c4ab869fe tempest-GroupSnapshotsTest-1246896825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c71603f-8f23-4385-bd79-003b5627845b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-959654988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aa35bca7-ae24-46aa-b83e-24b890b25118,host='devstack@QuobyteHD#QuobyteHD',id=af582029-af89-40b5-adc1-9fb5d47efe8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4fc678ab60641eca0ae492c65b6be49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:07Z,use_quota=True,user_id='b04fe47e77f14940b3f73a971b0e2339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b87e186-0583-4c8f-84e7-35d7b1c096c1),volume_type_id=7b87e186-0583-4c8f-84e7-35d7b1c096c1)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b5b0691b-ff3a-42af-a0a0-003c4ab869fe tempest-GroupSnapshotsTest-1246896825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a354f45-de7a-46a9-ae51-0f94e1fafc97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b5b0691b-ff3a-42af-a0a0-003c4ab869fe tempest-GroupSnapshotsTest-1246896825 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8a354f45-de7a-46a9-ae51-0f94e1fafc97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b5b0691b-ff3a-42af-a0a0-003c4ab869fe tempest-GroupSnapshotsTest-1246896825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (879913ef-c6da-451f-80f6-10bcd80b55e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b5b0691b-ff3a-42af-a0a0-003c4ab869fe tempest-GroupSnapshotsTest-1246896825 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (879913ef-c6da-451f-80f6-10bcd80b55e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af582029-af89-40b5-adc1-9fb5d47efe8b', 'volume_name': 'volume-af582029-af89-40b5-adc1-9fb5d47efe8b', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b5b0691b-ff3a-42af-a0a0-003c4ab869fe tempest-GroupSnapshotsTest-1246896825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b950a58a-e6f7-4476-b8a6-e0c1071a063c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b5b0691b-ff3a-42af-a0a0-003c4ab869fe tempest-GroupSnapshotsTest-1246896825 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b950a58a-e6f7-4476-b8a6-e0c1071a063c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b5b0691b-ff3a-42af-a0a0-003c4ab869fe tempest-GroupSnapshotsTest-1246896825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e042fa9-01f4-4643-86d8-55cbf4a5fd32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:07 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-b5b0691b-ff3a-42af-a0a0-003c4ab869fe tempest-GroupSnapshotsTest-1246896825 None] Volume af582029-af89-40b5-adc1-9fb5d47efe8b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af582029-af89-40b5-adc1-9fb5d47efe8b', 'volume_size': 1} Nov 01 12:26:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b5b0691b-ff3a-42af-a0a0-003c4ab869fe tempest-GroupSnapshotsTest-1246896825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b5b0691b-ff3a-42af-a0a0-003c4ab869fe tempest-GroupSnapshotsTest-1246896825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:07 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-b5b0691b-ff3a-42af-a0a0-003c4ab869fe tempest-GroupSnapshotsTest-1246896825 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=aa35bca7-ae24-46aa-b83e-24b890b25118,created_at=2026-11-01T11:26:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-959654988',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=aa35bca7-ae24-46aa-b83e-24b890b25118,host='devstack@QuobyteHD#QuobyteHD',id=af582029-af89-40b5-adc1-9fb5d47efe8b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a4fc678ab60641eca0ae492c65b6be49',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:07Z,use_quota=True,user_id='b04fe47e77f14940b3f73a971b0e2339',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7b87e186-0583-4c8f-84e7-35d7b1c096c1),volume_type_id=7b87e186-0583-4c8f-84e7-35d7b1c096c1)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:26:07 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-b5b0691b-ff3a-42af-a0a0-003c4ab869fe tempest-GroupSnapshotsTest-1246896825 None] Creating volume af582029-af89-40b5-adc1-9fb5d47efe8b {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:26:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b5b0691b-ff3a-42af-a0a0-003c4ab869fe tempest-GroupSnapshotsTest-1246896825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b5b0691b-ff3a-42af-a0a0-003c4ab869fe tempest-GroupSnapshotsTest-1246896825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:07 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-b5b0691b-ff3a-42af-a0a0-003c4ab869fe tempest-GroupSnapshotsTest-1246896825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:07 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-b5b0691b-ff3a-42af-a0a0-003c4ab869fe tempest-GroupSnapshotsTest-1246896825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b5b0691b-ff3a-42af-a0a0-003c4ab869fe tempest-GroupSnapshotsTest-1246896825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:07 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-b5b0691b-ff3a-42af-a0a0-003c4ab869fe tempest-GroupSnapshotsTest-1246896825 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:26:07 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-b5b0691b-ff3a-42af-a0a0-003c4ab869fe tempest-GroupSnapshotsTest-1246896825 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:26:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b5b0691b-ff3a-42af-a0a0-003c4ab869fe tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af582029-af89-40b5-adc1-9fb5d47efe8b 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:07 devstack sudo[95633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af582029-af89-40b5-adc1-9fb5d47efe8b 1073741824 Nov 01 12:26:07 devstack sudo[95633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:07 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:26:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Flow 'volume_create_manager' (7ea29de4-069d-4689-996e-2b45d223d547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98dc57fb-d6d8-43d4-9880-c8e3e02a564e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98dc57fb-d6d8-43d4-9880-c8e3e02a564e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneTest-Volume-1514782514',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d37d30c-6f17-48a8-8e33-71a2ad7af689,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2b6cdd6f6dc14b7486a2c0b658ca37bb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:07Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=f035f5de-c659-41c7-bd2b-f17e6ee99e92,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:07Z,use_quota=True,user_id='72c1d58871d3462880532965da13709e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df2fa539-561d-41db-8667-c6915dc24b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df2fa539-561d-41db-8667-c6915dc24b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c954a20-6a4e-4e36-a927-4cff68a0afaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8c954a20-6a4e-4e36-a927-4cff68a0afaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': '9d37d30c-6f17-48a8-8e33-71a2ad7af689', 'volume_name': 'volume-9d37d30c-6f17-48a8-8e33-71a2ad7af689', 'volume_size': 2, 'source_volid': 'f035f5de-c659-41c7-bd2b-f17e6ee99e92', 'source_volstatus': 'available'}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21061a8d-c832-4960-8b25-2ab5aaacb703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (21061a8d-c832-4960-8b25-2ab5aaacb703) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (688ec7dd-281a-41bd-9221-323cb69893a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:07 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Volume 9d37d30c-6f17-48a8-8e33-71a2ad7af689: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-9d37d30c-6f17-48a8-8e33-71a2ad7af689', 'volume_size': 2, 'source_volid': 'f035f5de-c659-41c7-bd2b-f17e6ee99e92', 'source_volstatus': 'available'} Nov 01 12:26:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:08 devstack sudo[95633]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b5b0691b-ff3a-42af-a0a0-003c4ab869fe tempest-GroupSnapshotsTest-1246896825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af582029-af89-40b5-adc1-9fb5d47efe8b 1073741824" returned: 0 in 0.908s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b5b0691b-ff3a-42af-a0a0-003c4ab869fe tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af582029-af89-40b5-adc1-9fb5d47efe8b {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:08 devstack sudo[95686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af582029-af89-40b5-adc1-9fb5d47efe8b Nov 01 12:26:08 devstack sudo[95686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:08 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-9abbe0b6-7c9a-4663-a5db-4f5b28df69ed req-bf7a45c0-b3c3-4462-a479-f498a5d896b6 tempest-ServerActionsTestOtherA-2064758512 None] Terminate volume connection completed successfully. Nov 01 12:26:08 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-9abbe0b6-7c9a-4663-a5db-4f5b28df69ed req-bf7a45c0-b3c3-4462-a479-f498a5d896b6 tempest-ServerActionsTestOtherA-2064758512 None] Deleting attachment 599e656a-0a2c-430a-b640-9e6d13475d12. {{(pid=86574) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 12:26:08 devstack sudo[95686]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b5b0691b-ff3a-42af-a0a0-003c4ab869fe tempest-GroupSnapshotsTest-1246896825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af582029-af89-40b5-adc1-9fb5d47efe8b" returned: 0 in 0.305s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:08 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-b5b0691b-ff3a-42af-a0a0-003c4ab869fe tempest-GroupSnapshotsTest-1246896825 None] <== create_volume: return (1306ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:26:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b5b0691b-ff3a-42af-a0a0-003c4ab869fe tempest-GroupSnapshotsTest-1246896825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.309s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 1.018s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:08 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Cloning volume f035f5de-c659-41c7-bd2b-f17e6ee99e92 to volume 9d37d30c-6f17-48a8-8e33-71a2ad7af689 Nov 01 12:26:08 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b5b0691b-ff3a-42af-a0a0-003c4ab869fe tempest-GroupSnapshotsTest-1246896825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e042fa9-01f4-4643-86d8-55cbf4a5fd32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af582029-af89-40b5-adc1-9fb5d47efe8b', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:08 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b5b0691b-ff3a-42af-a0a0-003c4ab869fe tempest-GroupSnapshotsTest-1246896825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4d8def8-1baa-41aa-94fb-d8a897e17143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:08 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-b5b0691b-ff3a-42af-a0a0-003c4ab869fe tempest-GroupSnapshotsTest-1246896825 None] Volume volume-af582029-af89-40b5-adc1-9fb5d47efe8b (af582029-af89-40b5-adc1-9fb5d47efe8b): created successfully Nov 01 12:26:08 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b5b0691b-ff3a-42af-a0a0-003c4ab869fe tempest-GroupSnapshotsTest-1246896825 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c4d8def8-1baa-41aa-94fb-d8a897e17143) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:08 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b5b0691b-ff3a-42af-a0a0-003c4ab869fe tempest-GroupSnapshotsTest-1246896825 None] Flow 'volume_create_manager' (9089ae49-6c50-4730-901f-9628a6235b46) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:08 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Creating offline snapshot f87d09de-8763-4f85-aacc-59571977892a of volume f035f5de-c659-41c7-bd2b-f17e6ee99e92 {{(pid=86574) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:26:08 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-b5b0691b-ff3a-42af-a0a0-003c4ab869fe tempest-GroupSnapshotsTest-1246896825 None] Created volume successfully. Nov 01 12:26:08 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5824ad0-c880-43af-b985-749aabfbd8bc]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:08 devstack sudo[95690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92 Nov 01 12:26:08 devstack sudo[95690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:09 devstack sudo[95690]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92" returned: 0 in 0.383s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92.f87d09de-8763-4f85-aacc-59571977892a 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:09 devstack sudo[95696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92.f87d09de-8763-4f85-aacc-59571977892a 1G Nov 01 12:26:09 devstack sudo[95696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:09 devstack sudo[95696]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92.f87d09de-8763-4f85-aacc-59571977892a 1G" returned: 0 in 0.478s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92.f87d09de-8763-4f85-aacc-59571977892a {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:09 devstack sudo[95701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92.f87d09de-8763-4f85-aacc-59571977892a Nov 01 12:26:09 devstack sudo[95701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:09 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-d11a34bf-d02c-4264-83f8-8dd27e413d8b tempest-GroupSnapshotsTest-1246896825 None] GroupSnapshot 3ce9a1f0-ebee-48ba-80d6-08d6c4c3daf7: creating. Nov 01 12:26:09 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d11a34bf-d02c-4264-83f8-8dd27e413d8b tempest-GroupSnapshotsTest-1246896825 None] Group snapshot 3ce9a1f0-ebee-48ba-80d6-08d6c4c3daf7: creating. {{(pid=86574) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 01 12:26:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d11a34bf-d02c-4264-83f8-8dd27e413d8b tempest-GroupSnapshotsTest-1246896825 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-9abbe0b6-7c9a-4663-a5db-4f5b28df69ed req-b556b5b8-3acf-4517-b7b7-2b900db32419 tempest-ServerActionsTestOtherA-2064758512 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:09 devstack sudo[95701]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92.f87d09de-8763-4f85-aacc-59571977892a" returned: 0 in 0.340s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:09 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92.f87d09de-8763-4f85-aacc-59571977892a is being set with open permissions: ugo+rw Nov 01 12:26:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92.f87d09de-8763-4f85-aacc-59571977892a {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:09 devstack sudo[95714]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92.f87d09de-8763-4f85-aacc-59571977892a Nov 01 12:26:09 devstack sudo[95714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:10 devstack sudo[95714]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92.f87d09de-8763-4f85-aacc-59571977892a" returned: 0 in 0.253s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:10 devstack sudo[95719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92.info Nov 01 12:26:10 devstack sudo[95719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:10 devstack sudo[95719]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92.info" returned: 0 in 0.274s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:10 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92.info is being set with open permissions: ugo+rw Nov 01 12:26:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:10 devstack sudo[95722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92.info Nov 01 12:26:10 devstack sudo[95722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:10 devstack sudo[95722]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92.info" returned: 0 in 0.259s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:10 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Acquiring lock "cinder-quobyte-9d37d30c-6f17-48a8-8e33-71a2ad7af689" by "_copy_volume_from_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:10 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Lock "cinder-quobyte-9d37d30c-6f17-48a8-8e33-71a2ad7af689" acquired by "_copy_volume_from_snapshot" :: waited 0.018s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:10 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] snapshot: f87d09de-8763-4f85-aacc-59571977892a, volume: 9d37d30c-6f17-48a8-8e33-71a2ad7af689, {{(pid=86574) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 01 12:26:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:10 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:10 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:10 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a827c55-41fe-4cef-a921-7c0f1358faa1]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92.f87d09de-8763-4f85-aacc-59571977892a {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:10 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-cafe14dd-1042-4b78-9646-3cd257314fdc tempest-AttachVolumeNegativeTest-245012374 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:26:10 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-cafe14dd-1042-4b78-9646-3cd257314fdc tempest-AttachVolumeNegativeTest-245012374 None] Flow 'volume_create_manager' (d41f15fe-1afb-4f15-85ae-d7393bf64b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:10 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-cafe14dd-1042-4b78-9646-3cd257314fdc tempest-AttachVolumeNegativeTest-245012374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0b23e8a-e3de-4009-9e3f-f63bf9f776b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:10 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-cafe14dd-1042-4b78-9646-3cd257314fdc tempest-AttachVolumeNegativeTest-245012374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0b23e8a-e3de-4009-9e3f-f63bf9f776b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1550614436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4157e8fb-3bd3-4d51-99ad-e24b520b6589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33bece50a475457daaa280199a8d84b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:11Z,use_quota=True,user_id='5e41c2cf7aa144d488e34538a0804726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:10 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-cafe14dd-1042-4b78-9646-3cd257314fdc tempest-AttachVolumeNegativeTest-245012374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afa5046c-6849-4a2a-a411-c5fb9c510ac6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:10 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-cafe14dd-1042-4b78-9646-3cd257314fdc tempest-AttachVolumeNegativeTest-245012374 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (afa5046c-6849-4a2a-a411-c5fb9c510ac6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:10 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-cafe14dd-1042-4b78-9646-3cd257314fdc tempest-AttachVolumeNegativeTest-245012374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4463b29-900a-433d-b093-0ffa3f3df644) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:10 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-cafe14dd-1042-4b78-9646-3cd257314fdc tempest-AttachVolumeNegativeTest-245012374 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b4463b29-900a-433d-b093-0ffa3f3df644) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4157e8fb-3bd3-4d51-99ad-e24b520b6589', 'volume_name': 'volume-4157e8fb-3bd3-4d51-99ad-e24b520b6589', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:10 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-cafe14dd-1042-4b78-9646-3cd257314fdc tempest-AttachVolumeNegativeTest-245012374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f6c3cab-66ac-4d5d-b1a5-51ecdf956f24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:10 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-cafe14dd-1042-4b78-9646-3cd257314fdc tempest-AttachVolumeNegativeTest-245012374 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1f6c3cab-66ac-4d5d-b1a5-51ecdf956f24) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:10 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-cafe14dd-1042-4b78-9646-3cd257314fdc tempest-AttachVolumeNegativeTest-245012374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (479c242b-6651-4ab7-99a2-df1902035129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:10 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-cafe14dd-1042-4b78-9646-3cd257314fdc tempest-AttachVolumeNegativeTest-245012374 None] Volume 4157e8fb-3bd3-4d51-99ad-e24b520b6589: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4157e8fb-3bd3-4d51-99ad-e24b520b6589', 'volume_size': 1} Nov 01 12:26:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-cafe14dd-1042-4b78-9646-3cd257314fdc tempest-AttachVolumeNegativeTest-245012374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:10 devstack sudo[95725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92.f87d09de-8763-4f85-aacc-59571977892a Nov 01 12:26:10 devstack sudo[95725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:11 devstack sudo[95725]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92.f87d09de-8763-4f85-aacc-59571977892a" returned: 0 in 0.352s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:11 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:26:11 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[dabcfa20-0f9e-4e80-9faa-084f239e6583]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:11 devstack sudo[95730]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92 Nov 01 12:26:11 devstack sudo[95730]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:11 devstack sudo[95730]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92" returned: 0 in 0.359s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:11 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92 {{(pid=86574) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 01 12:26:11 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Creating direct copy from snapshot {{(pid=86574) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 01 12:26:11 devstack cinder-volume[86574]: DEBUG cinder.utils [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Path /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9d37d30c-6f17-48a8-8e33-71a2ad7af689 not found in is_blk_device check {{(pid=86574) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 01 12:26:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9d37d30c-6f17-48a8-8e33-71a2ad7af689 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:11 devstack sudo[95735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9d37d30c-6f17-48a8-8e33-71a2ad7af689 Nov 01 12:26:11 devstack sudo[95735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:17 devstack sudo[95735]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:17 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9d37d30c-6f17-48a8-8e33-71a2ad7af689" returned: 0 in 6.101s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:17 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Image conversion details: src /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92, size 1024.00 MB, duration 6.10 sec, destination /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9d37d30c-6f17-48a8-8e33-71a2ad7af689 {{(pid=86574) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 12:26:17 devstack cinder-volume[86574]: INFO cinder.image.image_utils [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Converted 1024.00 MB image at 167.80 MB/s Nov 01 12:26:17 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9d37d30c-6f17-48a8-8e33-71a2ad7af689 is being set with open permissions: ugo+rw Nov 01 12:26:17 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9d37d30c-6f17-48a8-8e33-71a2ad7af689 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:17 devstack sudo[95748]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9d37d30c-6f17-48a8-8e33-71a2ad7af689 Nov 01 12:26:17 devstack sudo[95748]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:17 devstack sudo[95748]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:17 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9d37d30c-6f17-48a8-8e33-71a2ad7af689" returned: 0 in 0.249s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:17 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Lock "cinder-quobyte-9d37d30c-6f17-48a8-8e33-71a2ad7af689" released by "_copy_volume_from_snapshot" :: held 7.136s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:17 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Acquiring lock "cinder-quobyte-f87d09de-8763-4f85-aacc-59571977892a" by "_delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:17 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Lock "cinder-quobyte-f87d09de-8763-4f85-aacc-59571977892a" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:17 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Deleting offline snapshot f87d09de-8763-4f85-aacc-59571977892a of volume f035f5de-c659-41c7-bd2b-f17e6ee99e92 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:26:17 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] snapshot_file for this snap is: volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92.f87d09de-8763-4f85-aacc-59571977892a {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:26:17 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[d621c2b4-0604-4eb8-87d0-343a3c1b68bc]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:17 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92.f87d09de-8763-4f85-aacc-59571977892a {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:18 devstack sudo[95752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92.f87d09de-8763-4f85-aacc-59571977892a Nov 01 12:26:18 devstack sudo[95752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:18 devstack sudo[95752]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:18 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92.f87d09de-8763-4f85-aacc-59571977892a" returned: 0 in 0.360s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:18 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:26:18 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[54a2c85e-66d1-45cf-a6b4-6b85a94276d8]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:18 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:18 devstack sudo[95757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92 Nov 01 12:26:18 devstack sudo[95757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:18 devstack sudo[95757]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:18 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92" returned: 0 in 0.503s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:18 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92.f87d09de-8763-4f85-aacc-59571977892a {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:18 devstack sudo[95762]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92.f87d09de-8763-4f85-aacc-59571977892a Nov 01 12:26:18 devstack sudo[95762]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:19 devstack sudo[95762]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:19 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92.f87d09de-8763-4f85-aacc-59571977892a" returned: 0 in 0.327s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:19 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92.f87d09de-8763-4f85-aacc-59571977892a {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:19 devstack sudo[95768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92.f87d09de-8763-4f85-aacc-59571977892a Nov 01 12:26:19 devstack sudo[95768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:19 devstack sudo[95768]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:19 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92.f87d09de-8763-4f85-aacc-59571977892a" returned: 0 in 0.248s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:19 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Lock "cinder-quobyte-f87d09de-8763-4f85-aacc-59571977892a" released by "_delete_snapshot" :: held 1.535s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:19 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 10.948s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:19 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d11a34bf-d02c-4264-83f8-8dd27e413d8b tempest-GroupSnapshotsTest-1246896825 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 9.828s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:19 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (688ec7dd-281a-41bd-9221-323cb69893a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d37d30c-6f17-48a8-8e33-71a2ad7af689', 'volume_size': 2, 'source_volid': 'f035f5de-c659-41c7-bd2b-f17e6ee99e92', 'source_volstatus': 'available'}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:19 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (188470f7-06d3-4d30-8a05-01c45bb6d75a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:19 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-d11a34bf-d02c-4264-83f8-8dd27e413d8b tempest-GroupSnapshotsTest-1246896825 None] Creating offline snapshot 450365ac-ecf9-438a-8f6e-4a1946998741 of volume af582029-af89-40b5-adc1-9fb5d47efe8b {{(pid=86574) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:26:19 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Volume volume-9d37d30c-6f17-48a8-8e33-71a2ad7af689 (9d37d30c-6f17-48a8-8e33-71a2ad7af689): created successfully Nov 01 12:26:19 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (188470f7-06d3-4d30-8a05-01c45bb6d75a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:19 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Flow 'volume_create_manager' (7ea29de4-069d-4689-996e-2b45d223d547) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:19 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[7439a701-deb2-4e75-a108-c47619705f1b]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:19 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d11a34bf-d02c-4264-83f8-8dd27e413d8b tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af582029-af89-40b5-adc1-9fb5d47efe8b {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:19 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-19220042-0d85-4cfe-af56-15eea5cbceef tempest-VolumesCloneTest-1907935347 None] Created volume successfully. Nov 01 12:26:19 devstack sudo[95771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af582029-af89-40b5-adc1-9fb5d47efe8b Nov 01 12:26:19 devstack sudo[95771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:19 devstack sudo[95771]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:19 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d11a34bf-d02c-4264-83f8-8dd27e413d8b tempest-GroupSnapshotsTest-1246896825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af582029-af89-40b5-adc1-9fb5d47efe8b" returned: 0 in 0.348s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:19 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d11a34bf-d02c-4264-83f8-8dd27e413d8b tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af582029-af89-40b5-adc1-9fb5d47efe8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af582029-af89-40b5-adc1-9fb5d47efe8b.450365ac-ecf9-438a-8f6e-4a1946998741 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:19 devstack sudo[95776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af582029-af89-40b5-adc1-9fb5d47efe8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af582029-af89-40b5-adc1-9fb5d47efe8b.450365ac-ecf9-438a-8f6e-4a1946998741 1G Nov 01 12:26:19 devstack sudo[95776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:20 devstack sudo[95776]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d11a34bf-d02c-4264-83f8-8dd27e413d8b tempest-GroupSnapshotsTest-1246896825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af582029-af89-40b5-adc1-9fb5d47efe8b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af582029-af89-40b5-adc1-9fb5d47efe8b.450365ac-ecf9-438a-8f6e-4a1946998741 1G" returned: 0 in 0.391s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d11a34bf-d02c-4264-83f8-8dd27e413d8b tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af582029-af89-40b5-adc1-9fb5d47efe8b -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af582029-af89-40b5-adc1-9fb5d47efe8b.450365ac-ecf9-438a-8f6e-4a1946998741 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:20 devstack sudo[95781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af582029-af89-40b5-adc1-9fb5d47efe8b -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af582029-af89-40b5-adc1-9fb5d47efe8b.450365ac-ecf9-438a-8f6e-4a1946998741 Nov 01 12:26:20 devstack sudo[95781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:20 devstack sudo[95781]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d11a34bf-d02c-4264-83f8-8dd27e413d8b tempest-GroupSnapshotsTest-1246896825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-af582029-af89-40b5-adc1-9fb5d47efe8b -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af582029-af89-40b5-adc1-9fb5d47efe8b.450365ac-ecf9-438a-8f6e-4a1946998741" returned: 0 in 0.308s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:20 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-d11a34bf-d02c-4264-83f8-8dd27e413d8b tempest-GroupSnapshotsTest-1246896825 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af582029-af89-40b5-adc1-9fb5d47efe8b.450365ac-ecf9-438a-8f6e-4a1946998741 is being set with open permissions: ugo+rw: NotImplementedError Nov 01 12:26:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d11a34bf-d02c-4264-83f8-8dd27e413d8b tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af582029-af89-40b5-adc1-9fb5d47efe8b.450365ac-ecf9-438a-8f6e-4a1946998741 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:20 devstack sudo[95786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af582029-af89-40b5-adc1-9fb5d47efe8b.450365ac-ecf9-438a-8f6e-4a1946998741 Nov 01 12:26:20 devstack sudo[95786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:20 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-94a440a2-492d-461e-9777-ab590642281b tempest-VolumesCloneTest-1907935347 None] Acquiring lock "cinder-9d37d30c-6f17-48a8-8e33-71a2ad7af689-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:20 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-94a440a2-492d-461e-9777-ab590642281b tempest-VolumesCloneTest-1907935347 None] Lock "cinder-9d37d30c-6f17-48a8-8e33-71a2ad7af689-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:20 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:SELECT=141,cinder:INSERT=37,cinder:UPDATE=131,cinder:DELETE=4 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:26:20 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:UPDATE=122,cinder:SELECT=135,cinder:INSERT=34,cinder:DELETE=8 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:26:20 devstack sudo[95786]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d11a34bf-d02c-4264-83f8-8dd27e413d8b tempest-GroupSnapshotsTest-1246896825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af582029-af89-40b5-adc1-9fb5d47efe8b.450365ac-ecf9-438a-8f6e-4a1946998741" returned: 0 in 0.279s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:20 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-94a440a2-492d-461e-9777-ab590642281b tempest-VolumesCloneTest-1907935347 None] Acquiring lock "cinder-quobyte-9d37d30c-6f17-48a8-8e33-71a2ad7af689" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:20 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-94a440a2-492d-461e-9777-ab590642281b tempest-VolumesCloneTest-1907935347 None] Lock "cinder-quobyte-9d37d30c-6f17-48a8-8e33-71a2ad7af689" acquired by "delete_volume" :: waited 0.022s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d11a34bf-d02c-4264-83f8-8dd27e413d8b tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af582029-af89-40b5-adc1-9fb5d47efe8b.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:20 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[6676b7ca-8caa-49bb-894c-600ac1735c3b]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-94a440a2-492d-461e-9777-ab590642281b tempest-VolumesCloneTest-1907935347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9d37d30c-6f17-48a8-8e33-71a2ad7af689 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:20 devstack sudo[95789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af582029-af89-40b5-adc1-9fb5d47efe8b.info Nov 01 12:26:20 devstack sudo[95789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:20 devstack sudo[95790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9d37d30c-6f17-48a8-8e33-71a2ad7af689 Nov 01 12:26:20 devstack sudo[95790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:21 devstack sudo[95789]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d11a34bf-d02c-4264-83f8-8dd27e413d8b tempest-GroupSnapshotsTest-1246896825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af582029-af89-40b5-adc1-9fb5d47efe8b.info" returned: 0 in 0.254s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:21 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-d11a34bf-d02c-4264-83f8-8dd27e413d8b tempest-GroupSnapshotsTest-1246896825 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af582029-af89-40b5-adc1-9fb5d47efe8b.info is being set with open permissions: ugo+rw: NotImplementedError Nov 01 12:26:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d11a34bf-d02c-4264-83f8-8dd27e413d8b tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af582029-af89-40b5-adc1-9fb5d47efe8b.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:21 devstack sudo[95794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af582029-af89-40b5-adc1-9fb5d47efe8b.info Nov 01 12:26:21 devstack sudo[95794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:21 devstack sudo[95790]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-94a440a2-492d-461e-9777-ab590642281b tempest-VolumesCloneTest-1907935347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9d37d30c-6f17-48a8-8e33-71a2ad7af689" returned: 0 in 0.373s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-94a440a2-492d-461e-9777-ab590642281b tempest-VolumesCloneTest-1907935347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9d37d30c-6f17-48a8-8e33-71a2ad7af689 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:21 devstack sudo[95799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9d37d30c-6f17-48a8-8e33-71a2ad7af689 Nov 01 12:26:21 devstack sudo[95799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:21 devstack sudo[95794]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d11a34bf-d02c-4264-83f8-8dd27e413d8b tempest-GroupSnapshotsTest-1246896825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af582029-af89-40b5-adc1-9fb5d47efe8b.info" returned: 0 in 0.242s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d11a34bf-d02c-4264-83f8-8dd27e413d8b tempest-GroupSnapshotsTest-1246896825 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.949s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-9abbe0b6-7c9a-4663-a5db-4f5b28df69ed req-b556b5b8-3acf-4517-b7b7-2b900db32419 tempest-ServerActionsTestOtherA-2064758512 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 11.653s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-9abbe0b6-7c9a-4663-a5db-4f5b28df69ed req-b556b5b8-3acf-4517-b7b7-2b900db32419 tempest-ServerActionsTestOtherA-2064758512 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.019s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-cafe14dd-1042-4b78-9646-3cd257314fdc tempest-AttachVolumeNegativeTest-245012374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 10.559s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:21 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-cafe14dd-1042-4b78-9646-3cd257314fdc tempest-AttachVolumeNegativeTest-245012374 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1550614436',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4157e8fb-3bd3-4d51-99ad-e24b520b6589,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='33bece50a475457daaa280199a8d84b6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:11Z,use_quota=True,user_id='5e41c2cf7aa144d488e34538a0804726',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:26:21 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-cafe14dd-1042-4b78-9646-3cd257314fdc tempest-AttachVolumeNegativeTest-245012374 None] Creating volume 4157e8fb-3bd3-4d51-99ad-e24b520b6589 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:26:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-cafe14dd-1042-4b78-9646-3cd257314fdc tempest-AttachVolumeNegativeTest-245012374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-cafe14dd-1042-4b78-9646-3cd257314fdc tempest-AttachVolumeNegativeTest-245012374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:21 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-cafe14dd-1042-4b78-9646-3cd257314fdc tempest-AttachVolumeNegativeTest-245012374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:21 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-cafe14dd-1042-4b78-9646-3cd257314fdc tempest-AttachVolumeNegativeTest-245012374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-cafe14dd-1042-4b78-9646-3cd257314fdc tempest-AttachVolumeNegativeTest-245012374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:21 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-cafe14dd-1042-4b78-9646-3cd257314fdc tempest-AttachVolumeNegativeTest-245012374 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:26:21 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-cafe14dd-1042-4b78-9646-3cd257314fdc tempest-AttachVolumeNegativeTest-245012374 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:26:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-cafe14dd-1042-4b78-9646-3cd257314fdc tempest-AttachVolumeNegativeTest-245012374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4157e8fb-3bd3-4d51-99ad-e24b520b6589 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:21 devstack sudo[95802]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4157e8fb-3bd3-4d51-99ad-e24b520b6589 1073741824 Nov 01 12:26:21 devstack sudo[95802]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:21 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-9abbe0b6-7c9a-4663-a5db-4f5b28df69ed req-b556b5b8-3acf-4517-b7b7-2b900db32419 tempest-ServerActionsTestOtherA-2064758512 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb', 'name': 'volume-4dea6740-5a36-424b-8321-cc6bf8bed2da', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'eeb9c03c-a2de-4cf7-8872-db2e245ee3a2', 'enforce_multipath': True} {{(pid=86574) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 12:26:21 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-d11a34bf-d02c-4264-83f8-8dd27e413d8b tempest-GroupSnapshotsTest-1246896825 None] group_snapshot 3ce9a1f0-ebee-48ba-80d6-08d6c4c3daf7: created successfully Nov 01 12:26:21 devstack sudo[95799]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-94a440a2-492d-461e-9777-ab590642281b tempest-VolumesCloneTest-1907935347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9d37d30c-6f17-48a8-8e33-71a2ad7af689" returned: 0 in 0.296s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:21 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-94a440a2-492d-461e-9777-ab590642281b tempest-VolumesCloneTest-1907935347 None] Lock "cinder-quobyte-9d37d30c-6f17-48a8-8e33-71a2ad7af689" released by "delete_volume" :: held 0.718s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:21 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-9abbe0b6-7c9a-4663-a5db-4f5b28df69ed req-b556b5b8-3acf-4517-b7b7-2b900db32419 tempest-ServerActionsTestOtherA-2064758512 None] attachment_update completed successfully. Nov 01 12:26:21 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-94a440a2-492d-461e-9777-ab590642281b tempest-VolumesCloneTest-1907935347 None] Created reservations ['630532de-8c94-4c4d-8771-950fe8528c38', '6cfd8e6d-dd53-472b-9b54-09c4c2f3f079', '264fa8ee-19d6-4de9-b215-564461d6a3b8', 'a7cb25d3-17d7-4b73-a13f-57cb71c15d87'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:26:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-94a440a2-492d-461e-9777-ab590642281b tempest-VolumesCloneTest-1907935347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-94a440a2-492d-461e-9777-ab590642281b tempest-VolumesCloneTest-1907935347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:21 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-94a440a2-492d-461e-9777-ab590642281b tempest-VolumesCloneTest-1907935347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:21 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-94a440a2-492d-461e-9777-ab590642281b tempest-VolumesCloneTest-1907935347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-94a440a2-492d-461e-9777-ab590642281b tempest-VolumesCloneTest-1907935347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-94a440a2-492d-461e-9777-ab590642281b tempest-VolumesCloneTest-1907935347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:21 devstack sudo[95808]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:26:21 devstack sudo[95808]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:22 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ff49ec23-083a-4e4d-a4a5-6719c4a77512 tempest-VolumesCloneTest-1907935347 None] Acquiring lock "cinder-f035f5de-c659-41c7-bd2b-f17e6ee99e92-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:22 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-5647f22a-a92f-4598-8fb3-6d6e2b90df02 tempest-GroupSnapshotsTest-1246896825 None] group_snapshot 3ce9a1f0-ebee-48ba-80d6-08d6c4c3daf7: deleting Nov 01 12:26:22 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ff49ec23-083a-4e4d-a4a5-6719c4a77512 tempest-VolumesCloneTest-1907935347 None] Lock "cinder-f035f5de-c659-41c7-bd2b-f17e6ee99e92-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:22 devstack sudo[95802]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:22 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5647f22a-a92f-4598-8fb3-6d6e2b90df02 tempest-GroupSnapshotsTest-1246896825 None] group_snapshot 3ce9a1f0-ebee-48ba-80d6-08d6c4c3daf7: deleting {{(pid=86574) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 01 12:26:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-cafe14dd-1042-4b78-9646-3cd257314fdc tempest-AttachVolumeNegativeTest-245012374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4157e8fb-3bd3-4d51-99ad-e24b520b6589 1073741824" returned: 0 in 0.698s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:22 devstack sudo[95808]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-94a440a2-492d-461e-9777-ab590642281b tempest-VolumesCloneTest-1907935347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.408s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:22 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-94a440a2-492d-461e-9777-ab590642281b tempest-VolumesCloneTest-1907935347 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:26:22 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-94a440a2-492d-461e-9777-ab590642281b tempest-VolumesCloneTest-1907935347 None] Deleted volume successfully. Nov 01 12:26:22 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-5647f22a-a92f-4598-8fb3-6d6e2b90df02 tempest-GroupSnapshotsTest-1246896825 None] Acquiring lock "cinder-quobyte-af582029-af89-40b5-adc1-9fb5d47efe8b" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:22 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ff49ec23-083a-4e4d-a4a5-6719c4a77512 tempest-VolumesCloneTest-1907935347 None] Acquiring lock "cinder-quobyte-f035f5de-c659-41c7-bd2b-f17e6ee99e92" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:22 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ff49ec23-083a-4e4d-a4a5-6719c4a77512 tempest-VolumesCloneTest-1907935347 None] Lock "cinder-quobyte-f035f5de-c659-41c7-bd2b-f17e6ee99e92" acquired by "delete_volume" :: waited 0.026s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:22 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-5647f22a-a92f-4598-8fb3-6d6e2b90df02 tempest-GroupSnapshotsTest-1246896825 None] Lock "cinder-quobyte-af582029-af89-40b5-adc1-9fb5d47efe8b" acquired by "delete_snapshot" :: waited 0.075s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:22 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-5647f22a-a92f-4598-8fb3-6d6e2b90df02 tempest-GroupSnapshotsTest-1246896825 None] Acquiring lock "cinder-quobyte-450365ac-ecf9-438a-8f6e-4a1946998741" by "_delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:22 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-94a440a2-492d-461e-9777-ab590642281b tempest-VolumesCloneTest-1907935347 None] Lock "cinder-9d37d30c-6f17-48a8-8e33-71a2ad7af689-delete_volume" released by "delete_volume" :: held 1.621s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-cafe14dd-1042-4b78-9646-3cd257314fdc tempest-AttachVolumeNegativeTest-245012374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4157e8fb-3bd3-4d51-99ad-e24b520b6589 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:22 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[87cf141a-9278-4cc0-a481-7c811440e02c]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:22 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-5647f22a-a92f-4598-8fb3-6d6e2b90df02 tempest-GroupSnapshotsTest-1246896825 None] Lock "cinder-quobyte-450365ac-ecf9-438a-8f6e-4a1946998741" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:22 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-5647f22a-a92f-4598-8fb3-6d6e2b90df02 tempest-GroupSnapshotsTest-1246896825 None] Deleting offline snapshot 450365ac-ecf9-438a-8f6e-4a1946998741 of volume af582029-af89-40b5-adc1-9fb5d47efe8b {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:26:22 devstack sudo[95913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4157e8fb-3bd3-4d51-99ad-e24b520b6589 Nov 01 12:26:22 devstack sudo[95913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:22 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-5647f22a-a92f-4598-8fb3-6d6e2b90df02 tempest-GroupSnapshotsTest-1246896825 None] snapshot_file for this snap is: volume-af582029-af89-40b5-adc1-9fb5d47efe8b.450365ac-ecf9-438a-8f6e-4a1946998741 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:26:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ff49ec23-083a-4e4d-a4a5-6719c4a77512 tempest-VolumesCloneTest-1907935347 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:22 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a4f42f-ecbf-45d1-ae5e-5fdcff8f0d31]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5647f22a-a92f-4598-8fb3-6d6e2b90df02 tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af582029-af89-40b5-adc1-9fb5d47efe8b.450365ac-ecf9-438a-8f6e-4a1946998741 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:22 devstack sudo[95921]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92 Nov 01 12:26:22 devstack sudo[95921]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:22 devstack sudo[95927]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af582029-af89-40b5-adc1-9fb5d47efe8b.450365ac-ecf9-438a-8f6e-4a1946998741 Nov 01 12:26:22 devstack sudo[95927]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:23 devstack sudo[95913]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-cafe14dd-1042-4b78-9646-3cd257314fdc tempest-AttachVolumeNegativeTest-245012374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4157e8fb-3bd3-4d51-99ad-e24b520b6589" returned: 0 in 0.595s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:23 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-cafe14dd-1042-4b78-9646-3cd257314fdc tempest-AttachVolumeNegativeTest-245012374 None] <== create_volume: return (1585ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:26:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-cafe14dd-1042-4b78-9646-3cd257314fdc tempest-AttachVolumeNegativeTest-245012374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.590s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:23 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-cafe14dd-1042-4b78-9646-3cd257314fdc tempest-AttachVolumeNegativeTest-245012374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (479c242b-6651-4ab7-99a2-df1902035129) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4157e8fb-3bd3-4d51-99ad-e24b520b6589', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:23 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-cafe14dd-1042-4b78-9646-3cd257314fdc tempest-AttachVolumeNegativeTest-245012374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f98f0815-5397-475f-a834-d6c7d5d4d651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:23 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-cafe14dd-1042-4b78-9646-3cd257314fdc tempest-AttachVolumeNegativeTest-245012374 None] Volume volume-4157e8fb-3bd3-4d51-99ad-e24b520b6589 (4157e8fb-3bd3-4d51-99ad-e24b520b6589): created successfully Nov 01 12:26:23 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-cafe14dd-1042-4b78-9646-3cd257314fdc tempest-AttachVolumeNegativeTest-245012374 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f98f0815-5397-475f-a834-d6c7d5d4d651) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:23 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-cafe14dd-1042-4b78-9646-3cd257314fdc tempest-AttachVolumeNegativeTest-245012374 None] Flow 'volume_create_manager' (d41f15fe-1afb-4f15-85ae-d7393bf64b20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:23 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-cafe14dd-1042-4b78-9646-3cd257314fdc tempest-AttachVolumeNegativeTest-245012374 None] Created volume successfully. Nov 01 12:26:23 devstack sudo[95921]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ff49ec23-083a-4e4d-a4a5-6719c4a77512 tempest-VolumesCloneTest-1907935347 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92" returned: 0 in 0.740s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ff49ec23-083a-4e4d-a4a5-6719c4a77512 tempest-VolumesCloneTest-1907935347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:23 devstack sudo[95927]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:23 devstack sudo[96268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92 Nov 01 12:26:23 devstack sudo[96268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5647f22a-a92f-4598-8fb3-6d6e2b90df02 tempest-GroupSnapshotsTest-1246896825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af582029-af89-40b5-adc1-9fb5d47efe8b.450365ac-ecf9-438a-8f6e-4a1946998741" returned: 0 in 0.717s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:23 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-5647f22a-a92f-4598-8fb3-6d6e2b90df02 tempest-GroupSnapshotsTest-1246896825 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-af582029-af89-40b5-adc1-9fb5d47efe8b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:26:23 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d8fdc96-3284-451b-8949-9a8f1b34fdbc]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5647f22a-a92f-4598-8fb3-6d6e2b90df02 tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af582029-af89-40b5-adc1-9fb5d47efe8b {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:23 devstack sudo[96276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af582029-af89-40b5-adc1-9fb5d47efe8b Nov 01 12:26:23 devstack sudo[96276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:23 devstack sudo[96268]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ff49ec23-083a-4e4d-a4a5-6719c4a77512 tempest-VolumesCloneTest-1907935347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f035f5de-c659-41c7-bd2b-f17e6ee99e92" returned: 0 in 0.327s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:23 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ff49ec23-083a-4e4d-a4a5-6719c4a77512 tempest-VolumesCloneTest-1907935347 None] Lock "cinder-quobyte-f035f5de-c659-41c7-bd2b-f17e6ee99e92" released by "delete_volume" :: held 1.233s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:23 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-ff49ec23-083a-4e4d-a4a5-6719c4a77512 tempest-VolumesCloneTest-1907935347 None] Created reservations ['fa5493cd-02d9-4da1-8f11-a2c86d590b98', '25f561c4-5c88-47da-ad34-a2376889d778', '9bed4b0b-4ff7-4e81-af5b-82ad90cf9982', '887db9f4-38a1-4a59-8034-8452c2c74bb5'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:26:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ff49ec23-083a-4e4d-a4a5-6719c4a77512 tempest-VolumesCloneTest-1907935347 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ff49ec23-083a-4e4d-a4a5-6719c4a77512 tempest-VolumesCloneTest-1907935347 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:23 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ff49ec23-083a-4e4d-a4a5-6719c4a77512 tempest-VolumesCloneTest-1907935347 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:23 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ff49ec23-083a-4e4d-a4a5-6719c4a77512 tempest-VolumesCloneTest-1907935347 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ff49ec23-083a-4e4d-a4a5-6719c4a77512 tempest-VolumesCloneTest-1907935347 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ff49ec23-083a-4e4d-a4a5-6719c4a77512 tempest-VolumesCloneTest-1907935347 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:23 devstack sudo[96276]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:23 devstack sudo[96288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:26:23 devstack sudo[96288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5647f22a-a92f-4598-8fb3-6d6e2b90df02 tempest-GroupSnapshotsTest-1246896825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af582029-af89-40b5-adc1-9fb5d47efe8b" returned: 0 in 0.487s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5647f22a-a92f-4598-8fb3-6d6e2b90df02 tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af582029-af89-40b5-adc1-9fb5d47efe8b.450365ac-ecf9-438a-8f6e-4a1946998741 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:23 devstack sudo[96290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af582029-af89-40b5-adc1-9fb5d47efe8b.450365ac-ecf9-438a-8f6e-4a1946998741 Nov 01 12:26:23 devstack sudo[96290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:24 devstack sudo[96288]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ff49ec23-083a-4e4d-a4a5-6719c4a77512 tempest-VolumesCloneTest-1907935347 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.299s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:24 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-ff49ec23-083a-4e4d-a4a5-6719c4a77512 tempest-VolumesCloneTest-1907935347 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:26:24 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-ff49ec23-083a-4e4d-a4a5-6719c4a77512 tempest-VolumesCloneTest-1907935347 None] Deleted volume successfully. Nov 01 12:26:24 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ff49ec23-083a-4e4d-a4a5-6719c4a77512 tempest-VolumesCloneTest-1907935347 None] Lock "cinder-f035f5de-c659-41c7-bd2b-f17e6ee99e92-delete_volume" released by "delete_volume" :: held 2.011s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:24 devstack sudo[96290]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5647f22a-a92f-4598-8fb3-6d6e2b90df02 tempest-GroupSnapshotsTest-1246896825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af582029-af89-40b5-adc1-9fb5d47efe8b.450365ac-ecf9-438a-8f6e-4a1946998741" returned: 0 in 0.430s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5647f22a-a92f-4598-8fb3-6d6e2b90df02 tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af582029-af89-40b5-adc1-9fb5d47efe8b.450365ac-ecf9-438a-8f6e-4a1946998741 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:24 devstack sudo[96299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af582029-af89-40b5-adc1-9fb5d47efe8b.450365ac-ecf9-438a-8f6e-4a1946998741 Nov 01 12:26:24 devstack sudo[96299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:24 devstack sudo[96299]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5647f22a-a92f-4598-8fb3-6d6e2b90df02 tempest-GroupSnapshotsTest-1246896825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af582029-af89-40b5-adc1-9fb5d47efe8b.450365ac-ecf9-438a-8f6e-4a1946998741" returned: 0 in 0.434s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:24 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-5647f22a-a92f-4598-8fb3-6d6e2b90df02 tempest-GroupSnapshotsTest-1246896825 None] Lock "cinder-quobyte-450365ac-ecf9-438a-8f6e-4a1946998741" released by "_delete_snapshot" :: held 2.357s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:24 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-5647f22a-a92f-4598-8fb3-6d6e2b90df02 tempest-GroupSnapshotsTest-1246896825 None] Lock "cinder-quobyte-af582029-af89-40b5-adc1-9fb5d47efe8b" released by "delete_snapshot" :: held 2.426s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:25 devstack cinder-volume[86574]: WARNING cinder.quota [None req-5647f22a-a92f-4598-8fb3-6d6e2b90df02 tempest-GroupSnapshotsTest-1246896825 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-1329773880 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-1329773880, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:26:25 devstack cinder-volume[86574]: WARNING cinder.quota [None req-5647f22a-a92f-4598-8fb3-6d6e2b90df02 tempest-GroupSnapshotsTest-1246896825 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-1329773880 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-1329773880, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:26:25 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-5647f22a-a92f-4598-8fb3-6d6e2b90df02 tempest-GroupSnapshotsTest-1246896825 None] Created reservations ['f212c2e6-6c07-496d-b2a5-3058e5067928', '65c29272-7b86-4d0c-abc3-f4ad0586ceb1', '79df2038-f938-4bdf-a0c2-deae3c84afa9', 'db87a08d-bc75-418a-90de-431ceb91d9ce'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:26:25 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-5647f22a-a92f-4598-8fb3-6d6e2b90df02 tempest-GroupSnapshotsTest-1246896825 None] group_snapshot 3ce9a1f0-ebee-48ba-80d6-08d6c4c3daf7: deleted successfully Nov 01 12:26:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-b2bf9619-9d48-42d0-ad10-1da815d09287 req-8f924f4d-3be4-40b8-946b-45507074707c tempest-AttachVolumeNegativeTest-245012374 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-b2bf9619-9d48-42d0-ad10-1da815d09287 req-8f924f4d-3be4-40b8-946b-45507074707c tempest-AttachVolumeNegativeTest-245012374 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-b2bf9619-9d48-42d0-ad10-1da815d09287 req-8f924f4d-3be4-40b8-946b-45507074707c tempest-AttachVolumeNegativeTest-245012374 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.026s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:25 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-b2bf9619-9d48-42d0-ad10-1da815d09287 req-8f924f4d-3be4-40b8-946b-45507074707c tempest-AttachVolumeNegativeTest-245012374 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb', 'name': 'volume-4157e8fb-3bd3-4d51-99ad-e24b520b6589', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '40709d0b-5a05-41b1-9716-410fd18185ae', 'enforce_multipath': True} {{(pid=86574) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 12:26:25 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-b2bf9619-9d48-42d0-ad10-1da815d09287 req-8f924f4d-3be4-40b8-946b-45507074707c tempest-AttachVolumeNegativeTest-245012374 None] attachment_update completed successfully. Nov 01 12:26:26 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-08a9d764-8b84-4fab-9bc9-f5a173c6d440 tempest-GroupSnapshotsTest-1246896825 None] Acquiring lock "cinder-quobyte-af582029-af89-40b5-adc1-9fb5d47efe8b" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:26 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-08a9d764-8b84-4fab-9bc9-f5a173c6d440 tempest-GroupSnapshotsTest-1246896825 None] Lock "cinder-quobyte-af582029-af89-40b5-adc1-9fb5d47efe8b" acquired by "delete_volume" :: waited 0.056s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:26 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d192c84-fcae-4571-87ae-5911bb19307a]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-08a9d764-8b84-4fab-9bc9-f5a173c6d440 tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af582029-af89-40b5-adc1-9fb5d47efe8b {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:26 devstack sudo[96315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af582029-af89-40b5-adc1-9fb5d47efe8b Nov 01 12:26:26 devstack sudo[96315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:26 devstack sudo[96315]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-08a9d764-8b84-4fab-9bc9-f5a173c6d440 tempest-GroupSnapshotsTest-1246896825 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af582029-af89-40b5-adc1-9fb5d47efe8b" returned: 0 in 0.758s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-08a9d764-8b84-4fab-9bc9-f5a173c6d440 tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af582029-af89-40b5-adc1-9fb5d47efe8b {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:27 devstack sudo[96321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af582029-af89-40b5-adc1-9fb5d47efe8b Nov 01 12:26:27 devstack sudo[96321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:27 devstack sudo[96321]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-08a9d764-8b84-4fab-9bc9-f5a173c6d440 tempest-GroupSnapshotsTest-1246896825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af582029-af89-40b5-adc1-9fb5d47efe8b" returned: 0 in 0.441s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:27 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-08a9d764-8b84-4fab-9bc9-f5a173c6d440 tempest-GroupSnapshotsTest-1246896825 None] Lock "cinder-quobyte-af582029-af89-40b5-adc1-9fb5d47efe8b" released by "delete_volume" :: held 1.354s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:27 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-08a9d764-8b84-4fab-9bc9-f5a173c6d440 tempest-GroupSnapshotsTest-1246896825 None] Created reservations ['8c56d270-cd14-49bd-8b2e-8f1c8934cb75'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:26:27 devstack cinder-volume[86574]: WARNING cinder.quota [None req-08a9d764-8b84-4fab-9bc9-f5a173c6d440 tempest-GroupSnapshotsTest-1246896825 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-1329773880 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-1329773880, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:26:27 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-08a9d764-8b84-4fab-9bc9-f5a173c6d440 tempest-GroupSnapshotsTest-1246896825 None] Created reservations ['87e895e2-7429-4b1d-961a-3b87a6ba25cc', '797b4328-febb-4ea1-b77f-62d3e62b5aa0', '6f9b9112-0f58-4854-8191-d43e658641e6', '07de3bf1-544b-4237-8789-5406f335edff'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:26:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-08a9d764-8b84-4fab-9bc9-f5a173c6d440 tempest-GroupSnapshotsTest-1246896825 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-08a9d764-8b84-4fab-9bc9-f5a173c6d440 tempest-GroupSnapshotsTest-1246896825 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:27 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-08a9d764-8b84-4fab-9bc9-f5a173c6d440 tempest-GroupSnapshotsTest-1246896825 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:27 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-08a9d764-8b84-4fab-9bc9-f5a173c6d440 tempest-GroupSnapshotsTest-1246896825 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-08a9d764-8b84-4fab-9bc9-f5a173c6d440 tempest-GroupSnapshotsTest-1246896825 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-08a9d764-8b84-4fab-9bc9-f5a173c6d440 tempest-GroupSnapshotsTest-1246896825 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:28 devstack sudo[96325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:26:28 devstack sudo[96325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:28 devstack sudo[96325]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-08a9d764-8b84-4fab-9bc9-f5a173c6d440 tempest-GroupSnapshotsTest-1246896825 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.488s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:28 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-08a9d764-8b84-4fab-9bc9-f5a173c6d440 tempest-GroupSnapshotsTest-1246896825 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:26:28 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-08a9d764-8b84-4fab-9bc9-f5a173c6d440 tempest-GroupSnapshotsTest-1246896825 None] Delete group completed successfully. Nov 01 12:26:29 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-b4f4c974-4ec0-4944-b4f7-14d0a9603195 req-f2ec18fc-801e-4fc7-8543-55e9d7ebbd52 tempest-AttachVolumeNegativeTest-245012374 None] Terminate volume connection completed successfully. Nov 01 12:26:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-b4f4c974-4ec0-4944-b4f7-14d0a9603195 req-f2ec18fc-801e-4fc7-8543-55e9d7ebbd52 tempest-AttachVolumeNegativeTest-245012374 None] Deleting attachment 40709d0b-5a05-41b1-9716-410fd18185ae. {{(pid=86574) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 12:26:33 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:26:33 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] Flow 'volume_create_manager' (a16ba508-1588-4abc-9b2b-2a53245bf88f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:33 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ebfd182-f398-499c-8591-2e6a67f7be31) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:33 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ebfd182-f398-499c-8591-2e6a67f7be31) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1323050588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adaa610d-96b5-449a-876f-32c06c090214,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b94d621d740842939d4dc6d486ab7ee0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:33Z,use_quota=True,user_id='9a1b254e042b4afcbfa1402a74eddaa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:33 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2617f432-c0d3-4f1e-80c7-4549cd61da1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:33 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2617f432-c0d3-4f1e-80c7-4549cd61da1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:33 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3516659b-d6a6-4466-a2bd-1c35292fd172) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:33 devstack cinder-volume[86574]: DEBUG cinder.image.glance [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] Creating Keystone auth plugin from conf {{(pid=86574) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 01 12:26:34 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3516659b-d6a6-4466-a2bd-1c35292fd172) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'adaa610d-96b5-449a-876f-32c06c090214', 'volume_name': 'volume-adaa610d-96b5-449a-876f-32c06c090214', 'volume_size': 1, 'image_id': 'f937a0d6-76b6-4a84-a698-e474557181cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f937a0d6-76b6-4a84-a698-e474557181cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4892ea0f5a04c4d8b924ece0f60a2a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f937a0d6-76b6-4a84-a698-e474557181cd', 'created_at': datetime.datetime(2026, 11, 1, 11, 14, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 14, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f937a0d6-76b6-4a84-a698-e474557181cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:34 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3cdd801-ce40-49dd-960a-4a132c3bf7fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:34 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c3cdd801-ce40-49dd-960a-4a132c3bf7fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:34 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecce0aba-c6c3-466c-9a94-36eb97341d99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:34 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] Volume adaa610d-96b5-449a-876f-32c06c090214: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-adaa610d-96b5-449a-876f-32c06c090214', 'volume_size': 1, 'image_id': 'f937a0d6-76b6-4a84-a698-e474557181cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f937a0d6-76b6-4a84-a698-e474557181cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4892ea0f5a04c4d8b924ece0f60a2a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f937a0d6-76b6-4a84-a698-e474557181cd', 'created_at': datetime.datetime(2026, 11, 1, 11, 14, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 14, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f937a0d6-76b6-4a84-a698-e474557181cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 01 12:26:34 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] Trying to clone adaa610d-96b5-449a-876f-32c06c090214 from image f937a0d6-76b6-4a84-a698-e474557181cd at location (None, [{'url': 'file:///opt/stack/data/glance/images/f937a0d6-76b6-4a84-a698-e474557181cd', 'metadata': {}}]). {{(pid=86574) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 01 12:26:34 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_3b58q1z_devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86574) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 01 12:26:34 devstack cinder-volume[86574]: INFO cinder.image.image_utils [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] Image download 20.69 MB at 20.69 MB/s Nov 01 12:26:34 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[04df6119-72be-4426-a88a-312f30ddec13]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_3b58q1z_devstack@QuobyteHD {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:35 devstack sudo[96393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_3b58q1z_devstack@QuobyteHD Nov 01 12:26:35 devstack sudo[96393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:35 devstack sudo[96393]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_3b58q1z_devstack@QuobyteHD" returned: 0 in 0.456s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:35 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] Temporary image f937a0d6-76b6-4a84-a698-e474557181cd is fetched for user 9a1b254e042b4afcbfa1402a74eddaa7. {{(pid=86574) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 01 12:26:35 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b358fcd-7b17-4a0d-9bda-fa9d168c00da]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_3b58q1z_devstack@QuobyteHD {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:35 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-546075b5-8f48-4eca-85ae-4116422c594c tempest-AttachVolumeNegativeTest-245012374 None] Acquiring lock "cinder-4157e8fb-3bd3-4d51-99ad-e24b520b6589-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:35 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-546075b5-8f48-4eca-85ae-4116422c594c tempest-AttachVolumeNegativeTest-245012374 None] Lock "cinder-4157e8fb-3bd3-4d51-99ad-e24b520b6589-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:35 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-546075b5-8f48-4eca-85ae-4116422c594c tempest-AttachVolumeNegativeTest-245012374 None] Acquiring lock "cinder-quobyte-4157e8fb-3bd3-4d51-99ad-e24b520b6589" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:35 devstack sudo[96399]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_3b58q1z_devstack@QuobyteHD Nov 01 12:26:35 devstack sudo[96399]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:35 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-546075b5-8f48-4eca-85ae-4116422c594c tempest-AttachVolumeNegativeTest-245012374 None] Lock "cinder-quobyte-4157e8fb-3bd3-4d51-99ad-e24b520b6589" acquired by "delete_volume" :: waited 0.026s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:35 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[d1b6db36-eb01-4f6d-992b-c2ee88620c10]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-546075b5-8f48-4eca-85ae-4116422c594c tempest-AttachVolumeNegativeTest-245012374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4157e8fb-3bd3-4d51-99ad-e24b520b6589 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:35 devstack sudo[96401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4157e8fb-3bd3-4d51-99ad-e24b520b6589 Nov 01 12:26:35 devstack sudo[96401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:35 devstack sudo[96399]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_3b58q1z_devstack@QuobyteHD" returned: 0 in 0.427s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:35 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1323050588',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=adaa610d-96b5-449a-876f-32c06c090214,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b94d621d740842939d4dc6d486ab7ee0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:33Z,use_quota=True,user_id='9a1b254e042b4afcbfa1402a74eddaa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:26:35 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] Creating volume adaa610d-96b5-449a-876f-32c06c090214 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:26:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:35 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:35 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:35 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:26:35 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:26:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-adaa610d-96b5-449a-876f-32c06c090214 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:35 devstack sudo[96407]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-adaa610d-96b5-449a-876f-32c06c090214 1073741824 Nov 01 12:26:35 devstack sudo[96407]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:36 devstack sudo[96401]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-546075b5-8f48-4eca-85ae-4116422c594c tempest-AttachVolumeNegativeTest-245012374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4157e8fb-3bd3-4d51-99ad-e24b520b6589" returned: 0 in 0.497s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-546075b5-8f48-4eca-85ae-4116422c594c tempest-AttachVolumeNegativeTest-245012374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4157e8fb-3bd3-4d51-99ad-e24b520b6589 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:36 devstack sudo[96412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4157e8fb-3bd3-4d51-99ad-e24b520b6589 Nov 01 12:26:36 devstack sudo[96412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:36 devstack sudo[96407]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-adaa610d-96b5-449a-876f-32c06c090214 1073741824" returned: 0 in 0.543s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-adaa610d-96b5-449a-876f-32c06c090214 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:36 devstack sudo[96419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-adaa610d-96b5-449a-876f-32c06c090214 Nov 01 12:26:36 devstack sudo[96419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:36 devstack sudo[96412]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-546075b5-8f48-4eca-85ae-4116422c594c tempest-AttachVolumeNegativeTest-245012374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4157e8fb-3bd3-4d51-99ad-e24b520b6589" returned: 0 in 0.397s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:36 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-546075b5-8f48-4eca-85ae-4116422c594c tempest-AttachVolumeNegativeTest-245012374 None] Lock "cinder-quobyte-4157e8fb-3bd3-4d51-99ad-e24b520b6589" released by "delete_volume" :: held 0.953s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:36 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-546075b5-8f48-4eca-85ae-4116422c594c tempest-AttachVolumeNegativeTest-245012374 None] Created reservations ['74e19c42-e3f4-4eaf-b643-84aebb03ca72', '34860228-08d9-4802-b472-5bcc94e5545e', 'cceb9077-f4de-4947-85c1-4333fa86c08f', 'fe9f40e7-551b-4dce-9aef-50ca6a1f75c7'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:26:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-546075b5-8f48-4eca-85ae-4116422c594c tempest-AttachVolumeNegativeTest-245012374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-546075b5-8f48-4eca-85ae-4116422c594c tempest-AttachVolumeNegativeTest-245012374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:36 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-546075b5-8f48-4eca-85ae-4116422c594c tempest-AttachVolumeNegativeTest-245012374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:36 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-546075b5-8f48-4eca-85ae-4116422c594c tempest-AttachVolumeNegativeTest-245012374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-546075b5-8f48-4eca-85ae-4116422c594c tempest-AttachVolumeNegativeTest-245012374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-546075b5-8f48-4eca-85ae-4116422c594c tempest-AttachVolumeNegativeTest-245012374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:36 devstack sudo[96421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:26:36 devstack sudo[96421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:36 devstack sudo[96419]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-adaa610d-96b5-449a-876f-32c06c090214" returned: 0 in 0.453s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:36 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] <== create_volume: return (1061ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:26:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:36 devstack cinder-volume[86574]: DEBUG cinder.volume.volume_utils [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] Attempting download of f937a0d6-76b6-4a84-a698-e474557181cd ((None, [{'url': 'file:///opt/stack/data/glance/images/f937a0d6-76b6-4a84-a698-e474557181cd', 'metadata': {}}])) to volume adaa610d-96b5-449a-876f-32c06c090214. {{(pid=86574) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 01 12:26:37 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[1bd28bd9-b486-457f-b25c-74ee56ee2e77]: (4, 'raw') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f937a0d6-76b6-4a84-a698-e474557181cd_giyuk9pi {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:37 devstack sudo[96421]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-546075b5-8f48-4eca-85ae-4116422c594c tempest-AttachVolumeNegativeTest-245012374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.383s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:37 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-546075b5-8f48-4eca-85ae-4116422c594c tempest-AttachVolumeNegativeTest-245012374 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:26:37 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-546075b5-8f48-4eca-85ae-4116422c594c tempest-AttachVolumeNegativeTest-245012374 None] Deleted volume successfully. Nov 01 12:26:37 devstack sudo[96424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f937a0d6-76b6-4a84-a698-e474557181cd_giyuk9pi Nov 01 12:26:37 devstack sudo[96424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:37 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-546075b5-8f48-4eca-85ae-4116422c594c tempest-AttachVolumeNegativeTest-245012374 None] Lock "cinder-4157e8fb-3bd3-4d51-99ad-e24b520b6589-delete_volume" released by "delete_volume" :: held 1.684s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:37 devstack sudo[96424]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f937a0d6-76b6-4a84-a698-e474557181cd_giyuk9pi" returned: 0 in 0.411s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f937a0d6-76b6-4a84-a698-e474557181cd_giyuk9pi {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:37 devstack sudo[96429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f937a0d6-76b6-4a84-a698-e474557181cd_giyuk9pi Nov 01 12:26:37 devstack sudo[96429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:37 devstack sudo[96429]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f937a0d6-76b6-4a84-a698-e474557181cd_giyuk9pi" returned: 1 in 0.390s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f937a0d6-76b6-4a84-a698-e474557181cd_giyuk9pi' failed. Not Retrying. {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 12:26:37 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[070f732a-6968-4f91-a9bc-0fababf1bcb4]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_3b58q1z_devstack@QuobyteHD {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:37 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ccfef346-026e-4e2e-ba83-b4573cf2ac76 tempest-AttachVolumeNegativeTest-245012374 None] Acquiring lock "cinder-ec55a935-dc22-4dee-95e8-b0c90326849b-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:37 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ccfef346-026e-4e2e-ba83-b4573cf2ac76 tempest-AttachVolumeNegativeTest-245012374 None] Lock "cinder-ec55a935-dc22-4dee-95e8-b0c90326849b-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:38 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ccfef346-026e-4e2e-ba83-b4573cf2ac76 tempest-AttachVolumeNegativeTest-245012374 None] Acquiring lock "cinder-quobyte-ec55a935-dc22-4dee-95e8-b0c90326849b" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:38 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ccfef346-026e-4e2e-ba83-b4573cf2ac76 tempest-AttachVolumeNegativeTest-245012374 None] Lock "cinder-quobyte-ec55a935-dc22-4dee-95e8-b0c90326849b" acquired by "delete_volume" :: waited 0.021s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:38 devstack sudo[96434]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_3b58q1z_devstack@QuobyteHD Nov 01 12:26:38 devstack sudo[96434]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:38 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[c33dd543-9ada-444a-9c82-85f68b97cd7e]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ccfef346-026e-4e2e-ba83-b4573cf2ac76 tempest-AttachVolumeNegativeTest-245012374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ec55a935-dc22-4dee-95e8-b0c90326849b {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:38 devstack sudo[96436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ec55a935-dc22-4dee-95e8-b0c90326849b Nov 01 12:26:38 devstack sudo[96436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:38 devstack sudo[96434]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_3b58q1z_devstack@QuobyteHD" returned: 0 in 0.543s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:38 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] f937a0d6-76b6-4a84-a698-e474557181cd was qcow2, converting to qcow2 {{(pid=86574) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 01 12:26:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_3b58q1z_devstack@QuobyteHD /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-adaa610d-96b5-449a-876f-32c06c090214 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:38 devstack sudo[96441]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_3b58q1z_devstack@QuobyteHD /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-adaa610d-96b5-449a-876f-32c06c090214 Nov 01 12:26:38 devstack sudo[96441]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:38 devstack sudo[96436]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ccfef346-026e-4e2e-ba83-b4573cf2ac76 tempest-AttachVolumeNegativeTest-245012374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ec55a935-dc22-4dee-95e8-b0c90326849b" returned: 0 in 0.550s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ccfef346-026e-4e2e-ba83-b4573cf2ac76 tempest-AttachVolumeNegativeTest-245012374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ec55a935-dc22-4dee-95e8-b0c90326849b {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:38 devstack sudo[96447]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ec55a935-dc22-4dee-95e8-b0c90326849b Nov 01 12:26:38 devstack sudo[96447]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:38 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-10cd6573-92ed-4caa-8c26-e659384a32e6 tempest-SnapshotsActionsTest-1207636017 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:26:38 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-10cd6573-92ed-4caa-8c26-e659384a32e6 tempest-SnapshotsActionsTest-1207636017 None] Flow 'volume_create_manager' (4a19f011-e39f-4615-b58f-070ce3d43011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:38 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-10cd6573-92ed-4caa-8c26-e659384a32e6 tempest-SnapshotsActionsTest-1207636017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a13b9d71-6473-4120-a284-bc9c88231d83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:39 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-10cd6573-92ed-4caa-8c26-e659384a32e6 tempest-SnapshotsActionsTest-1207636017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a13b9d71-6473-4120-a284-bc9c88231d83) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2115075458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96a340ff-bc46-488b-a48d-d4848e67facd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1d4c431831b401f8d4c995162138c03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:39Z,use_quota=True,user_id='09c7a757282947a3bde043d846a4f200',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:39 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-10cd6573-92ed-4caa-8c26-e659384a32e6 tempest-SnapshotsActionsTest-1207636017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cd966ec-49e1-477d-bd1e-6a19811d0431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:39 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-10cd6573-92ed-4caa-8c26-e659384a32e6 tempest-SnapshotsActionsTest-1207636017 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6cd966ec-49e1-477d-bd1e-6a19811d0431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:39 devstack sudo[96447]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:39 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-10cd6573-92ed-4caa-8c26-e659384a32e6 tempest-SnapshotsActionsTest-1207636017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d7c7666-b43e-44d5-870c-aa84f2425651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:39 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-10cd6573-92ed-4caa-8c26-e659384a32e6 tempest-SnapshotsActionsTest-1207636017 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d7c7666-b43e-44d5-870c-aa84f2425651) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96a340ff-bc46-488b-a48d-d4848e67facd', 'volume_name': 'volume-96a340ff-bc46-488b-a48d-d4848e67facd', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:39 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-10cd6573-92ed-4caa-8c26-e659384a32e6 tempest-SnapshotsActionsTest-1207636017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b08bfdbc-d5d1-449f-9db0-bef9a77241b7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:39 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-10cd6573-92ed-4caa-8c26-e659384a32e6 tempest-SnapshotsActionsTest-1207636017 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b08bfdbc-d5d1-449f-9db0-bef9a77241b7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:39 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-10cd6573-92ed-4caa-8c26-e659384a32e6 tempest-SnapshotsActionsTest-1207636017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (347eb26f-43bf-40fa-9ab3-58d540638757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:39 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-10cd6573-92ed-4caa-8c26-e659384a32e6 tempest-SnapshotsActionsTest-1207636017 None] Volume 96a340ff-bc46-488b-a48d-d4848e67facd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96a340ff-bc46-488b-a48d-d4848e67facd', 'volume_size': 1} Nov 01 12:26:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-10cd6573-92ed-4caa-8c26-e659384a32e6 tempest-SnapshotsActionsTest-1207636017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-10cd6573-92ed-4caa-8c26-e659384a32e6 tempest-SnapshotsActionsTest-1207636017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-10cd6573-92ed-4caa-8c26-e659384a32e6 tempest-SnapshotsActionsTest-1207636017 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-2115075458',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96a340ff-bc46-488b-a48d-d4848e67facd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c1d4c431831b401f8d4c995162138c03',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:39Z,use_quota=True,user_id='09c7a757282947a3bde043d846a4f200',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:26:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-10cd6573-92ed-4caa-8c26-e659384a32e6 tempest-SnapshotsActionsTest-1207636017 None] Creating volume 96a340ff-bc46-488b-a48d-d4848e67facd {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:26:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-10cd6573-92ed-4caa-8c26-e659384a32e6 tempest-SnapshotsActionsTest-1207636017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-10cd6573-92ed-4caa-8c26-e659384a32e6 tempest-SnapshotsActionsTest-1207636017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-10cd6573-92ed-4caa-8c26-e659384a32e6 tempest-SnapshotsActionsTest-1207636017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-10cd6573-92ed-4caa-8c26-e659384a32e6 tempest-SnapshotsActionsTest-1207636017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-10cd6573-92ed-4caa-8c26-e659384a32e6 tempest-SnapshotsActionsTest-1207636017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-10cd6573-92ed-4caa-8c26-e659384a32e6 tempest-SnapshotsActionsTest-1207636017 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:26:39 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-10cd6573-92ed-4caa-8c26-e659384a32e6 tempest-SnapshotsActionsTest-1207636017 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:26:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-10cd6573-92ed-4caa-8c26-e659384a32e6 tempest-SnapshotsActionsTest-1207636017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ccfef346-026e-4e2e-ba83-b4573cf2ac76 tempest-AttachVolumeNegativeTest-245012374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ec55a935-dc22-4dee-95e8-b0c90326849b" returned: 0 in 0.423s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:39 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ccfef346-026e-4e2e-ba83-b4573cf2ac76 tempest-AttachVolumeNegativeTest-245012374 None] Lock "cinder-quobyte-ec55a935-dc22-4dee-95e8-b0c90326849b" released by "delete_volume" :: held 1.035s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:39 devstack sudo[96456]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd 1073741824 Nov 01 12:26:39 devstack sudo[96456]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:39 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-ccfef346-026e-4e2e-ba83-b4573cf2ac76 tempest-AttachVolumeNegativeTest-245012374 None] Created reservations ['c8563057-1190-4d36-b00f-44bcf68b5322', '254c89eb-2182-4dbd-a012-5638b133bc70', '6b099503-22e1-40af-bf3d-2e8c406e838a', 'b61b16d9-7007-4aa6-b844-b4836da19c39'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:26:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ccfef346-026e-4e2e-ba83-b4573cf2ac76 tempest-AttachVolumeNegativeTest-245012374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ccfef346-026e-4e2e-ba83-b4573cf2ac76 tempest-AttachVolumeNegativeTest-245012374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ccfef346-026e-4e2e-ba83-b4573cf2ac76 tempest-AttachVolumeNegativeTest-245012374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ccfef346-026e-4e2e-ba83-b4573cf2ac76 tempest-AttachVolumeNegativeTest-245012374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ccfef346-026e-4e2e-ba83-b4573cf2ac76 tempest-AttachVolumeNegativeTest-245012374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ccfef346-026e-4e2e-ba83-b4573cf2ac76 tempest-AttachVolumeNegativeTest-245012374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:39 devstack sudo[96458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:26:39 devstack sudo[96458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:39 devstack sudo[96458]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ccfef346-026e-4e2e-ba83-b4573cf2ac76 tempest-AttachVolumeNegativeTest-245012374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.393s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:39 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-ccfef346-026e-4e2e-ba83-b4573cf2ac76 tempest-AttachVolumeNegativeTest-245012374 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:26:39 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-ccfef346-026e-4e2e-ba83-b4573cf2ac76 tempest-AttachVolumeNegativeTest-245012374 None] Deleted volume successfully. Nov 01 12:26:39 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ccfef346-026e-4e2e-ba83-b4573cf2ac76 tempest-AttachVolumeNegativeTest-245012374 None] Lock "cinder-ec55a935-dc22-4dee-95e8-b0c90326849b-delete_volume" released by "delete_volume" :: held 1.718s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:39 devstack sudo[96456]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-10cd6573-92ed-4caa-8c26-e659384a32e6 tempest-SnapshotsActionsTest-1207636017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd 1073741824" returned: 0 in 0.685s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-10cd6573-92ed-4caa-8c26-e659384a32e6 tempest-SnapshotsActionsTest-1207636017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:39 devstack sudo[96471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd Nov 01 12:26:39 devstack sudo[96471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:39 devstack cinder-volume[86574]: DEBUG oslo_service.periodic_task [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86574) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:26:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:39 devstack sudo[96473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:26:39 devstack sudo[96473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:40 devstack sudo[96471]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-10cd6573-92ed-4caa-8c26-e659384a32e6 tempest-SnapshotsActionsTest-1207636017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd" returned: 0 in 0.283s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:40 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-10cd6573-92ed-4caa-8c26-e659384a32e6 tempest-SnapshotsActionsTest-1207636017 None] <== create_volume: return (1034ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:26:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-10cd6573-92ed-4caa-8c26-e659384a32e6 tempest-SnapshotsActionsTest-1207636017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.038s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-10cd6573-92ed-4caa-8c26-e659384a32e6 tempest-SnapshotsActionsTest-1207636017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (347eb26f-43bf-40fa-9ab3-58d540638757) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96a340ff-bc46-488b-a48d-d4848e67facd', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-10cd6573-92ed-4caa-8c26-e659384a32e6 tempest-SnapshotsActionsTest-1207636017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f98972c-538e-43e1-9e95-87d3aebe7431) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:40 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-10cd6573-92ed-4caa-8c26-e659384a32e6 tempest-SnapshotsActionsTest-1207636017 None] Volume volume-96a340ff-bc46-488b-a48d-d4848e67facd (96a340ff-bc46-488b-a48d-d4848e67facd): created successfully Nov 01 12:26:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-10cd6573-92ed-4caa-8c26-e659384a32e6 tempest-SnapshotsActionsTest-1207636017 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6f98972c-538e-43e1-9e95-87d3aebe7431) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-10cd6573-92ed-4caa-8c26-e659384a32e6 tempest-SnapshotsActionsTest-1207636017 None] Flow 'volume_create_manager' (4a19f011-e39f-4615-b58f-070ce3d43011) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:40 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-10cd6573-92ed-4caa-8c26-e659384a32e6 tempest-SnapshotsActionsTest-1207636017 None] Created volume successfully. Nov 01 12:26:40 devstack sudo[96473]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.411s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:40 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:26:40 devstack cinder-volume[86574]: DEBUG oslo_service.periodic_task [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running periodic task VolumeManager._thread_info {{(pid=86574) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:26:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] thread count: 28 {{(pid=86574) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 12:26:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] thread info: [<_MainThread(MainThread, started 131331184930944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86574) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 12:26:40 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a4884b85-bec3-4395-8184-11ba191f3422 tempest-AttachVolumeNegativeTest-245012374 None] Acquiring lock "cinder-24a6a708-b2b5-423d-9db6-52133f9f1eb4-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:40 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a4884b85-bec3-4395-8184-11ba191f3422 tempest-AttachVolumeNegativeTest-245012374 None] Lock "cinder-24a6a708-b2b5-423d-9db6-52133f9f1eb4-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:40 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a4884b85-bec3-4395-8184-11ba191f3422 tempest-AttachVolumeNegativeTest-245012374 None] Acquiring lock "cinder-quobyte-24a6a708-b2b5-423d-9db6-52133f9f1eb4" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:40 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a4884b85-bec3-4395-8184-11ba191f3422 tempest-AttachVolumeNegativeTest-245012374 None] Lock "cinder-quobyte-24a6a708-b2b5-423d-9db6-52133f9f1eb4" acquired by "delete_volume" :: waited 0.021s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:40 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[c622be5a-3def-4000-882d-33cd4e2567c0]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a4884b85-bec3-4395-8184-11ba191f3422 tempest-AttachVolumeNegativeTest-245012374 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24a6a708-b2b5-423d-9db6-52133f9f1eb4 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:40 devstack sudo[96441]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_3b58q1z_devstack@QuobyteHD /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-adaa610d-96b5-449a-876f-32c06c090214" returned: 0 in 2.331s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:40 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_3b58q1z_devstack@QuobyteHD, size 112.00 MB, duration 2.33 sec, destination /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-adaa610d-96b5-449a-876f-32c06c090214 {{(pid=86574) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 12:26:40 devstack cinder-volume[86574]: INFO cinder.image.image_utils [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] Converted 112.00 MB image at 48.02 MB/s Nov 01 12:26:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-adaa610d-96b5-449a-876f-32c06c090214 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:40 devstack sudo[96478]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-adaa610d-96b5-449a-876f-32c06c090214 1G Nov 01 12:26:40 devstack sudo[96478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:40 devstack sudo[96477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24a6a708-b2b5-423d-9db6-52133f9f1eb4 Nov 01 12:26:40 devstack sudo[96477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:41 devstack sudo[96478]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-adaa610d-96b5-449a-876f-32c06c090214 1G" returned: 0 in 0.421s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:41 devstack cinder-volume[86574]: DEBUG cinder.volume.volume_utils [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] Downloaded image f937a0d6-76b6-4a84-a698-e474557181cd ((None, [{'url': 'file:///opt/stack/data/glance/images/f937a0d6-76b6-4a84-a698-e474557181cd', 'metadata': {}}])) to volume adaa610d-96b5-449a-876f-32c06c090214 successfully. {{(pid=86574) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 01 12:26:41 devstack sudo[96477]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:41 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] Temporary image f937a0d6-76b6-4a84-a698-e474557181cd for user 9a1b254e042b4afcbfa1402a74eddaa7 is deleted. {{(pid=86574) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 01 12:26:41 devstack cinder-volume[86574]: DEBUG cinder.volume.volume_utils [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] Marking volume adaa610d-96b5-449a-876f-32c06c090214 as bootable. {{(pid=86574) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 01 12:26:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a4884b85-bec3-4395-8184-11ba191f3422 tempest-AttachVolumeNegativeTest-245012374 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24a6a708-b2b5-423d-9db6-52133f9f1eb4" returned: 0 in 0.489s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a4884b85-bec3-4395-8184-11ba191f3422 tempest-AttachVolumeNegativeTest-245012374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24a6a708-b2b5-423d-9db6-52133f9f1eb4 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:41 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] Copying metadata from image f937a0d6-76b6-4a84-a698-e474557181cd to adaa610d-96b5-449a-876f-32c06c090214. {{(pid=86574) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 01 12:26:41 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] Creating volume glance metadata for volume adaa610d-96b5-449a-876f-32c06c090214 backed by image f937a0d6-76b6-4a84-a698-e474557181cd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f937a0d6-76b6-4a84-a698-e474557181cd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86574) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 01 12:26:41 devstack sudo[96489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24a6a708-b2b5-423d-9db6-52133f9f1eb4 Nov 01 12:26:41 devstack sudo[96489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0fd257a0-a71a-428f-921b-3470376e7d8d tempest-SnapshotsActionsTest-1207636017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0fd257a0-a71a-428f-921b-3470376e7d8d tempest-SnapshotsActionsTest-1207636017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:41 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-0fd257a0-a71a-428f-921b-3470376e7d8d tempest-SnapshotsActionsTest-1207636017 None] Creating offline snapshot 2038db6d-de31-4331-a7d1-c0df308b3eb9 of volume 96a340ff-bc46-488b-a48d-d4848e67facd {{(pid=86574) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:26:41 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[c281193a-c195-4560-9d34-6527f19e7538]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0fd257a0-a71a-428f-921b-3470376e7d8d tempest-SnapshotsActionsTest-1207636017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ecce0aba-c6c3-466c-9a94-36eb97341d99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-adaa610d-96b5-449a-876f-32c06c090214', 'volume_size': 1, 'image_id': 'f937a0d6-76b6-4a84-a698-e474557181cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f937a0d6-76b6-4a84-a698-e474557181cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4892ea0f5a04c4d8b924ece0f60a2a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f937a0d6-76b6-4a84-a698-e474557181cd', 'created_at': datetime.datetime(2026, 11, 1, 11, 14, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 14, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f937a0d6-76b6-4a84-a698-e474557181cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (021bf109-14ae-48a2-9da6-e5709dbb23fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:41 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] Volume volume-adaa610d-96b5-449a-876f-32c06c090214 (adaa610d-96b5-449a-876f-32c06c090214): created successfully Nov 01 12:26:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (021bf109-14ae-48a2-9da6-e5709dbb23fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] Flow 'volume_create_manager' (a16ba508-1588-4abc-9b2b-2a53245bf88f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:41 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-eeb8aa39-1aae-4128-bd35-fddc08b8ffa3 tempest-VolumesExtendTest-311321505 None] Created volume successfully. Nov 01 12:26:41 devstack sudo[96491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd Nov 01 12:26:41 devstack sudo[96491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:41 devstack sudo[96489]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a4884b85-bec3-4395-8184-11ba191f3422 tempest-AttachVolumeNegativeTest-245012374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24a6a708-b2b5-423d-9db6-52133f9f1eb4" returned: 0 in 0.356s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:41 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a4884b85-bec3-4395-8184-11ba191f3422 tempest-AttachVolumeNegativeTest-245012374 None] Lock "cinder-quobyte-24a6a708-b2b5-423d-9db6-52133f9f1eb4" released by "delete_volume" :: held 0.911s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:41 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-a4884b85-bec3-4395-8184-11ba191f3422 tempest-AttachVolumeNegativeTest-245012374 None] Created reservations ['2034bee4-afdb-4599-b6d9-ecf0ea9559a9', '6d699b71-803a-474f-8ce0-ecc8ed33c33f', '28a3a882-7224-455a-b90e-93c4e24f851a', 'c3d5e841-4d3b-4cf0-9bb0-bf60666840e0'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:26:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a4884b85-bec3-4395-8184-11ba191f3422 tempest-AttachVolumeNegativeTest-245012374 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a4884b85-bec3-4395-8184-11ba191f3422 tempest-AttachVolumeNegativeTest-245012374 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:41 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a4884b85-bec3-4395-8184-11ba191f3422 tempest-AttachVolumeNegativeTest-245012374 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:41 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a4884b85-bec3-4395-8184-11ba191f3422 tempest-AttachVolumeNegativeTest-245012374 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a4884b85-bec3-4395-8184-11ba191f3422 tempest-AttachVolumeNegativeTest-245012374 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a4884b85-bec3-4395-8184-11ba191f3422 tempest-AttachVolumeNegativeTest-245012374 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:41 devstack sudo[96497]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:26:41 devstack sudo[96497]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:41 devstack sudo[96491]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0fd257a0-a71a-428f-921b-3470376e7d8d tempest-SnapshotsActionsTest-1207636017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd" returned: 0 in 0.500s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0fd257a0-a71a-428f-921b-3470376e7d8d tempest-SnapshotsActionsTest-1207636017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:41 devstack sudo[96501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9 1G Nov 01 12:26:41 devstack sudo[96501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:42 devstack sudo[96497]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a4884b85-bec3-4395-8184-11ba191f3422 tempest-AttachVolumeNegativeTest-245012374 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.326s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:42 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-a4884b85-bec3-4395-8184-11ba191f3422 tempest-AttachVolumeNegativeTest-245012374 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:26:42 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-a4884b85-bec3-4395-8184-11ba191f3422 tempest-AttachVolumeNegativeTest-245012374 None] Deleted volume successfully. Nov 01 12:26:42 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a4884b85-bec3-4395-8184-11ba191f3422 tempest-AttachVolumeNegativeTest-245012374 None] Lock "cinder-24a6a708-b2b5-423d-9db6-52133f9f1eb4-delete_volume" released by "delete_volume" :: held 1.520s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-147a5d06-b9cf-4a21-b488-d189922da9a5 tempest-VolumesExtendTest-311321505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:42 devstack sudo[96501]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0fd257a0-a71a-428f-921b-3470376e7d8d tempest-SnapshotsActionsTest-1207636017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9 1G" returned: 0 in 0.630s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0fd257a0-a71a-428f-921b-3470376e7d8d tempest-SnapshotsActionsTest-1207636017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96a340ff-bc46-488b-a48d-d4848e67facd -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:42 devstack sudo[96533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96a340ff-bc46-488b-a48d-d4848e67facd -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9 Nov 01 12:26:42 devstack sudo[96533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:42 devstack sudo[96533]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0fd257a0-a71a-428f-921b-3470376e7d8d tempest-SnapshotsActionsTest-1207636017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96a340ff-bc46-488b-a48d-d4848e67facd -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9" returned: 0 in 0.383s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:42 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-0fd257a0-a71a-428f-921b-3470376e7d8d tempest-SnapshotsActionsTest-1207636017 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9 is being set with open permissions: ugo+rw Nov 01 12:26:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0fd257a0-a71a-428f-921b-3470376e7d8d tempest-SnapshotsActionsTest-1207636017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:42 devstack sudo[96546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9 Nov 01 12:26:42 devstack sudo[96546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:43 devstack sudo[96546]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0fd257a0-a71a-428f-921b-3470376e7d8d tempest-SnapshotsActionsTest-1207636017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9" returned: 0 in 0.271s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0fd257a0-a71a-428f-921b-3470376e7d8d tempest-SnapshotsActionsTest-1207636017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:43 devstack sudo[96549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.info Nov 01 12:26:43 devstack sudo[96549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:43 devstack sudo[96549]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0fd257a0-a71a-428f-921b-3470376e7d8d tempest-SnapshotsActionsTest-1207636017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.info" returned: 0 in 0.280s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:43 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-0fd257a0-a71a-428f-921b-3470376e7d8d tempest-SnapshotsActionsTest-1207636017 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.info is being set with open permissions: ugo+rw Nov 01 12:26:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0fd257a0-a71a-428f-921b-3470376e7d8d tempest-SnapshotsActionsTest-1207636017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:43 devstack sudo[96553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.info Nov 01 12:26:43 devstack sudo[96553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:43 devstack sudo[96553]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0fd257a0-a71a-428f-921b-3470376e7d8d tempest-SnapshotsActionsTest-1207636017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.info" returned: 0 in 0.277s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0fd257a0-a71a-428f-921b-3470376e7d8d tempest-SnapshotsActionsTest-1207636017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.458s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-147a5d06-b9cf-4a21-b488-d189922da9a5 tempest-VolumesExtendTest-311321505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.521s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:43 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[84dcf113-c4b4-45ed-81b7-c16f67b21e97]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-147a5d06-b9cf-4a21-b488-d189922da9a5 tempest-VolumesExtendTest-311321505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-adaa610d-96b5-449a-876f-32c06c090214 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:43 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-0fd257a0-a71a-428f-921b-3470376e7d8d tempest-SnapshotsActionsTest-1207636017 None] Create snapshot completed successfully Nov 01 12:26:43 devstack sudo[96556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-adaa610d-96b5-449a-876f-32c06c090214 Nov 01 12:26:43 devstack sudo[96556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:44 devstack sudo[96556]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-147a5d06-b9cf-4a21-b488-d189922da9a5 tempest-VolumesExtendTest-311321505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-adaa610d-96b5-449a-876f-32c06c090214" returned: 0 in 0.376s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-147a5d06-b9cf-4a21-b488-d189922da9a5 tempest-VolumesExtendTest-311321505 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-adaa610d-96b5-449a-876f-32c06c090214 2G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-147a5d06-b9cf-4a21-b488-d189922da9a5 tempest-VolumesExtendTest-311321505 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-adaa610d-96b5-449a-876f-32c06c090214 2G" returned: 0 in 0.102s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-147a5d06-b9cf-4a21-b488-d189922da9a5 tempest-VolumesExtendTest-311321505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.509s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:44 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-147a5d06-b9cf-4a21-b488-d189922da9a5 tempest-VolumesExtendTest-311321505 None] Extend volume completed successfully. Nov 01 12:26:44 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0982e18f-6144-470e-8afc-6afb72b4e985 tempest-VolumesExtendTest-311321505 None] Acquiring lock "cinder-adaa610d-96b5-449a-876f-32c06c090214-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:44 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0982e18f-6144-470e-8afc-6afb72b4e985 tempest-VolumesExtendTest-311321505 None] Lock "cinder-adaa610d-96b5-449a-876f-32c06c090214-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:44 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0982e18f-6144-470e-8afc-6afb72b4e985 tempest-VolumesExtendTest-311321505 None] Acquiring lock "cinder-quobyte-adaa610d-96b5-449a-876f-32c06c090214" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:44 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0982e18f-6144-470e-8afc-6afb72b4e985 tempest-VolumesExtendTest-311321505 None] Lock "cinder-quobyte-adaa610d-96b5-449a-876f-32c06c090214" acquired by "delete_volume" :: waited 0.017s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:44 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[92c1edb4-022c-49e7-ba96-422edef01d8a]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0982e18f-6144-470e-8afc-6afb72b4e985 tempest-VolumesExtendTest-311321505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-adaa610d-96b5-449a-876f-32c06c090214 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:45 devstack sudo[96564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-adaa610d-96b5-449a-876f-32c06c090214 Nov 01 12:26:45 devstack sudo[96564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-73f7a795-8229-41f4-b490-7b8684920d11 tempest-SnapshotsActionsTest-1207636017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-73f7a795-8229-41f4-b490-7b8684920d11 tempest-SnapshotsActionsTest-1207636017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:45 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-73f7a795-8229-41f4-b490-7b8684920d11 tempest-SnapshotsActionsTest-1207636017 None] Creating offline snapshot 1fe2d440-b26a-431d-a25a-fe9cdc1f1632 of volume 96a340ff-bc46-488b-a48d-d4848e67facd {{(pid=86574) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:26:45 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6fb8b13-7d3d-4753-9604-130eb1d26724]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-73f7a795-8229-41f4-b490-7b8684920d11 tempest-SnapshotsActionsTest-1207636017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:45 devstack sudo[96566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9 Nov 01 12:26:45 devstack sudo[96566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:45 devstack sudo[96564]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0982e18f-6144-470e-8afc-6afb72b4e985 tempest-VolumesExtendTest-311321505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-adaa610d-96b5-449a-876f-32c06c090214" returned: 0 in 0.392s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0982e18f-6144-470e-8afc-6afb72b4e985 tempest-VolumesExtendTest-311321505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-adaa610d-96b5-449a-876f-32c06c090214 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:45 devstack sudo[96571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-adaa610d-96b5-449a-876f-32c06c090214 Nov 01 12:26:45 devstack sudo[96571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:45 devstack sudo[96566]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-73f7a795-8229-41f4-b490-7b8684920d11 tempest-SnapshotsActionsTest-1207636017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9" returned: 0 in 0.524s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:45 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-73f7a795-8229-41f4-b490-7b8684920d11 tempest-SnapshotsActionsTest-1207636017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96a340ff-bc46-488b-a48d-d4848e67facd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:26:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-73f7a795-8229-41f4-b490-7b8684920d11 tempest-SnapshotsActionsTest-1207636017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.1fe2d440-b26a-431d-a25a-fe9cdc1f1632 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:45 devstack sudo[96571]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0982e18f-6144-470e-8afc-6afb72b4e985 tempest-VolumesExtendTest-311321505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-adaa610d-96b5-449a-876f-32c06c090214" returned: 0 in 0.352s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:45 devstack sudo[96577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.1fe2d440-b26a-431d-a25a-fe9cdc1f1632 1G Nov 01 12:26:45 devstack sudo[96577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:45 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0982e18f-6144-470e-8afc-6afb72b4e985 tempest-VolumesExtendTest-311321505 None] Lock "cinder-quobyte-adaa610d-96b5-449a-876f-32c06c090214" released by "delete_volume" :: held 0.799s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:45 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-0982e18f-6144-470e-8afc-6afb72b4e985 tempest-VolumesExtendTest-311321505 None] Created reservations ['9086f1f1-8e24-42cf-a4c0-2dbf3c4c6baf', '96b26afb-82e1-4f6a-a8c1-06caa1588a10', '1e5f5251-3359-4661-b9ee-4a8aac4e9502', 'fcbc3bbe-c7dc-421e-9258-5f2fa295df47'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:26:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0982e18f-6144-470e-8afc-6afb72b4e985 tempest-VolumesExtendTest-311321505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0982e18f-6144-470e-8afc-6afb72b4e985 tempest-VolumesExtendTest-311321505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:45 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-0982e18f-6144-470e-8afc-6afb72b4e985 tempest-VolumesExtendTest-311321505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:45 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-0982e18f-6144-470e-8afc-6afb72b4e985 tempest-VolumesExtendTest-311321505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0982e18f-6144-470e-8afc-6afb72b4e985 tempest-VolumesExtendTest-311321505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0982e18f-6144-470e-8afc-6afb72b4e985 tempest-VolumesExtendTest-311321505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:45 devstack sudo[96580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:26:45 devstack sudo[96580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:46 devstack sudo[96580]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0982e18f-6144-470e-8afc-6afb72b4e985 tempest-VolumesExtendTest-311321505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.298s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:46 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-0982e18f-6144-470e-8afc-6afb72b4e985 tempest-VolumesExtendTest-311321505 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:26:46 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-0982e18f-6144-470e-8afc-6afb72b4e985 tempest-VolumesExtendTest-311321505 None] Deleted volume successfully. Nov 01 12:26:46 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0982e18f-6144-470e-8afc-6afb72b4e985 tempest-VolumesExtendTest-311321505 None] Lock "cinder-adaa610d-96b5-449a-876f-32c06c090214-delete_volume" released by "delete_volume" :: held 1.402s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:46 devstack sudo[96577]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-73f7a795-8229-41f4-b490-7b8684920d11 tempest-SnapshotsActionsTest-1207636017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.1fe2d440-b26a-431d-a25a-fe9cdc1f1632 1G" returned: 0 in 0.605s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-73f7a795-8229-41f4-b490-7b8684920d11 tempest-SnapshotsActionsTest-1207636017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.1fe2d440-b26a-431d-a25a-fe9cdc1f1632 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:46 devstack sudo[96586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.1fe2d440-b26a-431d-a25a-fe9cdc1f1632 Nov 01 12:26:46 devstack sudo[96586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:46 devstack sudo[96586]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-73f7a795-8229-41f4-b490-7b8684920d11 tempest-SnapshotsActionsTest-1207636017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.1fe2d440-b26a-431d-a25a-fe9cdc1f1632" returned: 0 in 0.390s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:46 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-73f7a795-8229-41f4-b490-7b8684920d11 tempest-SnapshotsActionsTest-1207636017 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.1fe2d440-b26a-431d-a25a-fe9cdc1f1632 is being set with open permissions: ugo+rw Nov 01 12:26:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-73f7a795-8229-41f4-b490-7b8684920d11 tempest-SnapshotsActionsTest-1207636017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.1fe2d440-b26a-431d-a25a-fe9cdc1f1632 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:46 devstack sudo[96593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.1fe2d440-b26a-431d-a25a-fe9cdc1f1632 Nov 01 12:26:46 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-f0f6a63f-bbd6-4de8-8786-2fe9296f7d4a tempest-VolumesExtendTest-311321505 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:26:46 devstack sudo[96593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f0f6a63f-bbd6-4de8-8786-2fe9296f7d4a tempest-VolumesExtendTest-311321505 None] Flow 'volume_create_manager' (1b6660d5-5cd4-4dde-9892-be7bf9f78af8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f0f6a63f-bbd6-4de8-8786-2fe9296f7d4a tempest-VolumesExtendTest-311321505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d0a791e-af04-4fa2-b2c2-79c7722c97d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f0f6a63f-bbd6-4de8-8786-2fe9296f7d4a tempest-VolumesExtendTest-311321505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d0a791e-af04-4fa2-b2c2-79c7722c97d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1780771265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbf4e50c-a917-4abe-8b60-75e0327d51d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b94d621d740842939d4dc6d486ab7ee0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:47Z,use_quota=True,user_id='9a1b254e042b4afcbfa1402a74eddaa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f0f6a63f-bbd6-4de8-8786-2fe9296f7d4a tempest-VolumesExtendTest-311321505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf122eed-a59e-4d10-816f-372c31c48f32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f0f6a63f-bbd6-4de8-8786-2fe9296f7d4a tempest-VolumesExtendTest-311321505 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bf122eed-a59e-4d10-816f-372c31c48f32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f0f6a63f-bbd6-4de8-8786-2fe9296f7d4a tempest-VolumesExtendTest-311321505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (733c554c-4cb5-49b1-ba23-4d0f79695e48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f0f6a63f-bbd6-4de8-8786-2fe9296f7d4a tempest-VolumesExtendTest-311321505 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (733c554c-4cb5-49b1-ba23-4d0f79695e48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dbf4e50c-a917-4abe-8b60-75e0327d51d8', 'volume_name': 'volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f0f6a63f-bbd6-4de8-8786-2fe9296f7d4a tempest-VolumesExtendTest-311321505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9d5d616-b05d-4437-8aa9-2fc5b26dda54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f0f6a63f-bbd6-4de8-8786-2fe9296f7d4a tempest-VolumesExtendTest-311321505 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9d5d616-b05d-4437-8aa9-2fc5b26dda54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f0f6a63f-bbd6-4de8-8786-2fe9296f7d4a tempest-VolumesExtendTest-311321505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57655301-caa9-43bb-8796-937cd191244f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:46 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-f0f6a63f-bbd6-4de8-8786-2fe9296f7d4a tempest-VolumesExtendTest-311321505 None] Volume dbf4e50c-a917-4abe-8b60-75e0327d51d8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8', 'volume_size': 1} Nov 01 12:26:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f0f6a63f-bbd6-4de8-8786-2fe9296f7d4a tempest-VolumesExtendTest-311321505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:46 devstack sudo[96593]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-73f7a795-8229-41f4-b490-7b8684920d11 tempest-SnapshotsActionsTest-1207636017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.1fe2d440-b26a-431d-a25a-fe9cdc1f1632" returned: 0 in 0.306s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-73f7a795-8229-41f4-b490-7b8684920d11 tempest-SnapshotsActionsTest-1207636017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.924s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f0f6a63f-bbd6-4de8-8786-2fe9296f7d4a tempest-VolumesExtendTest-311321505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.205s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:47 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f0f6a63f-bbd6-4de8-8786-2fe9296f7d4a tempest-VolumesExtendTest-311321505 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1780771265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dbf4e50c-a917-4abe-8b60-75e0327d51d8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b94d621d740842939d4dc6d486ab7ee0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:47Z,use_quota=True,user_id='9a1b254e042b4afcbfa1402a74eddaa7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:26:47 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-f0f6a63f-bbd6-4de8-8786-2fe9296f7d4a tempest-VolumesExtendTest-311321505 None] Creating volume dbf4e50c-a917-4abe-8b60-75e0327d51d8 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:26:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f0f6a63f-bbd6-4de8-8786-2fe9296f7d4a tempest-VolumesExtendTest-311321505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f0f6a63f-bbd6-4de8-8786-2fe9296f7d4a tempest-VolumesExtendTest-311321505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:47 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f0f6a63f-bbd6-4de8-8786-2fe9296f7d4a tempest-VolumesExtendTest-311321505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:47 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f0f6a63f-bbd6-4de8-8786-2fe9296f7d4a tempest-VolumesExtendTest-311321505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f0f6a63f-bbd6-4de8-8786-2fe9296f7d4a tempest-VolumesExtendTest-311321505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:47 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f0f6a63f-bbd6-4de8-8786-2fe9296f7d4a tempest-VolumesExtendTest-311321505 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:26:47 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-f0f6a63f-bbd6-4de8-8786-2fe9296f7d4a tempest-VolumesExtendTest-311321505 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:26:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f0f6a63f-bbd6-4de8-8786-2fe9296f7d4a tempest-VolumesExtendTest-311321505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:47 devstack sudo[96596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8 1073741824 Nov 01 12:26:47 devstack sudo[96596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:47 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-73f7a795-8229-41f4-b490-7b8684920d11 tempest-SnapshotsActionsTest-1207636017 None] Create snapshot completed successfully Nov 01 12:26:47 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-24d46d8b-64b0-4c55-944c-0f8cc926d680 tempest-SnapshotsActionsTest-1745873484 None] Acquiring lock "cinder-1fe2d440-b26a-431d-a25a-fe9cdc1f1632-delete_snapshot" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:47 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-24d46d8b-64b0-4c55-944c-0f8cc926d680 tempest-SnapshotsActionsTest-1745873484 None] Lock "cinder-1fe2d440-b26a-431d-a25a-fe9cdc1f1632-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:47 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-24d46d8b-64b0-4c55-944c-0f8cc926d680 tempest-SnapshotsActionsTest-1745873484 None] Acquiring lock "cinder-quobyte-96a340ff-bc46-488b-a48d-d4848e67facd" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:47 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-24d46d8b-64b0-4c55-944c-0f8cc926d680 tempest-SnapshotsActionsTest-1745873484 None] Lock "cinder-quobyte-96a340ff-bc46-488b-a48d-d4848e67facd" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:47 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-24d46d8b-64b0-4c55-944c-0f8cc926d680 tempest-SnapshotsActionsTest-1745873484 None] Acquiring lock "cinder-quobyte-1fe2d440-b26a-431d-a25a-fe9cdc1f1632" by "_delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:47 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-24d46d8b-64b0-4c55-944c-0f8cc926d680 tempest-SnapshotsActionsTest-1745873484 None] Lock "cinder-quobyte-1fe2d440-b26a-431d-a25a-fe9cdc1f1632" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:47 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-24d46d8b-64b0-4c55-944c-0f8cc926d680 tempest-SnapshotsActionsTest-1745873484 None] Deleting offline snapshot 1fe2d440-b26a-431d-a25a-fe9cdc1f1632 of volume 96a340ff-bc46-488b-a48d-d4848e67facd {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:26:47 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-24d46d8b-64b0-4c55-944c-0f8cc926d680 tempest-SnapshotsActionsTest-1745873484 None] snapshot_file for this snap is: volume-96a340ff-bc46-488b-a48d-d4848e67facd.1fe2d440-b26a-431d-a25a-fe9cdc1f1632 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:26:47 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[49387834-0bda-4bc2-8d43-73e6e4358402]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-24d46d8b-64b0-4c55-944c-0f8cc926d680 tempest-SnapshotsActionsTest-1745873484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.1fe2d440-b26a-431d-a25a-fe9cdc1f1632 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:47 devstack sudo[96596]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f0f6a63f-bbd6-4de8-8786-2fe9296f7d4a tempest-VolumesExtendTest-311321505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8 1073741824" returned: 0 in 0.513s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:47 devstack sudo[96605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.1fe2d440-b26a-431d-a25a-fe9cdc1f1632 Nov 01 12:26:47 devstack sudo[96605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f0f6a63f-bbd6-4de8-8786-2fe9296f7d4a tempest-VolumesExtendTest-311321505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:47 devstack sudo[96607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8 Nov 01 12:26:47 devstack sudo[96607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:47 devstack sudo[96605]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-24d46d8b-64b0-4c55-944c-0f8cc926d680 tempest-SnapshotsActionsTest-1745873484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.1fe2d440-b26a-431d-a25a-fe9cdc1f1632" returned: 0 in 0.430s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:47 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-24d46d8b-64b0-4c55-944c-0f8cc926d680 tempest-SnapshotsActionsTest-1745873484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96a340ff-bc46-488b-a48d-d4848e67facd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:26:47 devstack sudo[96607]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f0f6a63f-bbd6-4de8-8786-2fe9296f7d4a tempest-VolumesExtendTest-311321505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8" returned: 0 in 0.303s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:47 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f0f6a63f-bbd6-4de8-8786-2fe9296f7d4a tempest-VolumesExtendTest-311321505 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:26:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f0f6a63f-bbd6-4de8-8786-2fe9296f7d4a tempest-VolumesExtendTest-311321505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f0f6a63f-bbd6-4de8-8786-2fe9296f7d4a tempest-VolumesExtendTest-311321505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (57655301-caa9-43bb-8796-937cd191244f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f0f6a63f-bbd6-4de8-8786-2fe9296f7d4a tempest-VolumesExtendTest-311321505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (509bb9ad-4421-48a0-89c7-8ab3a46980b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:47 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[e30bdc4f-3501-4fa1-96d1-2263a34856ae]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-24d46d8b-64b0-4c55-944c-0f8cc926d680 tempest-SnapshotsActionsTest-1745873484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:47 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-f0f6a63f-bbd6-4de8-8786-2fe9296f7d4a tempest-VolumesExtendTest-311321505 None] Volume volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8 (dbf4e50c-a917-4abe-8b60-75e0327d51d8): created successfully Nov 01 12:26:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f0f6a63f-bbd6-4de8-8786-2fe9296f7d4a tempest-VolumesExtendTest-311321505 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (509bb9ad-4421-48a0-89c7-8ab3a46980b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f0f6a63f-bbd6-4de8-8786-2fe9296f7d4a tempest-VolumesExtendTest-311321505 None] Flow 'volume_create_manager' (1b6660d5-5cd4-4dde-9892-be7bf9f78af8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:47 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-f0f6a63f-bbd6-4de8-8786-2fe9296f7d4a tempest-VolumesExtendTest-311321505 None] Created volume successfully. Nov 01 12:26:48 devstack sudo[96614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9 Nov 01 12:26:48 devstack sudo[96614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:48 devstack sudo[96614]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-24d46d8b-64b0-4c55-944c-0f8cc926d680 tempest-SnapshotsActionsTest-1745873484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9" returned: 0 in 0.372s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:48 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-24d46d8b-64b0-4c55-944c-0f8cc926d680 tempest-SnapshotsActionsTest-1745873484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96a340ff-bc46-488b-a48d-d4848e67facd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:26:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-24d46d8b-64b0-4c55-944c-0f8cc926d680 tempest-SnapshotsActionsTest-1745873484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.1fe2d440-b26a-431d-a25a-fe9cdc1f1632 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:48 devstack sudo[96619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.1fe2d440-b26a-431d-a25a-fe9cdc1f1632 Nov 01 12:26:48 devstack sudo[96619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:48 devstack sudo[96619]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-24d46d8b-64b0-4c55-944c-0f8cc926d680 tempest-SnapshotsActionsTest-1745873484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.1fe2d440-b26a-431d-a25a-fe9cdc1f1632" returned: 0 in 0.445s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-24d46d8b-64b0-4c55-944c-0f8cc926d680 tempest-SnapshotsActionsTest-1745873484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.1fe2d440-b26a-431d-a25a-fe9cdc1f1632 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:48 devstack sudo[96624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.1fe2d440-b26a-431d-a25a-fe9cdc1f1632 Nov 01 12:26:48 devstack sudo[96624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-fae11410-9a9c-40a0-80f4-cf31e7555007 tempest-VolumesExtendTest-311321505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-fae11410-9a9c-40a0-80f4-cf31e7555007 tempest-VolumesExtendTest-311321505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:49 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-fae11410-9a9c-40a0-80f4-cf31e7555007 tempest-VolumesExtendTest-311321505 None] Creating offline snapshot c465eeac-ebdc-4abf-8769-dfedcd3c122e of volume dbf4e50c-a917-4abe-8b60-75e0327d51d8 {{(pid=86574) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:26:49 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[58c0fe1d-0435-4980-9f24-979e753cba9d]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-fae11410-9a9c-40a0-80f4-cf31e7555007 tempest-VolumesExtendTest-311321505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:49 devstack sudo[96624]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-24d46d8b-64b0-4c55-944c-0f8cc926d680 tempest-SnapshotsActionsTest-1745873484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.1fe2d440-b26a-431d-a25a-fe9cdc1f1632" returned: 0 in 0.312s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:49 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-24d46d8b-64b0-4c55-944c-0f8cc926d680 tempest-SnapshotsActionsTest-1745873484 None] Lock "cinder-quobyte-1fe2d440-b26a-431d-a25a-fe9cdc1f1632" released by "_delete_snapshot" :: held 1.717s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:49 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-24d46d8b-64b0-4c55-944c-0f8cc926d680 tempest-SnapshotsActionsTest-1745873484 None] Lock "cinder-quobyte-96a340ff-bc46-488b-a48d-d4848e67facd" released by "delete_snapshot" :: held 1.745s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:49 devstack sudo[96627]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8 Nov 01 12:26:49 devstack sudo[96627]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:49 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-24d46d8b-64b0-4c55-944c-0f8cc926d680 tempest-SnapshotsActionsTest-1745873484 None] Created reservations ['92433d66-9964-42ce-92e3-b1390e94ba29', 'f252d3d4-d334-4ac0-a53b-0e6d7fb29d69', 'f63d76f2-8e55-4bc6-9d35-1348e5f7f5e6', 'fe608707-a7db-42ba-9386-2b1fbfc04311'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:26:49 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-24d46d8b-64b0-4c55-944c-0f8cc926d680 tempest-SnapshotsActionsTest-1745873484 None] Delete snapshot completed successfully. Nov 01 12:26:49 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-24d46d8b-64b0-4c55-944c-0f8cc926d680 tempest-SnapshotsActionsTest-1745873484 None] Lock "cinder-1fe2d440-b26a-431d-a25a-fe9cdc1f1632-delete_snapshot" released by "delete_snapshot" :: held 1.930s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:49 devstack sudo[96627]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-fae11410-9a9c-40a0-80f4-cf31e7555007 tempest-VolumesExtendTest-311321505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8" returned: 0 in 0.538s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-fae11410-9a9c-40a0-80f4-cf31e7555007 tempest-VolumesExtendTest-311321505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8.c465eeac-ebdc-4abf-8769-dfedcd3c122e 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:49 devstack sudo[96633]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8.c465eeac-ebdc-4abf-8769-dfedcd3c122e 1G Nov 01 12:26:49 devstack sudo[96633]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b456d29c-5e48-4837-a606-c3a9486ef901 tempest-SnapshotsActionsTest-1207636017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:50 devstack sudo[96633]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-fae11410-9a9c-40a0-80f4-cf31e7555007 tempest-VolumesExtendTest-311321505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8.c465eeac-ebdc-4abf-8769-dfedcd3c122e 1G" returned: 0 in 0.589s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-fae11410-9a9c-40a0-80f4-cf31e7555007 tempest-VolumesExtendTest-311321505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8.c465eeac-ebdc-4abf-8769-dfedcd3c122e {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:50 devstack sudo[96638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8.c465eeac-ebdc-4abf-8769-dfedcd3c122e Nov 01 12:26:50 devstack sudo[96638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:50 devstack sudo[96638]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-fae11410-9a9c-40a0-80f4-cf31e7555007 tempest-VolumesExtendTest-311321505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8.c465eeac-ebdc-4abf-8769-dfedcd3c122e" returned: 0 in 0.372s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:50 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-fae11410-9a9c-40a0-80f4-cf31e7555007 tempest-VolumesExtendTest-311321505 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8.c465eeac-ebdc-4abf-8769-dfedcd3c122e is being set with open permissions: ugo+rw Nov 01 12:26:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-fae11410-9a9c-40a0-80f4-cf31e7555007 tempest-VolumesExtendTest-311321505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8.c465eeac-ebdc-4abf-8769-dfedcd3c122e {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:50 devstack sudo[96643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8.c465eeac-ebdc-4abf-8769-dfedcd3c122e Nov 01 12:26:50 devstack sudo[96643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:50 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [req-f9f387e5-f13f-4578-b59f-5c334d3030dc req-2465bf20-1795-4cb4-8554-444796252295 tempest-VolumesGetTestJSON-578633350 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:26:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-f9f387e5-f13f-4578-b59f-5c334d3030dc req-2465bf20-1795-4cb4-8554-444796252295 tempest-VolumesGetTestJSON-578633350 None] Flow 'volume_create_manager' (c38cf4c9-1660-47e4-ae16-70c1cde59af6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-f9f387e5-f13f-4578-b59f-5c334d3030dc req-2465bf20-1795-4cb4-8554-444796252295 tempest-VolumesGetTestJSON-578633350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d99bccc-4896-48ad-8a1e-620b8e6d2bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-f9f387e5-f13f-4578-b59f-5c334d3030dc req-2465bf20-1795-4cb4-8554-444796252295 tempest-VolumesGetTestJSON-578633350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d99bccc-4896-48ad-8a1e-620b8e6d2bc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-650534927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2427372-ed73-472d-8aeb-c2154566c157,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='955fb63fed52408680ea174d9525e3f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:51Z,use_quota=True,user_id='a5b1f467025a40888930c270345fe9e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-f9f387e5-f13f-4578-b59f-5c334d3030dc req-2465bf20-1795-4cb4-8554-444796252295 tempest-VolumesGetTestJSON-578633350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7879e23-6923-442d-82c0-3af8b3ab6d2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-f9f387e5-f13f-4578-b59f-5c334d3030dc req-2465bf20-1795-4cb4-8554-444796252295 tempest-VolumesGetTestJSON-578633350 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c7879e23-6923-442d-82c0-3af8b3ab6d2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-f9f387e5-f13f-4578-b59f-5c334d3030dc req-2465bf20-1795-4cb4-8554-444796252295 tempest-VolumesGetTestJSON-578633350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (847d6ece-0104-44af-825c-3b03daefe1ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-f9f387e5-f13f-4578-b59f-5c334d3030dc req-2465bf20-1795-4cb4-8554-444796252295 tempest-VolumesGetTestJSON-578633350 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (847d6ece-0104-44af-825c-3b03daefe1ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e2427372-ed73-472d-8aeb-c2154566c157', 'volume_name': 'volume-e2427372-ed73-472d-8aeb-c2154566c157', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-f9f387e5-f13f-4578-b59f-5c334d3030dc req-2465bf20-1795-4cb4-8554-444796252295 tempest-VolumesGetTestJSON-578633350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (826fa566-499c-4a87-9cda-cb64c12b063f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-f9f387e5-f13f-4578-b59f-5c334d3030dc req-2465bf20-1795-4cb4-8554-444796252295 tempest-VolumesGetTestJSON-578633350 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (826fa566-499c-4a87-9cda-cb64c12b063f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-f9f387e5-f13f-4578-b59f-5c334d3030dc req-2465bf20-1795-4cb4-8554-444796252295 tempest-VolumesGetTestJSON-578633350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12b5445a-b90a-4f0c-92c2-14e24e2560f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:50 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [req-f9f387e5-f13f-4578-b59f-5c334d3030dc req-2465bf20-1795-4cb4-8554-444796252295 tempest-VolumesGetTestJSON-578633350 None] Volume e2427372-ed73-472d-8aeb-c2154566c157: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e2427372-ed73-472d-8aeb-c2154566c157', 'volume_size': 1} Nov 01 12:26:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-f9f387e5-f13f-4578-b59f-5c334d3030dc req-2465bf20-1795-4cb4-8554-444796252295 tempest-VolumesGetTestJSON-578633350 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:50 devstack sudo[96643]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-fae11410-9a9c-40a0-80f4-cf31e7555007 tempest-VolumesExtendTest-311321505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8.c465eeac-ebdc-4abf-8769-dfedcd3c122e" returned: 0 in 0.286s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-fae11410-9a9c-40a0-80f4-cf31e7555007 tempest-VolumesExtendTest-311321505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:50 devstack sudo[96646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8.info Nov 01 12:26:50 devstack sudo[96646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:51 devstack sudo[96646]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-fae11410-9a9c-40a0-80f4-cf31e7555007 tempest-VolumesExtendTest-311321505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8.info" returned: 0 in 0.266s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:51 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-fae11410-9a9c-40a0-80f4-cf31e7555007 tempest-VolumesExtendTest-311321505 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8.info is being set with open permissions: ugo+rw Nov 01 12:26:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-fae11410-9a9c-40a0-80f4-cf31e7555007 tempest-VolumesExtendTest-311321505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:51 devstack sudo[96658]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8.info Nov 01 12:26:51 devstack sudo[96658]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:51 devstack sudo[96658]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-fae11410-9a9c-40a0-80f4-cf31e7555007 tempest-VolumesExtendTest-311321505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8.info" returned: 0 in 0.275s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-fae11410-9a9c-40a0-80f4-cf31e7555007 tempest-VolumesExtendTest-311321505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.444s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b456d29c-5e48-4837-a606-c3a9486ef901 tempest-SnapshotsActionsTest-1207636017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.465s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:51 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-b456d29c-5e48-4837-a606-c3a9486ef901 tempest-SnapshotsActionsTest-1207636017 None] Creating offline snapshot 828c4e06-ed38-4558-870f-48e8266ac0ba of volume 96a340ff-bc46-488b-a48d-d4848e67facd {{(pid=86574) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:26:51 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-fae11410-9a9c-40a0-80f4-cf31e7555007 tempest-VolumesExtendTest-311321505 None] Create snapshot completed successfully Nov 01 12:26:51 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[b30ebb4c-8972-4bf6-80c7-09ef86777499]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b456d29c-5e48-4837-a606-c3a9486ef901 tempest-SnapshotsActionsTest-1207636017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:51 devstack sudo[96663]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9 Nov 01 12:26:51 devstack sudo[96663]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:51 devstack sudo[96663]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b456d29c-5e48-4837-a606-c3a9486ef901 tempest-SnapshotsActionsTest-1207636017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9" returned: 0 in 0.388s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:51 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-b456d29c-5e48-4837-a606-c3a9486ef901 tempest-SnapshotsActionsTest-1207636017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96a340ff-bc46-488b-a48d-d4848e67facd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:26:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b456d29c-5e48-4837-a606-c3a9486ef901 tempest-SnapshotsActionsTest-1207636017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.828c4e06-ed38-4558-870f-48e8266ac0ba 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:51 devstack sudo[96668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.828c4e06-ed38-4558-870f-48e8266ac0ba 1G Nov 01 12:26:51 devstack sudo[96668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b6a5e939-c6a8-4ab2-ab6c-8808dced9c9c tempest-VolumesExtendTest-311321505 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:52 devstack sudo[96668]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b456d29c-5e48-4837-a606-c3a9486ef901 tempest-SnapshotsActionsTest-1207636017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.828c4e06-ed38-4558-870f-48e8266ac0ba 1G" returned: 0 in 0.581s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b456d29c-5e48-4837-a606-c3a9486ef901 tempest-SnapshotsActionsTest-1207636017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.828c4e06-ed38-4558-870f-48e8266ac0ba {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:52 devstack sudo[96678]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.828c4e06-ed38-4558-870f-48e8266ac0ba Nov 01 12:26:52 devstack sudo[96678]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:52 devstack sudo[96678]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b456d29c-5e48-4837-a606-c3a9486ef901 tempest-SnapshotsActionsTest-1207636017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.828c4e06-ed38-4558-870f-48e8266ac0ba" returned: 0 in 0.491s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:52 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-b456d29c-5e48-4837-a606-c3a9486ef901 tempest-SnapshotsActionsTest-1207636017 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.828c4e06-ed38-4558-870f-48e8266ac0ba is being set with open permissions: ugo+rw Nov 01 12:26:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b456d29c-5e48-4837-a606-c3a9486ef901 tempest-SnapshotsActionsTest-1207636017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.828c4e06-ed38-4558-870f-48e8266ac0ba {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:53 devstack sudo[96703]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.828c4e06-ed38-4558-870f-48e8266ac0ba Nov 01 12:26:53 devstack sudo[96703]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:53 devstack sudo[96703]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b456d29c-5e48-4837-a606-c3a9486ef901 tempest-SnapshotsActionsTest-1207636017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.828c4e06-ed38-4558-870f-48e8266ac0ba" returned: 0 in 0.314s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b456d29c-5e48-4837-a606-c3a9486ef901 tempest-SnapshotsActionsTest-1207636017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.887s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-f9f387e5-f13f-4578-b59f-5c334d3030dc req-2465bf20-1795-4cb4-8554-444796252295 tempest-VolumesGetTestJSON-578633350 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.553s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:53 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [req-f9f387e5-f13f-4578-b59f-5c334d3030dc req-2465bf20-1795-4cb4-8554-444796252295 tempest-VolumesGetTestJSON-578633350 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:26:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-650534927',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e2427372-ed73-472d-8aeb-c2154566c157,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='955fb63fed52408680ea174d9525e3f4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:26:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:26:51Z,use_quota=True,user_id='a5b1f467025a40888930c270345fe9e5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:26:53 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [req-f9f387e5-f13f-4578-b59f-5c334d3030dc req-2465bf20-1795-4cb4-8554-444796252295 tempest-VolumesGetTestJSON-578633350 None] Creating volume e2427372-ed73-472d-8aeb-c2154566c157 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:26:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-f9f387e5-f13f-4578-b59f-5c334d3030dc req-2465bf20-1795-4cb4-8554-444796252295 tempest-VolumesGetTestJSON-578633350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-f9f387e5-f13f-4578-b59f-5c334d3030dc req-2465bf20-1795-4cb4-8554-444796252295 tempest-VolumesGetTestJSON-578633350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:53 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [req-f9f387e5-f13f-4578-b59f-5c334d3030dc req-2465bf20-1795-4cb4-8554-444796252295 tempest-VolumesGetTestJSON-578633350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:53 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [req-f9f387e5-f13f-4578-b59f-5c334d3030dc req-2465bf20-1795-4cb4-8554-444796252295 tempest-VolumesGetTestJSON-578633350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-f9f387e5-f13f-4578-b59f-5c334d3030dc req-2465bf20-1795-4cb4-8554-444796252295 tempest-VolumesGetTestJSON-578633350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:53 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [req-f9f387e5-f13f-4578-b59f-5c334d3030dc req-2465bf20-1795-4cb4-8554-444796252295 tempest-VolumesGetTestJSON-578633350 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:26:53 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [req-f9f387e5-f13f-4578-b59f-5c334d3030dc req-2465bf20-1795-4cb4-8554-444796252295 tempest-VolumesGetTestJSON-578633350 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:26:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [req-f9f387e5-f13f-4578-b59f-5c334d3030dc req-2465bf20-1795-4cb4-8554-444796252295 tempest-VolumesGetTestJSON-578633350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e2427372-ed73-472d-8aeb-c2154566c157 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:53 devstack sudo[96707]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e2427372-ed73-472d-8aeb-c2154566c157 1073741824 Nov 01 12:26:53 devstack sudo[96707]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:53 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-b456d29c-5e48-4837-a606-c3a9486ef901 tempest-SnapshotsActionsTest-1207636017 None] Create snapshot completed successfully Nov 01 12:26:53 devstack sudo[96707]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [req-f9f387e5-f13f-4578-b59f-5c334d3030dc req-2465bf20-1795-4cb4-8554-444796252295 tempest-VolumesGetTestJSON-578633350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e2427372-ed73-472d-8aeb-c2154566c157 1073741824" returned: 0 in 0.606s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:53 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-1fcaa27f-4015-416a-8711-0fc86ab8c5f6 req-714a25de-6ac7-4cd2-b916-36e5836671fb tempest-ServerActionsTestOtherA-2064758512 None] Terminate volume connection completed successfully. Nov 01 12:26:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-1fcaa27f-4015-416a-8711-0fc86ab8c5f6 req-714a25de-6ac7-4cd2-b916-36e5836671fb tempest-ServerActionsTestOtherA-2064758512 None] Deleting attachment eeb9c03c-a2de-4cf7-8872-db2e245ee3a2. {{(pid=86574) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 12:26:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [req-f9f387e5-f13f-4578-b59f-5c334d3030dc req-2465bf20-1795-4cb4-8554-444796252295 tempest-VolumesGetTestJSON-578633350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e2427372-ed73-472d-8aeb-c2154566c157 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:54 devstack sudo[96715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e2427372-ed73-472d-8aeb-c2154566c157 Nov 01 12:26:54 devstack sudo[96715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:54 devstack cinder-volume[86574]: DEBUG cinder.coordination [req-1fcaa27f-4015-416a-8711-0fc86ab8c5f6 req-554b12db-310c-4e3a-bc3a-a524d42528c0 tempest-ServerActionsTestOtherA-2064758512 None] Acquiring lock "cinder-4dea6740-5a36-424b-8321-cc6bf8bed2da-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:54 devstack cinder-volume[86574]: DEBUG cinder.coordination [req-1fcaa27f-4015-416a-8711-0fc86ab8c5f6 req-554b12db-310c-4e3a-bc3a-a524d42528c0 tempest-ServerActionsTestOtherA-2064758512 None] Lock "cinder-4dea6740-5a36-424b-8321-cc6bf8bed2da-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:54 devstack sudo[96715]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:54 devstack cinder-volume[86574]: DEBUG cinder.coordination [req-1fcaa27f-4015-416a-8711-0fc86ab8c5f6 req-554b12db-310c-4e3a-bc3a-a524d42528c0 tempest-ServerActionsTestOtherA-2064758512 None] Acquiring lock "cinder-quobyte-4dea6740-5a36-424b-8321-cc6bf8bed2da" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [req-f9f387e5-f13f-4578-b59f-5c334d3030dc req-2465bf20-1795-4cb4-8554-444796252295 tempest-VolumesGetTestJSON-578633350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e2427372-ed73-472d-8aeb-c2154566c157" returned: 0 in 0.288s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:54 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [req-f9f387e5-f13f-4578-b59f-5c334d3030dc req-2465bf20-1795-4cb4-8554-444796252295 tempest-VolumesGetTestJSON-578633350 None] <== create_volume: return (948ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:26:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-f9f387e5-f13f-4578-b59f-5c334d3030dc req-2465bf20-1795-4cb4-8554-444796252295 tempest-VolumesGetTestJSON-578633350 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.952s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b6a5e939-c6a8-4ab2-ab6c-8808dced9c9c tempest-VolumesExtendTest-311321505 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 1.962s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:54 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-f9f387e5-f13f-4578-b59f-5c334d3030dc req-2465bf20-1795-4cb4-8554-444796252295 tempest-VolumesGetTestJSON-578633350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (12b5445a-b90a-4f0c-92c2-14e24e2560f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e2427372-ed73-472d-8aeb-c2154566c157', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:54 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-f9f387e5-f13f-4578-b59f-5c334d3030dc req-2465bf20-1795-4cb4-8554-444796252295 tempest-VolumesGetTestJSON-578633350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56462b5b-b541-4e21-821d-e84189e2f5a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:26:54 devstack cinder-volume[86574]: DEBUG cinder.coordination [req-1fcaa27f-4015-416a-8711-0fc86ab8c5f6 req-554b12db-310c-4e3a-bc3a-a524d42528c0 tempest-ServerActionsTestOtherA-2064758512 None] Lock "cinder-quobyte-4dea6740-5a36-424b-8321-cc6bf8bed2da" acquired by "delete_volume" :: waited 0.036s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:54 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[423498b0-8911-4de5-ab18-750733ca3496]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b6a5e939-c6a8-4ab2-ab6c-8808dced9c9c tempest-VolumesExtendTest-311321505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:54 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ddd9cd01-260f-4a6b-beef-8731fc736fa0 tempest-SnapshotsActionsTest-1745873484 None] Acquiring lock "cinder-828c4e06-ed38-4558-870f-48e8266ac0ba-delete_snapshot" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:54 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[25bb2d2e-2c1f-4b97-ad9a-1035c17daa88]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [req-1fcaa27f-4015-416a-8711-0fc86ab8c5f6 req-554b12db-310c-4e3a-bc3a-a524d42528c0 tempest-ServerActionsTestOtherA-2064758512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4dea6740-5a36-424b-8321-cc6bf8bed2da {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:54 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [req-f9f387e5-f13f-4578-b59f-5c334d3030dc req-2465bf20-1795-4cb4-8554-444796252295 tempest-VolumesGetTestJSON-578633350 None] Volume volume-e2427372-ed73-472d-8aeb-c2154566c157 (e2427372-ed73-472d-8aeb-c2154566c157): created successfully Nov 01 12:26:54 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-f9f387e5-f13f-4578-b59f-5c334d3030dc req-2465bf20-1795-4cb4-8554-444796252295 tempest-VolumesGetTestJSON-578633350 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (56462b5b-b541-4e21-821d-e84189e2f5a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:26:54 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-f9f387e5-f13f-4578-b59f-5c334d3030dc req-2465bf20-1795-4cb4-8554-444796252295 tempest-VolumesGetTestJSON-578633350 None] Flow 'volume_create_manager' (c38cf4c9-1660-47e4-ae16-70c1cde59af6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:26:54 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ddd9cd01-260f-4a6b-beef-8731fc736fa0 tempest-SnapshotsActionsTest-1745873484 None] Lock "cinder-828c4e06-ed38-4558-870f-48e8266ac0ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.070s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:54 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ddd9cd01-260f-4a6b-beef-8731fc736fa0 tempest-SnapshotsActionsTest-1745873484 None] Acquiring lock "cinder-quobyte-96a340ff-bc46-488b-a48d-d4848e67facd" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:54 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-f9f387e5-f13f-4578-b59f-5c334d3030dc req-2465bf20-1795-4cb4-8554-444796252295 tempest-VolumesGetTestJSON-578633350 None] Created volume successfully. Nov 01 12:26:54 devstack sudo[96718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8 Nov 01 12:26:54 devstack sudo[96718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:54 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ddd9cd01-260f-4a6b-beef-8731fc736fa0 tempest-SnapshotsActionsTest-1745873484 None] Lock "cinder-quobyte-96a340ff-bc46-488b-a48d-d4848e67facd" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:54 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ddd9cd01-260f-4a6b-beef-8731fc736fa0 tempest-SnapshotsActionsTest-1745873484 None] Acquiring lock "cinder-quobyte-828c4e06-ed38-4558-870f-48e8266ac0ba" by "_delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:54 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ddd9cd01-260f-4a6b-beef-8731fc736fa0 tempest-SnapshotsActionsTest-1745873484 None] Lock "cinder-quobyte-828c4e06-ed38-4558-870f-48e8266ac0ba" acquired by "_delete_snapshot" :: waited 0.032s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:54 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-ddd9cd01-260f-4a6b-beef-8731fc736fa0 tempest-SnapshotsActionsTest-1745873484 None] Deleting offline snapshot 828c4e06-ed38-4558-870f-48e8266ac0ba of volume 96a340ff-bc46-488b-a48d-d4848e67facd {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:26:54 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-ddd9cd01-260f-4a6b-beef-8731fc736fa0 tempest-SnapshotsActionsTest-1745873484 None] snapshot_file for this snap is: volume-96a340ff-bc46-488b-a48d-d4848e67facd.828c4e06-ed38-4558-870f-48e8266ac0ba {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:26:54 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[142c34fc-1c8c-49fc-9e3a-f999a8a78edd]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ddd9cd01-260f-4a6b-beef-8731fc736fa0 tempest-SnapshotsActionsTest-1745873484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.828c4e06-ed38-4558-870f-48e8266ac0ba {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:54 devstack sudo[96719]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4dea6740-5a36-424b-8321-cc6bf8bed2da Nov 01 12:26:54 devstack sudo[96719]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:54 devstack sudo[96722]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.828c4e06-ed38-4558-870f-48e8266ac0ba Nov 01 12:26:54 devstack sudo[96722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:54 devstack sudo[96718]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b6a5e939-c6a8-4ab2-ab6c-8808dced9c9c tempest-VolumesExtendTest-311321505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8" returned: 0 in 0.413s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b6a5e939-c6a8-4ab2-ab6c-8808dced9c9c tempest-VolumesExtendTest-311321505 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8.c465eeac-ebdc-4abf-8769-dfedcd3c122e 2G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:54 devstack sudo[96719]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [req-1fcaa27f-4015-416a-8711-0fc86ab8c5f6 req-554b12db-310c-4e3a-bc3a-a524d42528c0 tempest-ServerActionsTestOtherA-2064758512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4dea6740-5a36-424b-8321-cc6bf8bed2da" returned: 0 in 0.532s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [req-1fcaa27f-4015-416a-8711-0fc86ab8c5f6 req-554b12db-310c-4e3a-bc3a-a524d42528c0 tempest-ServerActionsTestOtherA-2064758512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4dea6740-5a36-424b-8321-cc6bf8bed2da {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:54 devstack sudo[96734]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4dea6740-5a36-424b-8321-cc6bf8bed2da Nov 01 12:26:54 devstack sudo[96734]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b6a5e939-c6a8-4ab2-ab6c-8808dced9c9c tempest-VolumesExtendTest-311321505 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8.c465eeac-ebdc-4abf-8769-dfedcd3c122e 2G" returned: 0 in 0.214s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b6a5e939-c6a8-4ab2-ab6c-8808dced9c9c tempest-VolumesExtendTest-311321505 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 0.695s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:55 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-39908bab-bd2d-42cd-950d-fffbde27bb1f tempest-ServerActionsTestOtherA-2064758512 None] Acquiring lock "cinder-c8d23fa1-7cea-46a1-b22f-31e8dd59cdd5-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:55 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-39908bab-bd2d-42cd-950d-fffbde27bb1f tempest-ServerActionsTestOtherA-2064758512 None] Lock "cinder-c8d23fa1-7cea-46a1-b22f-31e8dd59cdd5-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:55 devstack sudo[96722]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:55 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-b6a5e939-c6a8-4ab2-ab6c-8808dced9c9c tempest-VolumesExtendTest-311321505 None] Extend volume completed successfully. Nov 01 12:26:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ddd9cd01-260f-4a6b-beef-8731fc736fa0 tempest-SnapshotsActionsTest-1745873484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.828c4e06-ed38-4558-870f-48e8266ac0ba" returned: 0 in 0.554s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:55 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-ddd9cd01-260f-4a6b-beef-8731fc736fa0 tempest-SnapshotsActionsTest-1745873484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96a340ff-bc46-488b-a48d-d4848e67facd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:26:55 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-39908bab-bd2d-42cd-950d-fffbde27bb1f tempest-ServerActionsTestOtherA-2064758512 None] Acquiring lock "cinder-quobyte-c8d23fa1-7cea-46a1-b22f-31e8dd59cdd5" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:55 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[938cbc2c-e09d-4333-a069-92a723bc1ff6]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ddd9cd01-260f-4a6b-beef-8731fc736fa0 tempest-SnapshotsActionsTest-1745873484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:55 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-39908bab-bd2d-42cd-950d-fffbde27bb1f tempest-ServerActionsTestOtherA-2064758512 None] Lock "cinder-quobyte-c8d23fa1-7cea-46a1-b22f-31e8dd59cdd5" acquired by "delete_volume" :: waited 0.024s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:55 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[f31a5028-a8ba-49fd-a1a5-ed645dbb6937]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-39908bab-bd2d-42cd-950d-fffbde27bb1f tempest-ServerActionsTestOtherA-2064758512 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c8d23fa1-7cea-46a1-b22f-31e8dd59cdd5 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:55 devstack sudo[96739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9 Nov 01 12:26:55 devstack sudo[96734]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:55 devstack sudo[96739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [req-1fcaa27f-4015-416a-8711-0fc86ab8c5f6 req-554b12db-310c-4e3a-bc3a-a524d42528c0 tempest-ServerActionsTestOtherA-2064758512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4dea6740-5a36-424b-8321-cc6bf8bed2da" returned: 0 in 0.387s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:55 devstack cinder-volume[86574]: DEBUG cinder.coordination [req-1fcaa27f-4015-416a-8711-0fc86ab8c5f6 req-554b12db-310c-4e3a-bc3a-a524d42528c0 tempest-ServerActionsTestOtherA-2064758512 None] Lock "cinder-quobyte-4dea6740-5a36-424b-8321-cc6bf8bed2da" released by "delete_volume" :: held 0.999s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:55 devstack sudo[96740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c8d23fa1-7cea-46a1-b22f-31e8dd59cdd5 Nov 01 12:26:55 devstack sudo[96740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:55 devstack cinder-volume[86574]: DEBUG cinder.quota [req-1fcaa27f-4015-416a-8711-0fc86ab8c5f6 req-554b12db-310c-4e3a-bc3a-a524d42528c0 tempest-ServerActionsTestOtherA-2064758512 None] Created reservations ['6e0e2f13-587a-4cf4-bd06-1c79534b9e83', '67a934ee-74f2-404f-acd1-b04ef0e6cca7', '69f8d194-c32c-40a4-8ae0-85249cfea3ab', '94fe71d9-3b0f-4c92-94a8-072b1b8298ea'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:26:55 devstack cinder-volume[86574]: DEBUG cinder.coordination [req-a8cc7150-b8d2-42fc-8ff7-481def064c70 req-1c6b8162-80d9-4aef-8349-392082759812 tempest-VolumesGetTestJSON-578633350 None] Acquiring lock "cinder-e2427372-ed73-472d-8aeb-c2154566c157-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-1fcaa27f-4015-416a-8711-0fc86ab8c5f6 req-554b12db-310c-4e3a-bc3a-a524d42528c0 tempest-ServerActionsTestOtherA-2064758512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-1fcaa27f-4015-416a-8711-0fc86ab8c5f6 req-554b12db-310c-4e3a-bc3a-a524d42528c0 tempest-ServerActionsTestOtherA-2064758512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:55 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [req-1fcaa27f-4015-416a-8711-0fc86ab8c5f6 req-554b12db-310c-4e3a-bc3a-a524d42528c0 tempest-ServerActionsTestOtherA-2064758512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:55 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [req-1fcaa27f-4015-416a-8711-0fc86ab8c5f6 req-554b12db-310c-4e3a-bc3a-a524d42528c0 tempest-ServerActionsTestOtherA-2064758512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-1fcaa27f-4015-416a-8711-0fc86ab8c5f6 req-554b12db-310c-4e3a-bc3a-a524d42528c0 tempest-ServerActionsTestOtherA-2064758512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [req-1fcaa27f-4015-416a-8711-0fc86ab8c5f6 req-554b12db-310c-4e3a-bc3a-a524d42528c0 tempest-ServerActionsTestOtherA-2064758512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:55 devstack cinder-volume[86574]: DEBUG cinder.coordination [req-a8cc7150-b8d2-42fc-8ff7-481def064c70 req-1c6b8162-80d9-4aef-8349-392082759812 tempest-VolumesGetTestJSON-578633350 None] Lock "cinder-e2427372-ed73-472d-8aeb-c2154566c157-delete_volume" acquired by "delete_volume" :: waited 0.067s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:55 devstack sudo[96744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:26:55 devstack sudo[96744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:55 devstack cinder-volume[86574]: DEBUG cinder.coordination [req-a8cc7150-b8d2-42fc-8ff7-481def064c70 req-1c6b8162-80d9-4aef-8349-392082759812 tempest-VolumesGetTestJSON-578633350 None] Acquiring lock "cinder-quobyte-e2427372-ed73-472d-8aeb-c2154566c157" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:55 devstack cinder-volume[86574]: DEBUG cinder.coordination [req-a8cc7150-b8d2-42fc-8ff7-481def064c70 req-1c6b8162-80d9-4aef-8349-392082759812 tempest-VolumesGetTestJSON-578633350 None] Lock "cinder-quobyte-e2427372-ed73-472d-8aeb-c2154566c157" acquired by "delete_volume" :: waited 0.030s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:55 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[d44f9cde-7c7c-4226-abd7-c66f62ed5d7a]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [req-a8cc7150-b8d2-42fc-8ff7-481def064c70 req-1c6b8162-80d9-4aef-8349-392082759812 tempest-VolumesGetTestJSON-578633350 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e2427372-ed73-472d-8aeb-c2154566c157 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:55 devstack sudo[96739]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:55 devstack sudo[96740]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ddd9cd01-260f-4a6b-beef-8731fc736fa0 tempest-SnapshotsActionsTest-1745873484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9" returned: 0 in 0.527s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-39908bab-bd2d-42cd-950d-fffbde27bb1f tempest-ServerActionsTestOtherA-2064758512 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c8d23fa1-7cea-46a1-b22f-31e8dd59cdd5" returned: 0 in 0.472s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:55 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-ddd9cd01-260f-4a6b-beef-8731fc736fa0 tempest-SnapshotsActionsTest-1745873484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96a340ff-bc46-488b-a48d-d4848e67facd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:26:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ddd9cd01-260f-4a6b-beef-8731fc736fa0 tempest-SnapshotsActionsTest-1745873484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.828c4e06-ed38-4558-870f-48e8266ac0ba {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-39908bab-bd2d-42cd-950d-fffbde27bb1f tempest-ServerActionsTestOtherA-2064758512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c8d23fa1-7cea-46a1-b22f-31e8dd59cdd5 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:55 devstack sudo[96753]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.828c4e06-ed38-4558-870f-48e8266ac0ba Nov 01 12:26:55 devstack sudo[96753]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:55 devstack sudo[96754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c8d23fa1-7cea-46a1-b22f-31e8dd59cdd5 Nov 01 12:26:55 devstack sudo[96754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:55 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b5e15313-bc4f-42d1-b381-71bc6f15bfee tempest-VolumesExtendTest-311321505 None] Acquiring lock "cinder-c465eeac-ebdc-4abf-8769-dfedcd3c122e-delete_snapshot" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:55 devstack sudo[96752]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e2427372-ed73-472d-8aeb-c2154566c157 Nov 01 12:26:55 devstack sudo[96752]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:55 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b5e15313-bc4f-42d1-b381-71bc6f15bfee tempest-VolumesExtendTest-311321505 None] Lock "cinder-c465eeac-ebdc-4abf-8769-dfedcd3c122e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.040s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:55 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b5e15313-bc4f-42d1-b381-71bc6f15bfee tempest-VolumesExtendTest-311321505 None] Acquiring lock "cinder-quobyte-dbf4e50c-a917-4abe-8b60-75e0327d51d8" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:55 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b5e15313-bc4f-42d1-b381-71bc6f15bfee tempest-VolumesExtendTest-311321505 None] Lock "cinder-quobyte-dbf4e50c-a917-4abe-8b60-75e0327d51d8" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:55 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b5e15313-bc4f-42d1-b381-71bc6f15bfee tempest-VolumesExtendTest-311321505 None] Acquiring lock "cinder-quobyte-c465eeac-ebdc-4abf-8769-dfedcd3c122e" by "_delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:55 devstack sudo[96744]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [req-1fcaa27f-4015-416a-8711-0fc86ab8c5f6 req-554b12db-310c-4e3a-bc3a-a524d42528c0 tempest-ServerActionsTestOtherA-2064758512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.376s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:55 devstack cinder-volume[86574]: DEBUG cinder.manager [req-1fcaa27f-4015-416a-8711-0fc86ab8c5f6 req-554b12db-310c-4e3a-bc3a-a524d42528c0 tempest-ServerActionsTestOtherA-2064758512 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:26:55 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-1fcaa27f-4015-416a-8711-0fc86ab8c5f6 req-554b12db-310c-4e3a-bc3a-a524d42528c0 tempest-ServerActionsTestOtherA-2064758512 None] Deleted volume successfully. Nov 01 12:26:55 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b5e15313-bc4f-42d1-b381-71bc6f15bfee tempest-VolumesExtendTest-311321505 None] Lock "cinder-quobyte-c465eeac-ebdc-4abf-8769-dfedcd3c122e" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:55 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-b5e15313-bc4f-42d1-b381-71bc6f15bfee tempest-VolumesExtendTest-311321505 None] Deleting offline snapshot c465eeac-ebdc-4abf-8769-dfedcd3c122e of volume dbf4e50c-a917-4abe-8b60-75e0327d51d8 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:26:55 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-b5e15313-bc4f-42d1-b381-71bc6f15bfee tempest-VolumesExtendTest-311321505 None] snapshot_file for this snap is: volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8.c465eeac-ebdc-4abf-8769-dfedcd3c122e {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:26:55 devstack cinder-volume[86574]: DEBUG cinder.coordination [req-1fcaa27f-4015-416a-8711-0fc86ab8c5f6 req-554b12db-310c-4e3a-bc3a-a524d42528c0 tempest-ServerActionsTestOtherA-2064758512 None] Lock "cinder-4dea6740-5a36-424b-8321-cc6bf8bed2da-delete_volume" released by "delete_volume" :: held 1.756s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:55 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[26ce296b-25cc-4e8b-afa2-8765e2f2cce6]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b5e15313-bc4f-42d1-b381-71bc6f15bfee tempest-VolumesExtendTest-311321505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8.c465eeac-ebdc-4abf-8769-dfedcd3c122e {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:56 devstack sudo[96754]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-39908bab-bd2d-42cd-950d-fffbde27bb1f tempest-ServerActionsTestOtherA-2064758512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c8d23fa1-7cea-46a1-b22f-31e8dd59cdd5" returned: 0 in 0.375s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:56 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-39908bab-bd2d-42cd-950d-fffbde27bb1f tempest-ServerActionsTestOtherA-2064758512 None] Lock "cinder-quobyte-c8d23fa1-7cea-46a1-b22f-31e8dd59cdd5" released by "delete_volume" :: held 0.932s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:56 devstack sudo[96759]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8.c465eeac-ebdc-4abf-8769-dfedcd3c122e Nov 01 12:26:56 devstack sudo[96759]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:56 devstack sudo[96752]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [req-a8cc7150-b8d2-42fc-8ff7-481def064c70 req-1c6b8162-80d9-4aef-8349-392082759812 tempest-VolumesGetTestJSON-578633350 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e2427372-ed73-472d-8aeb-c2154566c157" returned: 0 in 0.509s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [req-a8cc7150-b8d2-42fc-8ff7-481def064c70 req-1c6b8162-80d9-4aef-8349-392082759812 tempest-VolumesGetTestJSON-578633350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e2427372-ed73-472d-8aeb-c2154566c157 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:56 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-39908bab-bd2d-42cd-950d-fffbde27bb1f tempest-ServerActionsTestOtherA-2064758512 None] Created reservations ['cca21d3a-9748-413c-a63a-3d480369082b', '3d513db3-2061-4a61-83d0-b595ab6ef3e7', '1c1cd4d3-4446-4bbd-b972-7c815aa9ea6f', '5a9f73ab-7e87-4d18-8bea-0ef6474059a5'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:26:56 devstack sudo[96768]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e2427372-ed73-472d-8aeb-c2154566c157 Nov 01 12:26:56 devstack sudo[96768]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:56 devstack sudo[96753]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ddd9cd01-260f-4a6b-beef-8731fc736fa0 tempest-SnapshotsActionsTest-1745873484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.828c4e06-ed38-4558-870f-48e8266ac0ba" returned: 0 in 0.558s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ddd9cd01-260f-4a6b-beef-8731fc736fa0 tempest-SnapshotsActionsTest-1745873484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.828c4e06-ed38-4558-870f-48e8266ac0ba {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:56 devstack sudo[96770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.828c4e06-ed38-4558-870f-48e8266ac0ba Nov 01 12:26:56 devstack sudo[96770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-39908bab-bd2d-42cd-950d-fffbde27bb1f tempest-ServerActionsTestOtherA-2064758512 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-39908bab-bd2d-42cd-950d-fffbde27bb1f tempest-ServerActionsTestOtherA-2064758512 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:56 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-39908bab-bd2d-42cd-950d-fffbde27bb1f tempest-ServerActionsTestOtherA-2064758512 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:56 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-39908bab-bd2d-42cd-950d-fffbde27bb1f tempest-ServerActionsTestOtherA-2064758512 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-39908bab-bd2d-42cd-950d-fffbde27bb1f tempest-ServerActionsTestOtherA-2064758512 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-39908bab-bd2d-42cd-950d-fffbde27bb1f tempest-ServerActionsTestOtherA-2064758512 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:56 devstack sudo[96773]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:26:56 devstack sudo[96773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:56 devstack sudo[96759]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b5e15313-bc4f-42d1-b381-71bc6f15bfee tempest-VolumesExtendTest-311321505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8.c465eeac-ebdc-4abf-8769-dfedcd3c122e" returned: 0 in 0.471s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:56 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-b5e15313-bc4f-42d1-b381-71bc6f15bfee tempest-VolumesExtendTest-311321505 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:26:56 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[442d8685-6cc9-471c-91b5-aedf5e2ebdb6]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b5e15313-bc4f-42d1-b381-71bc6f15bfee tempest-VolumesExtendTest-311321505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:56 devstack sudo[96768]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [req-a8cc7150-b8d2-42fc-8ff7-481def064c70 req-1c6b8162-80d9-4aef-8349-392082759812 tempest-VolumesGetTestJSON-578633350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e2427372-ed73-472d-8aeb-c2154566c157" returned: 0 in 0.310s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:56 devstack cinder-volume[86574]: DEBUG cinder.coordination [req-a8cc7150-b8d2-42fc-8ff7-481def064c70 req-1c6b8162-80d9-4aef-8349-392082759812 tempest-VolumesGetTestJSON-578633350 None] Lock "cinder-quobyte-e2427372-ed73-472d-8aeb-c2154566c157" released by "delete_volume" :: held 0.883s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:56 devstack sudo[96770]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ddd9cd01-260f-4a6b-beef-8731fc736fa0 tempest-SnapshotsActionsTest-1745873484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.828c4e06-ed38-4558-870f-48e8266ac0ba" returned: 0 in 0.310s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:56 devstack sudo[96778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8 Nov 01 12:26:56 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ddd9cd01-260f-4a6b-beef-8731fc736fa0 tempest-SnapshotsActionsTest-1745873484 None] Lock "cinder-quobyte-828c4e06-ed38-4558-870f-48e8266ac0ba" released by "_delete_snapshot" :: held 2.107s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:56 devstack sudo[96778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:56 devstack cinder-volume[86574]: DEBUG cinder.quota [req-a8cc7150-b8d2-42fc-8ff7-481def064c70 req-1c6b8162-80d9-4aef-8349-392082759812 tempest-VolumesGetTestJSON-578633350 None] Created reservations ['a72822db-e12f-46a7-bb78-8f0d055b7ee7', '03e913f0-f526-4c00-a45a-c9fdb7b82702', '1b529418-5ddd-49a1-ace7-82d322852508', 'fc4f8051-328f-4c3b-be47-c5bd403c5949'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:26:56 devstack sudo[96773]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:56 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ddd9cd01-260f-4a6b-beef-8731fc736fa0 tempest-SnapshotsActionsTest-1745873484 None] Lock "cinder-quobyte-96a340ff-bc46-488b-a48d-d4848e67facd" released by "delete_snapshot" :: held 2.158s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-39908bab-bd2d-42cd-950d-fffbde27bb1f tempest-ServerActionsTestOtherA-2064758512 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.303s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:56 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-39908bab-bd2d-42cd-950d-fffbde27bb1f tempest-ServerActionsTestOtherA-2064758512 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:26:56 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-39908bab-bd2d-42cd-950d-fffbde27bb1f tempest-ServerActionsTestOtherA-2064758512 None] Deleted volume successfully. Nov 01 12:26:56 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-39908bab-bd2d-42cd-950d-fffbde27bb1f tempest-ServerActionsTestOtherA-2064758512 None] Lock "cinder-c8d23fa1-7cea-46a1-b22f-31e8dd59cdd5-delete_volume" released by "delete_volume" :: held 1.611s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-a8cc7150-b8d2-42fc-8ff7-481def064c70 req-1c6b8162-80d9-4aef-8349-392082759812 tempest-VolumesGetTestJSON-578633350 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-a8cc7150-b8d2-42fc-8ff7-481def064c70 req-1c6b8162-80d9-4aef-8349-392082759812 tempest-VolumesGetTestJSON-578633350 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:56 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [req-a8cc7150-b8d2-42fc-8ff7-481def064c70 req-1c6b8162-80d9-4aef-8349-392082759812 tempest-VolumesGetTestJSON-578633350 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:26:56 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [req-a8cc7150-b8d2-42fc-8ff7-481def064c70 req-1c6b8162-80d9-4aef-8349-392082759812 tempest-VolumesGetTestJSON-578633350 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:26:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-a8cc7150-b8d2-42fc-8ff7-481def064c70 req-1c6b8162-80d9-4aef-8349-392082759812 tempest-VolumesGetTestJSON-578633350 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:26:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [req-a8cc7150-b8d2-42fc-8ff7-481def064c70 req-1c6b8162-80d9-4aef-8349-392082759812 tempest-VolumesGetTestJSON-578633350 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:56 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-ddd9cd01-260f-4a6b-beef-8731fc736fa0 tempest-SnapshotsActionsTest-1745873484 None] Created reservations ['074441a6-46d7-4ddf-879e-71c39059ba23', 'ddeb514a-e5d6-4e13-8d1f-ef34a8d416e2', '4a4fea88-e145-4fd4-934f-61dccf607cac', 'f2eb2463-e43f-4541-a5c4-1e8c4f38a4aa'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:26:56 devstack sudo[96782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:26:56 devstack sudo[96782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:56 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-ddd9cd01-260f-4a6b-beef-8731fc736fa0 tempest-SnapshotsActionsTest-1745873484 None] Delete snapshot completed successfully. Nov 01 12:26:56 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ddd9cd01-260f-4a6b-beef-8731fc736fa0 tempest-SnapshotsActionsTest-1745873484 None] Lock "cinder-828c4e06-ed38-4558-870f-48e8266ac0ba-delete_snapshot" released by "delete_snapshot" :: held 2.416s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:56 devstack sudo[96778]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b5e15313-bc4f-42d1-b381-71bc6f15bfee tempest-VolumesExtendTest-311321505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8" returned: 0 in 0.437s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b5e15313-bc4f-42d1-b381-71bc6f15bfee tempest-VolumesExtendTest-311321505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8.c465eeac-ebdc-4abf-8769-dfedcd3c122e {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:56 devstack sudo[96787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8.c465eeac-ebdc-4abf-8769-dfedcd3c122e Nov 01 12:26:56 devstack sudo[96787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:57 devstack sudo[96782]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [req-a8cc7150-b8d2-42fc-8ff7-481def064c70 req-1c6b8162-80d9-4aef-8349-392082759812 tempest-VolumesGetTestJSON-578633350 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.291s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:57 devstack cinder-volume[86574]: DEBUG cinder.manager [req-a8cc7150-b8d2-42fc-8ff7-481def064c70 req-1c6b8162-80d9-4aef-8349-392082759812 tempest-VolumesGetTestJSON-578633350 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:26:57 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-a8cc7150-b8d2-42fc-8ff7-481def064c70 req-1c6b8162-80d9-4aef-8349-392082759812 tempest-VolumesGetTestJSON-578633350 None] Deleted volume successfully. Nov 01 12:26:57 devstack cinder-volume[86574]: DEBUG cinder.coordination [req-a8cc7150-b8d2-42fc-8ff7-481def064c70 req-1c6b8162-80d9-4aef-8349-392082759812 tempest-VolumesGetTestJSON-578633350 None] Lock "cinder-e2427372-ed73-472d-8aeb-c2154566c157-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:57 devstack sudo[96787]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b5e15313-bc4f-42d1-b381-71bc6f15bfee tempest-VolumesExtendTest-311321505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8.c465eeac-ebdc-4abf-8769-dfedcd3c122e" returned: 0 in 0.391s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b5e15313-bc4f-42d1-b381-71bc6f15bfee tempest-VolumesExtendTest-311321505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8.c465eeac-ebdc-4abf-8769-dfedcd3c122e {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:57 devstack sudo[96794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8.c465eeac-ebdc-4abf-8769-dfedcd3c122e Nov 01 12:26:57 devstack sudo[96794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:57 devstack sudo[96794]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b5e15313-bc4f-42d1-b381-71bc6f15bfee tempest-VolumesExtendTest-311321505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8.c465eeac-ebdc-4abf-8769-dfedcd3c122e" returned: 0 in 0.282s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:57 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b5e15313-bc4f-42d1-b381-71bc6f15bfee tempest-VolumesExtendTest-311321505 None] Lock "cinder-quobyte-c465eeac-ebdc-4abf-8769-dfedcd3c122e" released by "_delete_snapshot" :: held 1.742s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:57 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b5e15313-bc4f-42d1-b381-71bc6f15bfee tempest-VolumesExtendTest-311321505 None] Lock "cinder-quobyte-dbf4e50c-a917-4abe-8b60-75e0327d51d8" released by "delete_snapshot" :: held 1.777s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:57 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-b5e15313-bc4f-42d1-b381-71bc6f15bfee tempest-VolumesExtendTest-311321505 None] Created reservations ['b8b6b1f8-0713-4290-8432-77285796fa34', 'de3b2199-ccf4-4ab6-a91e-8abc1843f5ef', '81d576e4-8ec2-4943-9a7f-1c5a54921800', '7eeaf681-dbc2-4bca-805d-b610caa77ebf'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:26:58 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-b5e15313-bc4f-42d1-b381-71bc6f15bfee tempest-VolumesExtendTest-311321505 None] Delete snapshot completed successfully. Nov 01 12:26:58 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b5e15313-bc4f-42d1-b381-71bc6f15bfee tempest-VolumesExtendTest-311321505 None] Lock "cinder-c465eeac-ebdc-4abf-8769-dfedcd3c122e-delete_snapshot" released by "delete_snapshot" :: held 2.166s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:26:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e425b9af-2054-474b-90f8-25d359a6f692 tempest-SnapshotsActionsTest-1207636017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:26:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e425b9af-2054-474b-90f8-25d359a6f692 tempest-SnapshotsActionsTest-1207636017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:26:58 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-e425b9af-2054-474b-90f8-25d359a6f692 tempest-SnapshotsActionsTest-1207636017 None] Creating offline snapshot d53d492e-b0e4-4681-8d81-9469051ac23d of volume 96a340ff-bc46-488b-a48d-d4848e67facd {{(pid=86574) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:26:58 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3144420-532e-4e10-be2a-a9cc3c7b62d1]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e425b9af-2054-474b-90f8-25d359a6f692 tempest-SnapshotsActionsTest-1207636017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:58 devstack sudo[96820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9 Nov 01 12:26:58 devstack sudo[96820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:58 devstack sudo[96820]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e425b9af-2054-474b-90f8-25d359a6f692 tempest-SnapshotsActionsTest-1207636017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9" returned: 0 in 0.406s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:58 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-e425b9af-2054-474b-90f8-25d359a6f692 tempest-SnapshotsActionsTest-1207636017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96a340ff-bc46-488b-a48d-d4848e67facd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:26:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e425b9af-2054-474b-90f8-25d359a6f692 tempest-SnapshotsActionsTest-1207636017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.d53d492e-b0e4-4681-8d81-9469051ac23d 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:58 devstack sudo[96825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.d53d492e-b0e4-4681-8d81-9469051ac23d 1G Nov 01 12:26:58 devstack sudo[96825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:59 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a8ab38ab-8aaa-4635-9c11-8c37f60ca58b tempest-VolumesExtendTest-311321505 None] Acquiring lock "cinder-dbf4e50c-a917-4abe-8b60-75e0327d51d8-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:59 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a8ab38ab-8aaa-4635-9c11-8c37f60ca58b tempest-VolumesExtendTest-311321505 None] Lock "cinder-dbf4e50c-a917-4abe-8b60-75e0327d51d8-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:59 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a8ab38ab-8aaa-4635-9c11-8c37f60ca58b tempest-VolumesExtendTest-311321505 None] Acquiring lock "cinder-quobyte-dbf4e50c-a917-4abe-8b60-75e0327d51d8" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:26:59 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a8ab38ab-8aaa-4635-9c11-8c37f60ca58b tempest-VolumesExtendTest-311321505 None] Lock "cinder-quobyte-dbf4e50c-a917-4abe-8b60-75e0327d51d8" acquired by "delete_volume" :: waited 0.034s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:26:59 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[57a481e0-0c08-4afa-b76c-97a755c7af34]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:26:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a8ab38ab-8aaa-4635-9c11-8c37f60ca58b tempest-VolumesExtendTest-311321505 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:59 devstack sudo[96825]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e425b9af-2054-474b-90f8-25d359a6f692 tempest-SnapshotsActionsTest-1207636017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.d53d492e-b0e4-4681-8d81-9469051ac23d 1G" returned: 0 in 0.806s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:59 devstack sudo[96833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8 Nov 01 12:26:59 devstack sudo[96833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e425b9af-2054-474b-90f8-25d359a6f692 tempest-SnapshotsActionsTest-1207636017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.d53d492e-b0e4-4681-8d81-9469051ac23d {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:59 devstack sudo[96835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.d53d492e-b0e4-4681-8d81-9469051ac23d Nov 01 12:26:59 devstack sudo[96835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:59 devstack sudo[96833]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a8ab38ab-8aaa-4635-9c11-8c37f60ca58b tempest-VolumesExtendTest-311321505 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8" returned: 0 in 0.527s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a8ab38ab-8aaa-4635-9c11-8c37f60ca58b tempest-VolumesExtendTest-311321505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:59 devstack sudo[96835]: pam_unix(sudo:session): session closed for user root Nov 01 12:26:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e425b9af-2054-474b-90f8-25d359a6f692 tempest-SnapshotsActionsTest-1207636017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.d53d492e-b0e4-4681-8d81-9469051ac23d" returned: 0 in 0.362s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:26:59 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-e425b9af-2054-474b-90f8-25d359a6f692 tempest-SnapshotsActionsTest-1207636017 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.d53d492e-b0e4-4681-8d81-9469051ac23d is being set with open permissions: ugo+rw Nov 01 12:26:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e425b9af-2054-474b-90f8-25d359a6f692 tempest-SnapshotsActionsTest-1207636017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.d53d492e-b0e4-4681-8d81-9469051ac23d {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:26:59 devstack sudo[96843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8 Nov 01 12:26:59 devstack sudo[96843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:26:59 devstack sudo[96844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.d53d492e-b0e4-4681-8d81-9469051ac23d Nov 01 12:26:59 devstack sudo[96844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:00 devstack sudo[96843]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:00 devstack sudo[96844]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a8ab38ab-8aaa-4635-9c11-8c37f60ca58b tempest-VolumesExtendTest-311321505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dbf4e50c-a917-4abe-8b60-75e0327d51d8" returned: 0 in 0.297s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e425b9af-2054-474b-90f8-25d359a6f692 tempest-SnapshotsActionsTest-1207636017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.d53d492e-b0e4-4681-8d81-9469051ac23d" returned: 0 in 0.299s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:00 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a8ab38ab-8aaa-4635-9c11-8c37f60ca58b tempest-VolumesExtendTest-311321505 None] Lock "cinder-quobyte-dbf4e50c-a917-4abe-8b60-75e0327d51d8" released by "delete_volume" :: held 0.910s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:27:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e425b9af-2054-474b-90f8-25d359a6f692 tempest-SnapshotsActionsTest-1207636017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.027s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:27:00 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-e425b9af-2054-474b-90f8-25d359a6f692 tempest-SnapshotsActionsTest-1207636017 None] Create snapshot completed successfully Nov 01 12:27:00 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-a8ab38ab-8aaa-4635-9c11-8c37f60ca58b tempest-VolumesExtendTest-311321505 None] Created reservations ['c927113a-5282-4aea-834e-20d7854d7f9b', '0e8fb7a9-9cb2-44ed-ba4e-e48e85700acf', '821523f9-e8fb-4fb7-bbfb-e3f308a96609', '6820cfc4-eb7f-4cd2-9d44-14beb0e38ec7'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:27:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a8ab38ab-8aaa-4635-9c11-8c37f60ca58b tempest-VolumesExtendTest-311321505 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:27:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a8ab38ab-8aaa-4635-9c11-8c37f60ca58b tempest-VolumesExtendTest-311321505 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:27:00 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a8ab38ab-8aaa-4635-9c11-8c37f60ca58b tempest-VolumesExtendTest-311321505 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:27:00 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a8ab38ab-8aaa-4635-9c11-8c37f60ca58b tempest-VolumesExtendTest-311321505 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:27:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a8ab38ab-8aaa-4635-9c11-8c37f60ca58b tempest-VolumesExtendTest-311321505 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:27:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a8ab38ab-8aaa-4635-9c11-8c37f60ca58b tempest-VolumesExtendTest-311321505 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:00 devstack sudo[96849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:27:00 devstack sudo[96849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:00 devstack sudo[96849]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a8ab38ab-8aaa-4635-9c11-8c37f60ca58b tempest-VolumesExtendTest-311321505 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.280s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:00 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-a8ab38ab-8aaa-4635-9c11-8c37f60ca58b tempest-VolumesExtendTest-311321505 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:27:00 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-a8ab38ab-8aaa-4635-9c11-8c37f60ca58b tempest-VolumesExtendTest-311321505 None] Deleted volume successfully. Nov 01 12:27:00 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a8ab38ab-8aaa-4635-9c11-8c37f60ca58b tempest-VolumesExtendTest-311321505 None] Lock "cinder-dbf4e50c-a917-4abe-8b60-75e0327d51d8-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:27:01 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a95513f9-ec08-491c-91c5-7e02a83e3b50 tempest-SnapshotsActionsTest-1745873484 None] Acquiring lock "cinder-d53d492e-b0e4-4681-8d81-9469051ac23d-delete_snapshot" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:27:01 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a95513f9-ec08-491c-91c5-7e02a83e3b50 tempest-SnapshotsActionsTest-1745873484 None] Lock "cinder-d53d492e-b0e4-4681-8d81-9469051ac23d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.035s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:27:01 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a95513f9-ec08-491c-91c5-7e02a83e3b50 tempest-SnapshotsActionsTest-1745873484 None] Acquiring lock "cinder-quobyte-96a340ff-bc46-488b-a48d-d4848e67facd" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:27:01 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a95513f9-ec08-491c-91c5-7e02a83e3b50 tempest-SnapshotsActionsTest-1745873484 None] Lock "cinder-quobyte-96a340ff-bc46-488b-a48d-d4848e67facd" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:27:01 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a95513f9-ec08-491c-91c5-7e02a83e3b50 tempest-SnapshotsActionsTest-1745873484 None] Acquiring lock "cinder-quobyte-d53d492e-b0e4-4681-8d81-9469051ac23d" by "_delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:27:01 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a95513f9-ec08-491c-91c5-7e02a83e3b50 tempest-SnapshotsActionsTest-1745873484 None] Lock "cinder-quobyte-d53d492e-b0e4-4681-8d81-9469051ac23d" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:27:01 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-a95513f9-ec08-491c-91c5-7e02a83e3b50 tempest-SnapshotsActionsTest-1745873484 None] Deleting offline snapshot d53d492e-b0e4-4681-8d81-9469051ac23d of volume 96a340ff-bc46-488b-a48d-d4848e67facd {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:27:01 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-a95513f9-ec08-491c-91c5-7e02a83e3b50 tempest-SnapshotsActionsTest-1745873484 None] snapshot_file for this snap is: volume-96a340ff-bc46-488b-a48d-d4848e67facd.d53d492e-b0e4-4681-8d81-9469051ac23d {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:27:01 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[978ebdc7-0776-476f-a412-97a2e855785e]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:27:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a95513f9-ec08-491c-91c5-7e02a83e3b50 tempest-SnapshotsActionsTest-1745873484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.d53d492e-b0e4-4681-8d81-9469051ac23d {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:01 devstack sudo[96852]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.d53d492e-b0e4-4681-8d81-9469051ac23d Nov 01 12:27:01 devstack sudo[96852]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:02 devstack sudo[96852]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a95513f9-ec08-491c-91c5-7e02a83e3b50 tempest-SnapshotsActionsTest-1745873484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.d53d492e-b0e4-4681-8d81-9469051ac23d" returned: 0 in 0.480s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:02 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-a95513f9-ec08-491c-91c5-7e02a83e3b50 tempest-SnapshotsActionsTest-1745873484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96a340ff-bc46-488b-a48d-d4848e67facd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:27:02 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7601979-9cb1-4161-a050-b455a907fd06]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:27:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a95513f9-ec08-491c-91c5-7e02a83e3b50 tempest-SnapshotsActionsTest-1745873484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:02 devstack sudo[96857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9 Nov 01 12:27:02 devstack sudo[96857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:02 devstack sudo[96857]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a95513f9-ec08-491c-91c5-7e02a83e3b50 tempest-SnapshotsActionsTest-1745873484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9" returned: 0 in 0.479s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:02 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-a95513f9-ec08-491c-91c5-7e02a83e3b50 tempest-SnapshotsActionsTest-1745873484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96a340ff-bc46-488b-a48d-d4848e67facd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:27:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a95513f9-ec08-491c-91c5-7e02a83e3b50 tempest-SnapshotsActionsTest-1745873484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.d53d492e-b0e4-4681-8d81-9469051ac23d {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:02 devstack sudo[96862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.d53d492e-b0e4-4681-8d81-9469051ac23d Nov 01 12:27:02 devstack sudo[96862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:03 devstack sudo[96862]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a95513f9-ec08-491c-91c5-7e02a83e3b50 tempest-SnapshotsActionsTest-1745873484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.d53d492e-b0e4-4681-8d81-9469051ac23d" returned: 0 in 0.598s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a95513f9-ec08-491c-91c5-7e02a83e3b50 tempest-SnapshotsActionsTest-1745873484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.d53d492e-b0e4-4681-8d81-9469051ac23d {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:03 devstack sudo[96869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.d53d492e-b0e4-4681-8d81-9469051ac23d Nov 01 12:27:03 devstack sudo[96869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:03 devstack sudo[96869]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a95513f9-ec08-491c-91c5-7e02a83e3b50 tempest-SnapshotsActionsTest-1745873484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.d53d492e-b0e4-4681-8d81-9469051ac23d" returned: 0 in 0.316s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:03 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a95513f9-ec08-491c-91c5-7e02a83e3b50 tempest-SnapshotsActionsTest-1745873484 None] Lock "cinder-quobyte-d53d492e-b0e4-4681-8d81-9469051ac23d" released by "_delete_snapshot" :: held 2.076s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:27:03 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a95513f9-ec08-491c-91c5-7e02a83e3b50 tempest-SnapshotsActionsTest-1745873484 None] Lock "cinder-quobyte-96a340ff-bc46-488b-a48d-d4848e67facd" released by "delete_snapshot" :: held 2.108s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:27:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a49b425f-2ea6-42ef-b79e-d49c02633c99 tempest-BackendsCapabilitiesAdminTestsJSON-899608135 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.9067420959473, 'free_capacity_gb': 1773.9067420959473, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86574) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 01 12:27:03 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-a95513f9-ec08-491c-91c5-7e02a83e3b50 tempest-SnapshotsActionsTest-1745873484 None] Created reservations ['8207ccee-1545-44c3-af25-397eb712fb8b', 'fd0236d6-624b-4b03-b414-0b238a2ef672', '2542bcf3-d8e8-4118-8cf1-9029a8fffac7', '25f5c2fa-2ad8-411e-bf4c-bd730f47e9fc'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:27:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8e376ce3-9e44-4522-be0c-8a5531c84f78 tempest-BackendsCapabilitiesAdminTestsJSON-899608135 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.9067420959473, 'free_capacity_gb': 1773.9067420959473, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86574) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 01 12:27:04 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-a95513f9-ec08-491c-91c5-7e02a83e3b50 tempest-SnapshotsActionsTest-1745873484 None] Delete snapshot completed successfully. Nov 01 12:27:04 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a95513f9-ec08-491c-91c5-7e02a83e3b50 tempest-SnapshotsActionsTest-1745873484 None] Lock "cinder-d53d492e-b0e4-4681-8d81-9469051ac23d-delete_snapshot" released by "delete_snapshot" :: held 2.391s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:27:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-14e83a28-9093-4410-aded-f56af0ec38dd tempest-SnapshotsActionsTest-1207636017 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:27:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-14e83a28-9093-4410-aded-f56af0ec38dd tempest-SnapshotsActionsTest-1207636017 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:27:05 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-14e83a28-9093-4410-aded-f56af0ec38dd tempest-SnapshotsActionsTest-1207636017 None] Creating offline snapshot 3414a5d7-0e9a-4869-a8ff-f6a86739e6ba of volume 96a340ff-bc46-488b-a48d-d4848e67facd {{(pid=86574) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:27:05 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[9664e81c-752b-4a16-80d8-6d6849c2b0b3]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:27:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-14e83a28-9093-4410-aded-f56af0ec38dd tempest-SnapshotsActionsTest-1207636017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:05 devstack sudo[96873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9 Nov 01 12:27:05 devstack sudo[96873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:05 devstack sudo[96873]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-14e83a28-9093-4410-aded-f56af0ec38dd tempest-SnapshotsActionsTest-1207636017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9" returned: 0 in 0.577s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:05 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-14e83a28-9093-4410-aded-f56af0ec38dd tempest-SnapshotsActionsTest-1207636017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96a340ff-bc46-488b-a48d-d4848e67facd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:27:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-14e83a28-9093-4410-aded-f56af0ec38dd tempest-SnapshotsActionsTest-1207636017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.3414a5d7-0e9a-4869-a8ff-f6a86739e6ba 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:05 devstack sudo[96878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.3414a5d7-0e9a-4869-a8ff-f6a86739e6ba 1G Nov 01 12:27:05 devstack sudo[96878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:06 devstack sudo[96878]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-14e83a28-9093-4410-aded-f56af0ec38dd tempest-SnapshotsActionsTest-1207636017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.3414a5d7-0e9a-4869-a8ff-f6a86739e6ba 1G" returned: 0 in 0.641s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-14e83a28-9093-4410-aded-f56af0ec38dd tempest-SnapshotsActionsTest-1207636017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.3414a5d7-0e9a-4869-a8ff-f6a86739e6ba {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:06 devstack sudo[96885]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.3414a5d7-0e9a-4869-a8ff-f6a86739e6ba Nov 01 12:27:06 devstack sudo[96885]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:06 devstack sudo[96885]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-14e83a28-9093-4410-aded-f56af0ec38dd tempest-SnapshotsActionsTest-1207636017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.3414a5d7-0e9a-4869-a8ff-f6a86739e6ba" returned: 0 in 0.413s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:06 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-14e83a28-9093-4410-aded-f56af0ec38dd tempest-SnapshotsActionsTest-1207636017 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.3414a5d7-0e9a-4869-a8ff-f6a86739e6ba is being set with open permissions: ugo+rw Nov 01 12:27:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-14e83a28-9093-4410-aded-f56af0ec38dd tempest-SnapshotsActionsTest-1207636017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.3414a5d7-0e9a-4869-a8ff-f6a86739e6ba {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:06 devstack sudo[96891]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.3414a5d7-0e9a-4869-a8ff-f6a86739e6ba Nov 01 12:27:06 devstack sudo[96891]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:07 devstack sudo[96891]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-14e83a28-9093-4410-aded-f56af0ec38dd tempest-SnapshotsActionsTest-1207636017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.3414a5d7-0e9a-4869-a8ff-f6a86739e6ba" returned: 0 in 0.355s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-14e83a28-9093-4410-aded-f56af0ec38dd tempest-SnapshotsActionsTest-1207636017 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.131s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:27:07 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-14e83a28-9093-4410-aded-f56af0ec38dd tempest-SnapshotsActionsTest-1207636017 None] Create snapshot completed successfully Nov 01 12:27:07 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-829bd404-0a7a-4d53-a2f0-8ec595fac25c tempest-VolumesNegativeTest-789353155 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:27:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-829bd404-0a7a-4d53-a2f0-8ec595fac25c tempest-VolumesNegativeTest-789353155 None] Flow 'volume_create_manager' (ea59f271-a9ac-4da4-beb7-fc7fe0ff7950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:27:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-829bd404-0a7a-4d53-a2f0-8ec595fac25c tempest-VolumesNegativeTest-789353155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feb68bd0-f8f1-406c-bd4d-b95e3b6870e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-829bd404-0a7a-4d53-a2f0-8ec595fac25c tempest-VolumesNegativeTest-789353155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (feb68bd0-f8f1-406c-bd4d-b95e3b6870e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1438483952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3270c195-0594-470b-8d68-2d138e427bb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cbb35ef2f7c4ea7b7fd72a9977068b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:27:07Z,use_quota=True,user_id='f4007f1ae46c4cbda2ed10583a88188e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-829bd404-0a7a-4d53-a2f0-8ec595fac25c tempest-VolumesNegativeTest-789353155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83849a18-5909-41f1-b0e3-43e445072b27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-829bd404-0a7a-4d53-a2f0-8ec595fac25c tempest-VolumesNegativeTest-789353155 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (83849a18-5909-41f1-b0e3-43e445072b27) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-829bd404-0a7a-4d53-a2f0-8ec595fac25c tempest-VolumesNegativeTest-789353155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4e9baf7-a343-4cae-a2fe-1194cd3a7b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-829bd404-0a7a-4d53-a2f0-8ec595fac25c tempest-VolumesNegativeTest-789353155 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c4e9baf7-a343-4cae-a2fe-1194cd3a7b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3270c195-0594-470b-8d68-2d138e427bb1', 'volume_name': 'volume-3270c195-0594-470b-8d68-2d138e427bb1', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-829bd404-0a7a-4d53-a2f0-8ec595fac25c tempest-VolumesNegativeTest-789353155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (addc9b22-3708-4925-86fc-4418eba1c6e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-829bd404-0a7a-4d53-a2f0-8ec595fac25c tempest-VolumesNegativeTest-789353155 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (addc9b22-3708-4925-86fc-4418eba1c6e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-829bd404-0a7a-4d53-a2f0-8ec595fac25c tempest-VolumesNegativeTest-789353155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (648d0c24-9213-4281-bf9f-b0aedf444663) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:07 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-829bd404-0a7a-4d53-a2f0-8ec595fac25c tempest-VolumesNegativeTest-789353155 None] Volume 3270c195-0594-470b-8d68-2d138e427bb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3270c195-0594-470b-8d68-2d138e427bb1', 'volume_size': 1} Nov 01 12:27:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-829bd404-0a7a-4d53-a2f0-8ec595fac25c tempest-VolumesNegativeTest-789353155 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:27:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-829bd404-0a7a-4d53-a2f0-8ec595fac25c tempest-VolumesNegativeTest-789353155 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:27:07 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-829bd404-0a7a-4d53-a2f0-8ec595fac25c tempest-VolumesNegativeTest-789353155 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:27:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1438483952',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3270c195-0594-470b-8d68-2d138e427bb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7cbb35ef2f7c4ea7b7fd72a9977068b4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:27:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:27:07Z,use_quota=True,user_id='f4007f1ae46c4cbda2ed10583a88188e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:27:07 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-829bd404-0a7a-4d53-a2f0-8ec595fac25c tempest-VolumesNegativeTest-789353155 None] Creating volume 3270c195-0594-470b-8d68-2d138e427bb1 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:27:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-829bd404-0a7a-4d53-a2f0-8ec595fac25c tempest-VolumesNegativeTest-789353155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:27:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-829bd404-0a7a-4d53-a2f0-8ec595fac25c tempest-VolumesNegativeTest-789353155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:27:07 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-829bd404-0a7a-4d53-a2f0-8ec595fac25c tempest-VolumesNegativeTest-789353155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:27:07 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-829bd404-0a7a-4d53-a2f0-8ec595fac25c tempest-VolumesNegativeTest-789353155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:27:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-829bd404-0a7a-4d53-a2f0-8ec595fac25c tempest-VolumesNegativeTest-789353155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:27:07 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-829bd404-0a7a-4d53-a2f0-8ec595fac25c tempest-VolumesNegativeTest-789353155 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:27:07 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-829bd404-0a7a-4d53-a2f0-8ec595fac25c tempest-VolumesNegativeTest-789353155 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:27:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-829bd404-0a7a-4d53-a2f0-8ec595fac25c tempest-VolumesNegativeTest-789353155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3270c195-0594-470b-8d68-2d138e427bb1 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:07 devstack sudo[96896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3270c195-0594-470b-8d68-2d138e427bb1 1073741824 Nov 01 12:27:07 devstack sudo[96896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:08 devstack sudo[96896]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-829bd404-0a7a-4d53-a2f0-8ec595fac25c tempest-VolumesNegativeTest-789353155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3270c195-0594-470b-8d68-2d138e427bb1 1073741824" returned: 0 in 0.531s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-829bd404-0a7a-4d53-a2f0-8ec595fac25c tempest-VolumesNegativeTest-789353155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3270c195-0594-470b-8d68-2d138e427bb1 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:08 devstack sudo[96903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3270c195-0594-470b-8d68-2d138e427bb1 Nov 01 12:27:08 devstack sudo[96903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:08 devstack sudo[96903]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:08 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-bd956672-bcfa-4b83-b72c-e3c39b2f87ff tempest-SnapshotsActionsTest-1745873484 None] Acquiring lock "cinder-3414a5d7-0e9a-4869-a8ff-f6a86739e6ba-delete_snapshot" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:27:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-829bd404-0a7a-4d53-a2f0-8ec595fac25c tempest-VolumesNegativeTest-789353155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3270c195-0594-470b-8d68-2d138e427bb1" returned: 0 in 0.390s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:08 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-829bd404-0a7a-4d53-a2f0-8ec595fac25c tempest-VolumesNegativeTest-789353155 None] <== create_volume: return (987ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:27:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-829bd404-0a7a-4d53-a2f0-8ec595fac25c tempest-VolumesNegativeTest-789353155 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.992s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:27:08 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-bd956672-bcfa-4b83-b72c-e3c39b2f87ff tempest-SnapshotsActionsTest-1745873484 None] Lock "cinder-3414a5d7-0e9a-4869-a8ff-f6a86739e6ba-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:27:08 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-bd956672-bcfa-4b83-b72c-e3c39b2f87ff tempest-SnapshotsActionsTest-1745873484 None] Acquiring lock "cinder-quobyte-96a340ff-bc46-488b-a48d-d4848e67facd" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:27:08 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-829bd404-0a7a-4d53-a2f0-8ec595fac25c tempest-VolumesNegativeTest-789353155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (648d0c24-9213-4281-bf9f-b0aedf444663) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3270c195-0594-470b-8d68-2d138e427bb1', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:08 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-829bd404-0a7a-4d53-a2f0-8ec595fac25c tempest-VolumesNegativeTest-789353155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5df7617d-9960-45a2-b0ed-eb8cb3b81873) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:08 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-bd956672-bcfa-4b83-b72c-e3c39b2f87ff tempest-SnapshotsActionsTest-1745873484 None] Lock "cinder-quobyte-96a340ff-bc46-488b-a48d-d4848e67facd" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:27:08 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-bd956672-bcfa-4b83-b72c-e3c39b2f87ff tempest-SnapshotsActionsTest-1745873484 None] Acquiring lock "cinder-quobyte-3414a5d7-0e9a-4869-a8ff-f6a86739e6ba" by "_delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:27:08 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-829bd404-0a7a-4d53-a2f0-8ec595fac25c tempest-VolumesNegativeTest-789353155 None] Volume volume-3270c195-0594-470b-8d68-2d138e427bb1 (3270c195-0594-470b-8d68-2d138e427bb1): created successfully Nov 01 12:27:08 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-829bd404-0a7a-4d53-a2f0-8ec595fac25c tempest-VolumesNegativeTest-789353155 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5df7617d-9960-45a2-b0ed-eb8cb3b81873) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:08 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-829bd404-0a7a-4d53-a2f0-8ec595fac25c tempest-VolumesNegativeTest-789353155 None] Flow 'volume_create_manager' (ea59f271-a9ac-4da4-beb7-fc7fe0ff7950) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:27:08 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-829bd404-0a7a-4d53-a2f0-8ec595fac25c tempest-VolumesNegativeTest-789353155 None] Created volume successfully. Nov 01 12:27:08 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-bd956672-bcfa-4b83-b72c-e3c39b2f87ff tempest-SnapshotsActionsTest-1745873484 None] Lock "cinder-quobyte-3414a5d7-0e9a-4869-a8ff-f6a86739e6ba" acquired by "_delete_snapshot" :: waited 0.040s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:27:08 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-bd956672-bcfa-4b83-b72c-e3c39b2f87ff tempest-SnapshotsActionsTest-1745873484 None] Deleting offline snapshot 3414a5d7-0e9a-4869-a8ff-f6a86739e6ba of volume 96a340ff-bc46-488b-a48d-d4848e67facd {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:27:08 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-bd956672-bcfa-4b83-b72c-e3c39b2f87ff tempest-SnapshotsActionsTest-1745873484 None] snapshot_file for this snap is: volume-96a340ff-bc46-488b-a48d-d4848e67facd.3414a5d7-0e9a-4869-a8ff-f6a86739e6ba {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:27:08 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[8511ee7f-1e12-4567-a158-563d1b484998]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:27:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bd956672-bcfa-4b83-b72c-e3c39b2f87ff tempest-SnapshotsActionsTest-1745873484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.3414a5d7-0e9a-4869-a8ff-f6a86739e6ba {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:08 devstack sudo[96906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.3414a5d7-0e9a-4869-a8ff-f6a86739e6ba Nov 01 12:27:08 devstack sudo[96906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:09 devstack sudo[96906]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bd956672-bcfa-4b83-b72c-e3c39b2f87ff tempest-SnapshotsActionsTest-1745873484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.3414a5d7-0e9a-4869-a8ff-f6a86739e6ba" returned: 0 in 0.448s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:09 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-bd956672-bcfa-4b83-b72c-e3c39b2f87ff tempest-SnapshotsActionsTest-1745873484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96a340ff-bc46-488b-a48d-d4848e67facd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:27:09 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[01271070-079b-4a06-a205-7ce7f256fb34]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:27:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bd956672-bcfa-4b83-b72c-e3c39b2f87ff tempest-SnapshotsActionsTest-1745873484 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:09 devstack sudo[96911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9 Nov 01 12:27:09 devstack sudo[96911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bd956672-bcfa-4b83-b72c-e3c39b2f87ff tempest-SnapshotsActionsTest-1745873484 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9" returned: 0 in 0.426s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:09 devstack sudo[96911]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:09 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-bd956672-bcfa-4b83-b72c-e3c39b2f87ff tempest-SnapshotsActionsTest-1745873484 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96a340ff-bc46-488b-a48d-d4848e67facd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:27:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bd956672-bcfa-4b83-b72c-e3c39b2f87ff tempest-SnapshotsActionsTest-1745873484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.3414a5d7-0e9a-4869-a8ff-f6a86739e6ba {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:09 devstack sudo[96916]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.3414a5d7-0e9a-4869-a8ff-f6a86739e6ba Nov 01 12:27:09 devstack sudo[96916]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:10 devstack sudo[96916]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bd956672-bcfa-4b83-b72c-e3c39b2f87ff tempest-SnapshotsActionsTest-1745873484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.3414a5d7-0e9a-4869-a8ff-f6a86739e6ba" returned: 0 in 0.545s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bd956672-bcfa-4b83-b72c-e3c39b2f87ff tempest-SnapshotsActionsTest-1745873484 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.3414a5d7-0e9a-4869-a8ff-f6a86739e6ba {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:10 devstack sudo[96925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.3414a5d7-0e9a-4869-a8ff-f6a86739e6ba Nov 01 12:27:10 devstack sudo[96925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:10 devstack sudo[96925]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bd956672-bcfa-4b83-b72c-e3c39b2f87ff tempest-SnapshotsActionsTest-1745873484 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.3414a5d7-0e9a-4869-a8ff-f6a86739e6ba" returned: 0 in 0.310s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:10 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-bd956672-bcfa-4b83-b72c-e3c39b2f87ff tempest-SnapshotsActionsTest-1745873484 None] Lock "cinder-quobyte-3414a5d7-0e9a-4869-a8ff-f6a86739e6ba" released by "_delete_snapshot" :: held 1.876s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:27:10 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-bd956672-bcfa-4b83-b72c-e3c39b2f87ff tempest-SnapshotsActionsTest-1745873484 None] Lock "cinder-quobyte-96a340ff-bc46-488b-a48d-d4848e67facd" released by "delete_snapshot" :: held 1.931s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:27:10 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-bd956672-bcfa-4b83-b72c-e3c39b2f87ff tempest-SnapshotsActionsTest-1745873484 None] Created reservations ['986c1bd6-434a-4511-9936-7ccd3352127c', 'ba8feae3-3c62-4af9-9d61-87f95d2a6e14', '72c6ac22-1885-4e61-b5ae-1f801cb06f49', 'c2c94473-8622-4edc-bf0b-cd61f0926059'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:27:10 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-bd956672-bcfa-4b83-b72c-e3c39b2f87ff tempest-SnapshotsActionsTest-1745873484 None] Delete snapshot completed successfully. Nov 01 12:27:10 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-bd956672-bcfa-4b83-b72c-e3c39b2f87ff tempest-SnapshotsActionsTest-1745873484 None] Lock "cinder-3414a5d7-0e9a-4869-a8ff-f6a86739e6ba-delete_snapshot" released by "delete_snapshot" :: held 2.104s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:27:11 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-22196c08-bf6a-4223-b617-87156f3122c7 tempest-SnapshotsActionsTest-1207636017 None] Acquiring lock "cinder-2038db6d-de31-4331-a7d1-c0df308b3eb9-delete_snapshot" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:27:11 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-22196c08-bf6a-4223-b617-87156f3122c7 tempest-SnapshotsActionsTest-1207636017 None] Lock "cinder-2038db6d-de31-4331-a7d1-c0df308b3eb9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:27:11 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-22196c08-bf6a-4223-b617-87156f3122c7 tempest-SnapshotsActionsTest-1207636017 None] Acquiring lock "cinder-quobyte-96a340ff-bc46-488b-a48d-d4848e67facd" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:27:11 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-22196c08-bf6a-4223-b617-87156f3122c7 tempest-SnapshotsActionsTest-1207636017 None] Lock "cinder-quobyte-96a340ff-bc46-488b-a48d-d4848e67facd" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:27:11 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-22196c08-bf6a-4223-b617-87156f3122c7 tempest-SnapshotsActionsTest-1207636017 None] Acquiring lock "cinder-quobyte-2038db6d-de31-4331-a7d1-c0df308b3eb9" by "_delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:27:11 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-22196c08-bf6a-4223-b617-87156f3122c7 tempest-SnapshotsActionsTest-1207636017 None] Lock "cinder-quobyte-2038db6d-de31-4331-a7d1-c0df308b3eb9" acquired by "_delete_snapshot" :: waited 0.047s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:27:11 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-22196c08-bf6a-4223-b617-87156f3122c7 tempest-SnapshotsActionsTest-1207636017 None] Deleting offline snapshot 2038db6d-de31-4331-a7d1-c0df308b3eb9 of volume 96a340ff-bc46-488b-a48d-d4848e67facd {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:27:11 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-22196c08-bf6a-4223-b617-87156f3122c7 tempest-SnapshotsActionsTest-1207636017 None] snapshot_file for this snap is: volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:27:11 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cb2e595-c2fb-43b7-8d42-13cd69f5fdae]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:27:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-22196c08-bf6a-4223-b617-87156f3122c7 tempest-SnapshotsActionsTest-1207636017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:12 devstack sudo[96928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9 Nov 01 12:27:12 devstack sudo[96928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:12 devstack sudo[96928]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-22196c08-bf6a-4223-b617-87156f3122c7 tempest-SnapshotsActionsTest-1207636017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9" returned: 0 in 0.758s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:12 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-22196c08-bf6a-4223-b617-87156f3122c7 tempest-SnapshotsActionsTest-1207636017 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-96a340ff-bc46-488b-a48d-d4848e67facd(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:27:12 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c9e2e90-af7b-4b6e-9132-cc38e867fee4]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:27:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-22196c08-bf6a-4223-b617-87156f3122c7 tempest-SnapshotsActionsTest-1207636017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:12 devstack sudo[96945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd Nov 01 12:27:12 devstack sudo[96945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:13 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-fbdd246a-5ce4-4ff7-8d3d-6bb6e48f8ef9 tempest-GroupSnapshotsV319Test-112737702 None] Group tempest-GroupSnapshotsV319Test-Group-204322454: creating Nov 01 12:27:13 devstack sudo[96945]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-22196c08-bf6a-4223-b617-87156f3122c7 tempest-SnapshotsActionsTest-1207636017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd" returned: 0 in 0.485s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-22196c08-bf6a-4223-b617-87156f3122c7 tempest-SnapshotsActionsTest-1207636017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:13 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-fbdd246a-5ce4-4ff7-8d3d-6bb6e48f8ef9 tempest-GroupSnapshotsV319Test-112737702 None] Group tempest-GroupSnapshotsV319Test-Group-204322454: created successfully Nov 01 12:27:13 devstack sudo[96955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9 Nov 01 12:27:13 devstack sudo[96955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:13 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-fbdd246a-5ce4-4ff7-8d3d-6bb6e48f8ef9 tempest-GroupSnapshotsV319Test-112737702 None] Create group completed successfully. Nov 01 12:27:13 devstack sudo[96955]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-22196c08-bf6a-4223-b617-87156f3122c7 tempest-SnapshotsActionsTest-1207636017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9" returned: 0 in 0.399s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-22196c08-bf6a-4223-b617-87156f3122c7 tempest-SnapshotsActionsTest-1207636017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:13 devstack sudo[96961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9 Nov 01 12:27:13 devstack sudo[96961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:13 devstack sudo[96961]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-22196c08-bf6a-4223-b617-87156f3122c7 tempest-SnapshotsActionsTest-1207636017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd.2038db6d-de31-4331-a7d1-c0df308b3eb9" returned: 0 in 0.306s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:13 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-22196c08-bf6a-4223-b617-87156f3122c7 tempest-SnapshotsActionsTest-1207636017 None] Lock "cinder-quobyte-2038db6d-de31-4331-a7d1-c0df308b3eb9" released by "_delete_snapshot" :: held 2.161s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:27:13 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-22196c08-bf6a-4223-b617-87156f3122c7 tempest-SnapshotsActionsTest-1207636017 None] Lock "cinder-quobyte-96a340ff-bc46-488b-a48d-d4848e67facd" released by "delete_snapshot" :: held 2.218s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:27:13 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-22196c08-bf6a-4223-b617-87156f3122c7 tempest-SnapshotsActionsTest-1207636017 None] Created reservations ['abf49fc3-147d-4b63-a1e5-2d83ddfcc564', '5c0c2f0b-b7a0-4828-b639-fe10057c299f', '927bf249-99e0-4265-9a5e-a7a74b256596', '0ad9e78a-17d2-4579-a8d4-359a9d2b2e03'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:27:14 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-22196c08-bf6a-4223-b617-87156f3122c7 tempest-SnapshotsActionsTest-1207636017 None] Delete snapshot completed successfully. Nov 01 12:27:14 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-22196c08-bf6a-4223-b617-87156f3122c7 tempest-SnapshotsActionsTest-1207636017 None] Lock "cinder-2038db6d-de31-4331-a7d1-c0df308b3eb9-delete_snapshot" released by "delete_snapshot" :: held 2.426s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:27:14 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-a1bce27c-14b0-44a8-bd91-38f9b3cb0c01 tempest-GroupSnapshotsV319Test-112737702 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:27:14 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a1bce27c-14b0-44a8-bd91-38f9b3cb0c01 tempest-GroupSnapshotsV319Test-112737702 None] Flow 'volume_create_manager' (cc74627c-81bb-48b6-87f4-d8ed3b74e046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:27:14 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a1bce27c-14b0-44a8-bd91-38f9b3cb0c01 tempest-GroupSnapshotsV319Test-112737702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a226aa49-87e2-4d75-9b33-acdfa748ccdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:14 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a1bce27c-14b0-44a8-bd91-38f9b3cb0c01 tempest-GroupSnapshotsV319Test-112737702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a226aa49-87e2-4d75-9b33-acdfa748ccdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1323185143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d88db2d5-fa47-45b6-af60-21228b1240cd,host='devstack@QuobyteHD#QuobyteHD',id=e008861e-f7a1-4a67-823c-417cbb74fcf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf6eea786e774aac8a34a5fefde2ed8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:27:15Z,use_quota=True,user_id='f0e51cf8360748d49aab404ca6c2a463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76b394ec-579f-4f45-a7a1-fd8fc82a9547),volume_type_id=76b394ec-579f-4f45-a7a1-fd8fc82a9547)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:14 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a1bce27c-14b0-44a8-bd91-38f9b3cb0c01 tempest-GroupSnapshotsV319Test-112737702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c01f1d20-22a0-4f33-b9b1-f6cb78cab866) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:15 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a1bce27c-14b0-44a8-bd91-38f9b3cb0c01 tempest-GroupSnapshotsV319Test-112737702 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c01f1d20-22a0-4f33-b9b1-f6cb78cab866) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:15 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a1bce27c-14b0-44a8-bd91-38f9b3cb0c01 tempest-GroupSnapshotsV319Test-112737702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e38c2f3-47ed-43bd-a2fe-7612867fd015) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:15 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a1bce27c-14b0-44a8-bd91-38f9b3cb0c01 tempest-GroupSnapshotsV319Test-112737702 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0e38c2f3-47ed-43bd-a2fe-7612867fd015) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e008861e-f7a1-4a67-823c-417cbb74fcf3', 'volume_name': 'volume-e008861e-f7a1-4a67-823c-417cbb74fcf3', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:15 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a1bce27c-14b0-44a8-bd91-38f9b3cb0c01 tempest-GroupSnapshotsV319Test-112737702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9416100-27d5-4cf8-bfce-3ab546f4fa91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:15 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a1bce27c-14b0-44a8-bd91-38f9b3cb0c01 tempest-GroupSnapshotsV319Test-112737702 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b9416100-27d5-4cf8-bfce-3ab546f4fa91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:15 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a1bce27c-14b0-44a8-bd91-38f9b3cb0c01 tempest-GroupSnapshotsV319Test-112737702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65b9168c-d8c9-48e0-8fb5-c95fd2788549) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:15 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-a1bce27c-14b0-44a8-bd91-38f9b3cb0c01 tempest-GroupSnapshotsV319Test-112737702 None] Volume e008861e-f7a1-4a67-823c-417cbb74fcf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e008861e-f7a1-4a67-823c-417cbb74fcf3', 'volume_size': 1} Nov 01 12:27:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a1bce27c-14b0-44a8-bd91-38f9b3cb0c01 tempest-GroupSnapshotsV319Test-112737702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:27:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a1bce27c-14b0-44a8-bd91-38f9b3cb0c01 tempest-GroupSnapshotsV319Test-112737702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:27:15 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a1bce27c-14b0-44a8-bd91-38f9b3cb0c01 tempest-GroupSnapshotsV319Test-112737702 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=d88db2d5-fa47-45b6-af60-21228b1240cd,created_at=2026-11-01T11:27:14Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1323185143',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=d88db2d5-fa47-45b6-af60-21228b1240cd,host='devstack@QuobyteHD#QuobyteHD',id=e008861e-f7a1-4a67-823c-417cbb74fcf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bf6eea786e774aac8a34a5fefde2ed8e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:27:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:27:15Z,use_quota=True,user_id='f0e51cf8360748d49aab404ca6c2a463',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(76b394ec-579f-4f45-a7a1-fd8fc82a9547),volume_type_id=76b394ec-579f-4f45-a7a1-fd8fc82a9547)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:27:15 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-a1bce27c-14b0-44a8-bd91-38f9b3cb0c01 tempest-GroupSnapshotsV319Test-112737702 None] Creating volume e008861e-f7a1-4a67-823c-417cbb74fcf3 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:27:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a1bce27c-14b0-44a8-bd91-38f9b3cb0c01 tempest-GroupSnapshotsV319Test-112737702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:27:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a1bce27c-14b0-44a8-bd91-38f9b3cb0c01 tempest-GroupSnapshotsV319Test-112737702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:27:15 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a1bce27c-14b0-44a8-bd91-38f9b3cb0c01 tempest-GroupSnapshotsV319Test-112737702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:27:15 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a1bce27c-14b0-44a8-bd91-38f9b3cb0c01 tempest-GroupSnapshotsV319Test-112737702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:27:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a1bce27c-14b0-44a8-bd91-38f9b3cb0c01 tempest-GroupSnapshotsV319Test-112737702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:27:15 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a1bce27c-14b0-44a8-bd91-38f9b3cb0c01 tempest-GroupSnapshotsV319Test-112737702 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:27:15 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-a1bce27c-14b0-44a8-bd91-38f9b3cb0c01 tempest-GroupSnapshotsV319Test-112737702 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:27:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a1bce27c-14b0-44a8-bd91-38f9b3cb0c01 tempest-GroupSnapshotsV319Test-112737702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e008861e-f7a1-4a67-823c-417cbb74fcf3 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:15 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-10e07b43-14f1-42c4-8e9a-81147ae446ee tempest-SnapshotsActionsTest-1207636017 None] Acquiring lock "cinder-96a340ff-bc46-488b-a48d-d4848e67facd-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:27:15 devstack sudo[96965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e008861e-f7a1-4a67-823c-417cbb74fcf3 1073741824 Nov 01 12:27:15 devstack sudo[96965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:15 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-10e07b43-14f1-42c4-8e9a-81147ae446ee tempest-SnapshotsActionsTest-1207636017 None] Lock "cinder-96a340ff-bc46-488b-a48d-d4848e67facd-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:27:15 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-10e07b43-14f1-42c4-8e9a-81147ae446ee tempest-SnapshotsActionsTest-1207636017 None] Acquiring lock "cinder-quobyte-96a340ff-bc46-488b-a48d-d4848e67facd" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:27:15 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-10e07b43-14f1-42c4-8e9a-81147ae446ee tempest-SnapshotsActionsTest-1207636017 None] Lock "cinder-quobyte-96a340ff-bc46-488b-a48d-d4848e67facd" acquired by "delete_volume" :: waited 0.046s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:27:15 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c759d22-ee7b-4171-9921-dde675179b31]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:27:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-10e07b43-14f1-42c4-8e9a-81147ae446ee tempest-SnapshotsActionsTest-1207636017 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:15 devstack sudo[96967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd Nov 01 12:27:15 devstack sudo[96967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:15 devstack sudo[96965]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a1bce27c-14b0-44a8-bd91-38f9b3cb0c01 tempest-GroupSnapshotsV319Test-112737702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e008861e-f7a1-4a67-823c-417cbb74fcf3 1073741824" returned: 0 in 0.591s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a1bce27c-14b0-44a8-bd91-38f9b3cb0c01 tempest-GroupSnapshotsV319Test-112737702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e008861e-f7a1-4a67-823c-417cbb74fcf3 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:15 devstack sudo[96975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e008861e-f7a1-4a67-823c-417cbb74fcf3 Nov 01 12:27:15 devstack sudo[96975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:16 devstack sudo[96967]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:16 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-10e07b43-14f1-42c4-8e9a-81147ae446ee tempest-SnapshotsActionsTest-1207636017 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd" returned: 0 in 0.673s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:16 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-10e07b43-14f1-42c4-8e9a-81147ae446ee tempest-SnapshotsActionsTest-1207636017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:16 devstack sudo[96989]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd Nov 01 12:27:16 devstack sudo[96989]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:16 devstack sudo[96975]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:16 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a1bce27c-14b0-44a8-bd91-38f9b3cb0c01 tempest-GroupSnapshotsV319Test-112737702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e008861e-f7a1-4a67-823c-417cbb74fcf3" returned: 0 in 0.724s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:16 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a1bce27c-14b0-44a8-bd91-38f9b3cb0c01 tempest-GroupSnapshotsV319Test-112737702 None] <== create_volume: return (1398ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:27:16 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a1bce27c-14b0-44a8-bd91-38f9b3cb0c01 tempest-GroupSnapshotsV319Test-112737702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.407s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:27:16 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a1bce27c-14b0-44a8-bd91-38f9b3cb0c01 tempest-GroupSnapshotsV319Test-112737702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (65b9168c-d8c9-48e0-8fb5-c95fd2788549) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e008861e-f7a1-4a67-823c-417cbb74fcf3', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:16 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a1bce27c-14b0-44a8-bd91-38f9b3cb0c01 tempest-GroupSnapshotsV319Test-112737702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (127c857c-f422-4aff-b15e-9b39c4aa0e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:16 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-a1bce27c-14b0-44a8-bd91-38f9b3cb0c01 tempest-GroupSnapshotsV319Test-112737702 None] Volume volume-e008861e-f7a1-4a67-823c-417cbb74fcf3 (e008861e-f7a1-4a67-823c-417cbb74fcf3): created successfully Nov 01 12:27:16 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a1bce27c-14b0-44a8-bd91-38f9b3cb0c01 tempest-GroupSnapshotsV319Test-112737702 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (127c857c-f422-4aff-b15e-9b39c4aa0e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:16 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a1bce27c-14b0-44a8-bd91-38f9b3cb0c01 tempest-GroupSnapshotsV319Test-112737702 None] Flow 'volume_create_manager' (cc74627c-81bb-48b6-87f4-d8ed3b74e046) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:27:16 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-a1bce27c-14b0-44a8-bd91-38f9b3cb0c01 tempest-GroupSnapshotsV319Test-112737702 None] Created volume successfully. Nov 01 12:27:16 devstack sudo[96989]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:16 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-10e07b43-14f1-42c4-8e9a-81147ae446ee tempest-SnapshotsActionsTest-1207636017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-96a340ff-bc46-488b-a48d-d4848e67facd" returned: 0 in 0.679s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:16 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-10e07b43-14f1-42c4-8e9a-81147ae446ee tempest-SnapshotsActionsTest-1207636017 None] Lock "cinder-quobyte-96a340ff-bc46-488b-a48d-d4848e67facd" released by "delete_volume" :: held 1.470s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:27:16 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-10e07b43-14f1-42c4-8e9a-81147ae446ee tempest-SnapshotsActionsTest-1207636017 None] Created reservations ['ffdfd404-73d0-4131-b32b-8fdd97daa235', 'b964f3fe-f9d9-4435-8d1a-b15e451f9004', 'c9de560d-8baf-47e7-aa63-d4859b8929c9', '56d54fa9-bae3-46a3-be54-f6f72d957908'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:27:16 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-10e07b43-14f1-42c4-8e9a-81147ae446ee tempest-SnapshotsActionsTest-1207636017 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:27:16 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-10e07b43-14f1-42c4-8e9a-81147ae446ee tempest-SnapshotsActionsTest-1207636017 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:27:16 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-10e07b43-14f1-42c4-8e9a-81147ae446ee tempest-SnapshotsActionsTest-1207636017 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:27:16 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-10e07b43-14f1-42c4-8e9a-81147ae446ee tempest-SnapshotsActionsTest-1207636017 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:27:16 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-10e07b43-14f1-42c4-8e9a-81147ae446ee tempest-SnapshotsActionsTest-1207636017 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:27:16 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-10e07b43-14f1-42c4-8e9a-81147ae446ee tempest-SnapshotsActionsTest-1207636017 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:17 devstack sudo[97041]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:27:17 devstack sudo[97041]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:17 devstack sudo[97041]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:17 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-10e07b43-14f1-42c4-8e9a-81147ae446ee tempest-SnapshotsActionsTest-1207636017 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.379s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:17 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-10e07b43-14f1-42c4-8e9a-81147ae446ee tempest-SnapshotsActionsTest-1207636017 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:27:17 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-10e07b43-14f1-42c4-8e9a-81147ae446ee tempest-SnapshotsActionsTest-1207636017 None] Deleted volume successfully. Nov 01 12:27:17 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-10e07b43-14f1-42c4-8e9a-81147ae446ee tempest-SnapshotsActionsTest-1207636017 None] Lock "cinder-96a340ff-bc46-488b-a48d-d4848e67facd-delete_volume" released by "delete_volume" :: held 2.221s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:27:17 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-0c4725aa-57b8-4f5b-9044-43f164996d41 tempest-GroupSnapshotsV319Test-112737702 None] GroupSnapshot ba816ca4-097c-4438-80be-227499b02a4a: creating. Nov 01 12:27:17 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0c4725aa-57b8-4f5b-9044-43f164996d41 tempest-GroupSnapshotsV319Test-112737702 None] Group snapshot ba816ca4-097c-4438-80be-227499b02a4a: creating. {{(pid=86574) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4175}} Nov 01 12:27:18 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0c4725aa-57b8-4f5b-9044-43f164996d41 tempest-GroupSnapshotsV319Test-112737702 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:27:18 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0c4725aa-57b8-4f5b-9044-43f164996d41 tempest-GroupSnapshotsV319Test-112737702 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:27:18 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-0c4725aa-57b8-4f5b-9044-43f164996d41 tempest-GroupSnapshotsV319Test-112737702 None] Creating offline snapshot 1a44bac2-208d-43b0-aa98-b6d2eeb77d7b of volume e008861e-f7a1-4a67-823c-417cbb74fcf3 {{(pid=86574) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:27:18 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[00dbc978-4150-406e-bece-176acb480c91]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:27:18 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0c4725aa-57b8-4f5b-9044-43f164996d41 tempest-GroupSnapshotsV319Test-112737702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e008861e-f7a1-4a67-823c-417cbb74fcf3 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:18 devstack sudo[97053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e008861e-f7a1-4a67-823c-417cbb74fcf3 Nov 01 12:27:18 devstack sudo[97053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:18 devstack sudo[97053]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:18 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0c4725aa-57b8-4f5b-9044-43f164996d41 tempest-GroupSnapshotsV319Test-112737702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e008861e-f7a1-4a67-823c-417cbb74fcf3" returned: 0 in 0.747s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:18 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0c4725aa-57b8-4f5b-9044-43f164996d41 tempest-GroupSnapshotsV319Test-112737702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e008861e-f7a1-4a67-823c-417cbb74fcf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e008861e-f7a1-4a67-823c-417cbb74fcf3.1a44bac2-208d-43b0-aa98-b6d2eeb77d7b 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:18 devstack sudo[97060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e008861e-f7a1-4a67-823c-417cbb74fcf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e008861e-f7a1-4a67-823c-417cbb74fcf3.1a44bac2-208d-43b0-aa98-b6d2eeb77d7b 1G Nov 01 12:27:18 devstack sudo[97060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:19 devstack sudo[97060]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:19 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0c4725aa-57b8-4f5b-9044-43f164996d41 tempest-GroupSnapshotsV319Test-112737702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e008861e-f7a1-4a67-823c-417cbb74fcf3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e008861e-f7a1-4a67-823c-417cbb74fcf3.1a44bac2-208d-43b0-aa98-b6d2eeb77d7b 1G" returned: 0 in 0.819s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:19 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0c4725aa-57b8-4f5b-9044-43f164996d41 tempest-GroupSnapshotsV319Test-112737702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e008861e-f7a1-4a67-823c-417cbb74fcf3 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e008861e-f7a1-4a67-823c-417cbb74fcf3.1a44bac2-208d-43b0-aa98-b6d2eeb77d7b {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:19 devstack sudo[97067]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e008861e-f7a1-4a67-823c-417cbb74fcf3 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e008861e-f7a1-4a67-823c-417cbb74fcf3.1a44bac2-208d-43b0-aa98-b6d2eeb77d7b Nov 01 12:27:19 devstack sudo[97067]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:20 devstack sudo[97067]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0c4725aa-57b8-4f5b-9044-43f164996d41 tempest-GroupSnapshotsV319Test-112737702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-e008861e-f7a1-4a67-823c-417cbb74fcf3 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e008861e-f7a1-4a67-823c-417cbb74fcf3.1a44bac2-208d-43b0-aa98-b6d2eeb77d7b" returned: 0 in 0.505s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:20 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-0c4725aa-57b8-4f5b-9044-43f164996d41 tempest-GroupSnapshotsV319Test-112737702 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e008861e-f7a1-4a67-823c-417cbb74fcf3.1a44bac2-208d-43b0-aa98-b6d2eeb77d7b is being set with open permissions: ugo+rw: NotImplementedError Nov 01 12:27:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0c4725aa-57b8-4f5b-9044-43f164996d41 tempest-GroupSnapshotsV319Test-112737702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e008861e-f7a1-4a67-823c-417cbb74fcf3.1a44bac2-208d-43b0-aa98-b6d2eeb77d7b {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:20 devstack sudo[97073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e008861e-f7a1-4a67-823c-417cbb74fcf3.1a44bac2-208d-43b0-aa98-b6d2eeb77d7b Nov 01 12:27:20 devstack sudo[97073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:20 devstack sudo[97073]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0c4725aa-57b8-4f5b-9044-43f164996d41 tempest-GroupSnapshotsV319Test-112737702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e008861e-f7a1-4a67-823c-417cbb74fcf3.1a44bac2-208d-43b0-aa98-b6d2eeb77d7b" returned: 0 in 0.371s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0c4725aa-57b8-4f5b-9044-43f164996d41 tempest-GroupSnapshotsV319Test-112737702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e008861e-f7a1-4a67-823c-417cbb74fcf3.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:20 devstack sudo[97076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e008861e-f7a1-4a67-823c-417cbb74fcf3.info Nov 01 12:27:20 devstack sudo[97076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:20 devstack sudo[97076]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0c4725aa-57b8-4f5b-9044-43f164996d41 tempest-GroupSnapshotsV319Test-112737702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e008861e-f7a1-4a67-823c-417cbb74fcf3.info" returned: 0 in 0.370s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:20 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-0c4725aa-57b8-4f5b-9044-43f164996d41 tempest-GroupSnapshotsV319Test-112737702 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e008861e-f7a1-4a67-823c-417cbb74fcf3.info is being set with open permissions: ugo+rw: NotImplementedError Nov 01 12:27:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0c4725aa-57b8-4f5b-9044-43f164996d41 tempest-GroupSnapshotsV319Test-112737702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e008861e-f7a1-4a67-823c-417cbb74fcf3.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:21 devstack sudo[97079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e008861e-f7a1-4a67-823c-417cbb74fcf3.info Nov 01 12:27:21 devstack sudo[97079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:21 devstack sudo[97079]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0c4725aa-57b8-4f5b-9044-43f164996d41 tempest-GroupSnapshotsV319Test-112737702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e008861e-f7a1-4a67-823c-417cbb74fcf3.info" returned: 0 in 0.332s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0c4725aa-57b8-4f5b-9044-43f164996d41 tempest-GroupSnapshotsV319Test-112737702 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.320s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:27:21 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:SELECT=153,cinder:UPDATE=189,cinder:INSERT=53,cinder:DELETE=10 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:27:21 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:SELECT=172,cinder:UPDATE=169,cinder:INSERT=48,cinder:DELETE=14 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:27:21 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-0c4725aa-57b8-4f5b-9044-43f164996d41 tempest-GroupSnapshotsV319Test-112737702 None] group_snapshot ba816ca4-097c-4438-80be-227499b02a4a: created successfully Nov 01 12:27:23 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-71de925e-7b06-46fa-be63-aa25c4d8fcdf tempest-GroupSnapshotsV319Test-112737702 None] group_snapshot ba816ca4-097c-4438-80be-227499b02a4a: deleting Nov 01 12:27:23 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-71de925e-7b06-46fa-be63-aa25c4d8fcdf tempest-GroupSnapshotsV319Test-112737702 None] group_snapshot ba816ca4-097c-4438-80be-227499b02a4a: deleting {{(pid=86574) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4350}} Nov 01 12:27:23 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-71de925e-7b06-46fa-be63-aa25c4d8fcdf tempest-GroupSnapshotsV319Test-112737702 None] Acquiring lock "cinder-quobyte-e008861e-f7a1-4a67-823c-417cbb74fcf3" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:27:23 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-71de925e-7b06-46fa-be63-aa25c4d8fcdf tempest-GroupSnapshotsV319Test-112737702 None] Lock "cinder-quobyte-e008861e-f7a1-4a67-823c-417cbb74fcf3" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:27:23 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-71de925e-7b06-46fa-be63-aa25c4d8fcdf tempest-GroupSnapshotsV319Test-112737702 None] Acquiring lock "cinder-quobyte-1a44bac2-208d-43b0-aa98-b6d2eeb77d7b" by "_delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:27:23 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-71de925e-7b06-46fa-be63-aa25c4d8fcdf tempest-GroupSnapshotsV319Test-112737702 None] Lock "cinder-quobyte-1a44bac2-208d-43b0-aa98-b6d2eeb77d7b" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:27:23 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-71de925e-7b06-46fa-be63-aa25c4d8fcdf tempest-GroupSnapshotsV319Test-112737702 None] Deleting offline snapshot 1a44bac2-208d-43b0-aa98-b6d2eeb77d7b of volume e008861e-f7a1-4a67-823c-417cbb74fcf3 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:27:23 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-71de925e-7b06-46fa-be63-aa25c4d8fcdf tempest-GroupSnapshotsV319Test-112737702 None] snapshot_file for this snap is: volume-e008861e-f7a1-4a67-823c-417cbb74fcf3.1a44bac2-208d-43b0-aa98-b6d2eeb77d7b {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:27:23 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[209ab23b-6b28-4297-b0c3-b1496ac27a51]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:27:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-71de925e-7b06-46fa-be63-aa25c4d8fcdf tempest-GroupSnapshotsV319Test-112737702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e008861e-f7a1-4a67-823c-417cbb74fcf3.1a44bac2-208d-43b0-aa98-b6d2eeb77d7b {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:23 devstack sudo[97106]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e008861e-f7a1-4a67-823c-417cbb74fcf3.1a44bac2-208d-43b0-aa98-b6d2eeb77d7b Nov 01 12:27:23 devstack sudo[97106]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:24 devstack sudo[97106]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-71de925e-7b06-46fa-be63-aa25c4d8fcdf tempest-GroupSnapshotsV319Test-112737702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e008861e-f7a1-4a67-823c-417cbb74fcf3.1a44bac2-208d-43b0-aa98-b6d2eeb77d7b" returned: 0 in 0.454s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:24 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-71de925e-7b06-46fa-be63-aa25c4d8fcdf tempest-GroupSnapshotsV319Test-112737702 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-e008861e-f7a1-4a67-823c-417cbb74fcf3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:27:24 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[48e2ec64-a8f4-4d34-ac57-46aa7601d51e]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:27:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-71de925e-7b06-46fa-be63-aa25c4d8fcdf tempest-GroupSnapshotsV319Test-112737702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e008861e-f7a1-4a67-823c-417cbb74fcf3 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:24 devstack sudo[97112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e008861e-f7a1-4a67-823c-417cbb74fcf3 Nov 01 12:27:24 devstack sudo[97112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:24 devstack sudo[97112]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-71de925e-7b06-46fa-be63-aa25c4d8fcdf tempest-GroupSnapshotsV319Test-112737702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e008861e-f7a1-4a67-823c-417cbb74fcf3" returned: 0 in 0.571s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-71de925e-7b06-46fa-be63-aa25c4d8fcdf tempest-GroupSnapshotsV319Test-112737702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e008861e-f7a1-4a67-823c-417cbb74fcf3.1a44bac2-208d-43b0-aa98-b6d2eeb77d7b {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:24 devstack sudo[97117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e008861e-f7a1-4a67-823c-417cbb74fcf3.1a44bac2-208d-43b0-aa98-b6d2eeb77d7b Nov 01 12:27:24 devstack sudo[97117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:25 devstack sudo[97117]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-71de925e-7b06-46fa-be63-aa25c4d8fcdf tempest-GroupSnapshotsV319Test-112737702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e008861e-f7a1-4a67-823c-417cbb74fcf3.1a44bac2-208d-43b0-aa98-b6d2eeb77d7b" returned: 0 in 0.445s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-71de925e-7b06-46fa-be63-aa25c4d8fcdf tempest-GroupSnapshotsV319Test-112737702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e008861e-f7a1-4a67-823c-417cbb74fcf3.1a44bac2-208d-43b0-aa98-b6d2eeb77d7b {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:25 devstack sudo[97122]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e008861e-f7a1-4a67-823c-417cbb74fcf3.1a44bac2-208d-43b0-aa98-b6d2eeb77d7b Nov 01 12:27:25 devstack sudo[97122]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:25 devstack sudo[97122]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-71de925e-7b06-46fa-be63-aa25c4d8fcdf tempest-GroupSnapshotsV319Test-112737702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e008861e-f7a1-4a67-823c-417cbb74fcf3.1a44bac2-208d-43b0-aa98-b6d2eeb77d7b" returned: 0 in 0.361s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:25 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-71de925e-7b06-46fa-be63-aa25c4d8fcdf tempest-GroupSnapshotsV319Test-112737702 None] Lock "cinder-quobyte-1a44bac2-208d-43b0-aa98-b6d2eeb77d7b" released by "_delete_snapshot" :: held 1.986s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:27:25 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-71de925e-7b06-46fa-be63-aa25c4d8fcdf tempest-GroupSnapshotsV319Test-112737702 None] Lock "cinder-quobyte-e008861e-f7a1-4a67-823c-417cbb74fcf3" released by "delete_snapshot" :: held 2.029s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:27:25 devstack cinder-volume[86574]: WARNING cinder.quota [None req-71de925e-7b06-46fa-be63-aa25c4d8fcdf tempest-GroupSnapshotsV319Test-112737702 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1208346243 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1208346243, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:27:25 devstack cinder-volume[86574]: WARNING cinder.quota [None req-71de925e-7b06-46fa-be63-aa25c4d8fcdf tempest-GroupSnapshotsV319Test-112737702 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1208346243 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1208346243, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:27:25 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-71de925e-7b06-46fa-be63-aa25c4d8fcdf tempest-GroupSnapshotsV319Test-112737702 None] Created reservations ['a161e72a-4c3c-4271-84ad-7f55207855ed', '43df4aac-d3a0-4fc7-b04e-b909d861c0ac', '6f6c2f0a-e733-44fd-9967-8418ae0a1139', '56d161a9-fa31-4840-bae1-ac0acc5de919'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:27:26 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-71de925e-7b06-46fa-be63-aa25c4d8fcdf tempest-GroupSnapshotsV319Test-112737702 None] group_snapshot ba816ca4-097c-4438-80be-227499b02a4a: deleted successfully Nov 01 12:27:27 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0921e7b1-1178-47f0-93f4-c7366684ece6 tempest-GroupSnapshotsV319Test-112737702 None] Acquiring lock "cinder-quobyte-e008861e-f7a1-4a67-823c-417cbb74fcf3" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:27:27 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0921e7b1-1178-47f0-93f4-c7366684ece6 tempest-GroupSnapshotsV319Test-112737702 None] Lock "cinder-quobyte-e008861e-f7a1-4a67-823c-417cbb74fcf3" acquired by "delete_volume" :: waited 0.019s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:27:27 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6846ada-c3a5-4ceb-8740-0a4c054f87c3]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:27:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0921e7b1-1178-47f0-93f4-c7366684ece6 tempest-GroupSnapshotsV319Test-112737702 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e008861e-f7a1-4a67-823c-417cbb74fcf3 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:27 devstack sudo[97126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e008861e-f7a1-4a67-823c-417cbb74fcf3 Nov 01 12:27:27 devstack sudo[97126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:28 devstack sudo[97126]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0921e7b1-1178-47f0-93f4-c7366684ece6 tempest-GroupSnapshotsV319Test-112737702 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e008861e-f7a1-4a67-823c-417cbb74fcf3" returned: 0 in 0.591s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0921e7b1-1178-47f0-93f4-c7366684ece6 tempest-GroupSnapshotsV319Test-112737702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e008861e-f7a1-4a67-823c-417cbb74fcf3 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:28 devstack sudo[97133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e008861e-f7a1-4a67-823c-417cbb74fcf3 Nov 01 12:27:28 devstack sudo[97133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:28 devstack sudo[97133]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0921e7b1-1178-47f0-93f4-c7366684ece6 tempest-GroupSnapshotsV319Test-112737702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e008861e-f7a1-4a67-823c-417cbb74fcf3" returned: 0 in 0.322s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:28 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0921e7b1-1178-47f0-93f4-c7366684ece6 tempest-GroupSnapshotsV319Test-112737702 None] Lock "cinder-quobyte-e008861e-f7a1-4a67-823c-417cbb74fcf3" released by "delete_volume" :: held 1.018s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:27:28 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-0921e7b1-1178-47f0-93f4-c7366684ece6 tempest-GroupSnapshotsV319Test-112737702 None] Created reservations ['7e6cc723-6e08-4392-8151-9fc1401e30d5'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:27:28 devstack cinder-volume[86574]: WARNING cinder.quota [None req-0921e7b1-1178-47f0-93f4-c7366684ece6 tempest-GroupSnapshotsV319Test-112737702 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1208346243 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1208346243, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:27:28 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-0921e7b1-1178-47f0-93f4-c7366684ece6 tempest-GroupSnapshotsV319Test-112737702 None] Created reservations ['2dbd89b0-ad07-461b-bd92-57d6387908b2', '7d20e16c-e928-492d-971a-83c2e2e4015f', '9b8986ff-e49e-4519-a242-7f572326c12c', 'f08d2734-d35a-462c-ab8e-d0dbf3e18f1c'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:27:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0921e7b1-1178-47f0-93f4-c7366684ece6 tempest-GroupSnapshotsV319Test-112737702 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:27:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0921e7b1-1178-47f0-93f4-c7366684ece6 tempest-GroupSnapshotsV319Test-112737702 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:27:28 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-0921e7b1-1178-47f0-93f4-c7366684ece6 tempest-GroupSnapshotsV319Test-112737702 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:27:28 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-0921e7b1-1178-47f0-93f4-c7366684ece6 tempest-GroupSnapshotsV319Test-112737702 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:27:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0921e7b1-1178-47f0-93f4-c7366684ece6 tempest-GroupSnapshotsV319Test-112737702 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:27:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0921e7b1-1178-47f0-93f4-c7366684ece6 tempest-GroupSnapshotsV319Test-112737702 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:28 devstack sudo[97137]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:27:28 devstack sudo[97137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:28 devstack sudo[97137]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0921e7b1-1178-47f0-93f4-c7366684ece6 tempest-GroupSnapshotsV319Test-112737702 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.286s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:28 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-0921e7b1-1178-47f0-93f4-c7366684ece6 tempest-GroupSnapshotsV319Test-112737702 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:27:28 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-0921e7b1-1178-47f0-93f4-c7366684ece6 tempest-GroupSnapshotsV319Test-112737702 None] Delete group completed successfully. Nov 01 12:27:37 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-2843cf24-5338-4946-b43e-6c1b6ee6bf8d tempest-VolumesNegativeTest-789353155 None] Acquiring lock "cinder-3270c195-0594-470b-8d68-2d138e427bb1-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:27:37 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-2843cf24-5338-4946-b43e-6c1b6ee6bf8d tempest-VolumesNegativeTest-789353155 None] Lock "cinder-3270c195-0594-470b-8d68-2d138e427bb1-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:27:38 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-2843cf24-5338-4946-b43e-6c1b6ee6bf8d tempest-VolumesNegativeTest-789353155 None] Acquiring lock "cinder-quobyte-3270c195-0594-470b-8d68-2d138e427bb1" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:27:38 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-2843cf24-5338-4946-b43e-6c1b6ee6bf8d tempest-VolumesNegativeTest-789353155 None] Lock "cinder-quobyte-3270c195-0594-470b-8d68-2d138e427bb1" acquired by "delete_volume" :: waited 0.029s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:27:38 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[44f5c40e-7080-47da-a800-3f9ed4c17fd1]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:27:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2843cf24-5338-4946-b43e-6c1b6ee6bf8d tempest-VolumesNegativeTest-789353155 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3270c195-0594-470b-8d68-2d138e427bb1 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:38 devstack sudo[97271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3270c195-0594-470b-8d68-2d138e427bb1 Nov 01 12:27:38 devstack sudo[97271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:38 devstack sudo[97271]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2843cf24-5338-4946-b43e-6c1b6ee6bf8d tempest-VolumesNegativeTest-789353155 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3270c195-0594-470b-8d68-2d138e427bb1" returned: 0 in 0.659s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2843cf24-5338-4946-b43e-6c1b6ee6bf8d tempest-VolumesNegativeTest-789353155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3270c195-0594-470b-8d68-2d138e427bb1 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:38 devstack sudo[97276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3270c195-0594-470b-8d68-2d138e427bb1 Nov 01 12:27:38 devstack sudo[97276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:39 devstack sudo[97276]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2843cf24-5338-4946-b43e-6c1b6ee6bf8d tempest-VolumesNegativeTest-789353155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3270c195-0594-470b-8d68-2d138e427bb1" returned: 0 in 0.504s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:39 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-2843cf24-5338-4946-b43e-6c1b6ee6bf8d tempest-VolumesNegativeTest-789353155 None] Lock "cinder-quobyte-3270c195-0594-470b-8d68-2d138e427bb1" released by "delete_volume" :: held 1.263s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:27:39 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-2843cf24-5338-4946-b43e-6c1b6ee6bf8d tempest-VolumesNegativeTest-789353155 None] Created reservations ['88236dbf-b447-4235-a130-0174008f9d85', '30287f25-d9c6-4897-a0eb-e42d5376e554', '31f2c2df-495f-457a-8a90-e0851c5ec230', 'a8197cee-ceaf-47ec-af1c-d201c2643795'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:27:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-2843cf24-5338-4946-b43e-6c1b6ee6bf8d tempest-VolumesNegativeTest-789353155 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:27:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-2843cf24-5338-4946-b43e-6c1b6ee6bf8d tempest-VolumesNegativeTest-789353155 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:27:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-2843cf24-5338-4946-b43e-6c1b6ee6bf8d tempest-VolumesNegativeTest-789353155 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:27:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-2843cf24-5338-4946-b43e-6c1b6ee6bf8d tempest-VolumesNegativeTest-789353155 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:27:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-2843cf24-5338-4946-b43e-6c1b6ee6bf8d tempest-VolumesNegativeTest-789353155 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:27:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2843cf24-5338-4946-b43e-6c1b6ee6bf8d tempest-VolumesNegativeTest-789353155 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:39 devstack sudo[97279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:27:39 devstack sudo[97279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:39 devstack cinder-volume[86574]: DEBUG oslo_service.periodic_task [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86574) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:27:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:27:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:27:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:27:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:27:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:27:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:39 devstack sudo[97288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:27:39 devstack sudo[97288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:40 devstack sudo[97279]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2843cf24-5338-4946-b43e-6c1b6ee6bf8d tempest-VolumesNegativeTest-789353155 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.479s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:40 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-2843cf24-5338-4946-b43e-6c1b6ee6bf8d tempest-VolumesNegativeTest-789353155 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:27:40 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-2843cf24-5338-4946-b43e-6c1b6ee6bf8d tempest-VolumesNegativeTest-789353155 None] Deleted volume successfully. Nov 01 12:27:40 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-2843cf24-5338-4946-b43e-6c1b6ee6bf8d tempest-VolumesNegativeTest-789353155 None] Lock "cinder-3270c195-0594-470b-8d68-2d138e427bb1-delete_volume" released by "delete_volume" :: held 2.239s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:27:40 devstack sudo[97288]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.460s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:40 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:27:40 devstack cinder-volume[86574]: DEBUG oslo_service.periodic_task [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running periodic task VolumeManager._thread_info {{(pid=86574) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:27:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] thread count: 28 {{(pid=86574) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 12:27:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] thread info: [<_MainThread(MainThread, started 131331184930944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86574) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 12:27:41 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-1f5bc8ea-a201-4c64-bfd2-b6dcf2ba6bfc tempest-GroupsV314Test-907585005 None] Group tempest-GroupsV314Test-Group-1182566778: creating Nov 01 12:27:41 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-1f5bc8ea-a201-4c64-bfd2-b6dcf2ba6bfc tempest-GroupsV314Test-907585005 None] Group tempest-GroupsV314Test-Group-1182566778: created successfully Nov 01 12:27:41 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-1f5bc8ea-a201-4c64-bfd2-b6dcf2ba6bfc tempest-GroupsV314Test-907585005 None] Create group completed successfully. Nov 01 12:27:43 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-20dc415b-2867-45bd-aedb-007b01e94d48 tempest-GroupsV314Test-907585005 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:27:43 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-20dc415b-2867-45bd-aedb-007b01e94d48 tempest-GroupsV314Test-907585005 None] Flow 'volume_create_manager' (374091ce-b35c-4e09-95d8-ed712cce7f89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:27:43 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-20dc415b-2867-45bd-aedb-007b01e94d48 tempest-GroupsV314Test-907585005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8812e95b-fa36-4d43-944b-28b5709c89fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:43 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-20dc415b-2867-45bd-aedb-007b01e94d48 tempest-GroupsV314Test-907585005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8812e95b-fa36-4d43-944b-28b5709c89fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-685861723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=012f89ec-4e8a-4e7c-938a-e2053681c04c,host='devstack@QuobyteHD#QuobyteHD',id=b9d51b2e-f396-4094-a548-38976fdececf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c02b2bb5cd54d16a4aa0978b1fdb804',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:27:43Z,use_quota=True,user_id='e3296d985a5e4ca3b7e7c7bfc81771ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b8f10c-07b5-431f-8e9b-23c6502a1dac),volume_type_id=62b8f10c-07b5-431f-8e9b-23c6502a1dac)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:43 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-20dc415b-2867-45bd-aedb-007b01e94d48 tempest-GroupsV314Test-907585005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b48ef81-6968-42c7-bae3-c53476735d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:43 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-20dc415b-2867-45bd-aedb-007b01e94d48 tempest-GroupsV314Test-907585005 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5b48ef81-6968-42c7-bae3-c53476735d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:43 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-20dc415b-2867-45bd-aedb-007b01e94d48 tempest-GroupsV314Test-907585005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc707d0d-0799-4d36-8cf3-b48719d878e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:43 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-20dc415b-2867-45bd-aedb-007b01e94d48 tempest-GroupsV314Test-907585005 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bc707d0d-0799-4d36-8cf3-b48719d878e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b9d51b2e-f396-4094-a548-38976fdececf', 'volume_name': 'volume-b9d51b2e-f396-4094-a548-38976fdececf', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:43 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-20dc415b-2867-45bd-aedb-007b01e94d48 tempest-GroupsV314Test-907585005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ffd1acb-d996-4f6f-bc9a-e2554ae28124) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:43 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-20dc415b-2867-45bd-aedb-007b01e94d48 tempest-GroupsV314Test-907585005 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7ffd1acb-d996-4f6f-bc9a-e2554ae28124) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:43 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-20dc415b-2867-45bd-aedb-007b01e94d48 tempest-GroupsV314Test-907585005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25575622-cba6-4c44-b60a-e15dfa63c0a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:43 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-20dc415b-2867-45bd-aedb-007b01e94d48 tempest-GroupsV314Test-907585005 None] Volume b9d51b2e-f396-4094-a548-38976fdececf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b9d51b2e-f396-4094-a548-38976fdececf', 'volume_size': 1} Nov 01 12:27:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-20dc415b-2867-45bd-aedb-007b01e94d48 tempest-GroupsV314Test-907585005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:27:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-20dc415b-2867-45bd-aedb-007b01e94d48 tempest-GroupsV314Test-907585005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:27:43 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-20dc415b-2867-45bd-aedb-007b01e94d48 tempest-GroupsV314Test-907585005 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=012f89ec-4e8a-4e7c-938a-e2053681c04c,created_at=2026-11-01T11:27:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-685861723',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=012f89ec-4e8a-4e7c-938a-e2053681c04c,host='devstack@QuobyteHD#QuobyteHD',id=b9d51b2e-f396-4094-a548-38976fdececf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0c02b2bb5cd54d16a4aa0978b1fdb804',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:27:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:27:43Z,use_quota=True,user_id='e3296d985a5e4ca3b7e7c7bfc81771ce',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(62b8f10c-07b5-431f-8e9b-23c6502a1dac),volume_type_id=62b8f10c-07b5-431f-8e9b-23c6502a1dac)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:27:43 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-20dc415b-2867-45bd-aedb-007b01e94d48 tempest-GroupsV314Test-907585005 None] Creating volume b9d51b2e-f396-4094-a548-38976fdececf {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:27:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-20dc415b-2867-45bd-aedb-007b01e94d48 tempest-GroupsV314Test-907585005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:27:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-20dc415b-2867-45bd-aedb-007b01e94d48 tempest-GroupsV314Test-907585005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:27:43 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-20dc415b-2867-45bd-aedb-007b01e94d48 tempest-GroupsV314Test-907585005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:27:43 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-20dc415b-2867-45bd-aedb-007b01e94d48 tempest-GroupsV314Test-907585005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:27:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-20dc415b-2867-45bd-aedb-007b01e94d48 tempest-GroupsV314Test-907585005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:27:43 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-20dc415b-2867-45bd-aedb-007b01e94d48 tempest-GroupsV314Test-907585005 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:27:43 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-20dc415b-2867-45bd-aedb-007b01e94d48 tempest-GroupsV314Test-907585005 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:27:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-20dc415b-2867-45bd-aedb-007b01e94d48 tempest-GroupsV314Test-907585005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:43 devstack sudo[97294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf 1073741824 Nov 01 12:27:43 devstack sudo[97294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:44 devstack sudo[97294]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-20dc415b-2867-45bd-aedb-007b01e94d48 tempest-GroupsV314Test-907585005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf 1073741824" returned: 0 in 0.518s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-20dc415b-2867-45bd-aedb-007b01e94d48 tempest-GroupsV314Test-907585005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:44 devstack sudo[97300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf Nov 01 12:27:44 devstack sudo[97300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:44 devstack sudo[97300]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-20dc415b-2867-45bd-aedb-007b01e94d48 tempest-GroupsV314Test-907585005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf" returned: 0 in 0.298s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:44 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-20dc415b-2867-45bd-aedb-007b01e94d48 tempest-GroupsV314Test-907585005 None] <== create_volume: return (885ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:27:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-20dc415b-2867-45bd-aedb-007b01e94d48 tempest-GroupsV314Test-907585005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.888s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:27:44 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-20dc415b-2867-45bd-aedb-007b01e94d48 tempest-GroupsV314Test-907585005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25575622-cba6-4c44-b60a-e15dfa63c0a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b9d51b2e-f396-4094-a548-38976fdececf', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:44 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-20dc415b-2867-45bd-aedb-007b01e94d48 tempest-GroupsV314Test-907585005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1c9fdf7-2952-4da1-8f23-e95bcc6e3efd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:44 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-20dc415b-2867-45bd-aedb-007b01e94d48 tempest-GroupsV314Test-907585005 None] Volume volume-b9d51b2e-f396-4094-a548-38976fdececf (b9d51b2e-f396-4094-a548-38976fdececf): created successfully Nov 01 12:27:44 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-20dc415b-2867-45bd-aedb-007b01e94d48 tempest-GroupsV314Test-907585005 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1c9fdf7-2952-4da1-8f23-e95bcc6e3efd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:44 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-20dc415b-2867-45bd-aedb-007b01e94d48 tempest-GroupsV314Test-907585005 None] Flow 'volume_create_manager' (374091ce-b35c-4e09-95d8-ed712cce7f89) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:27:44 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-20dc415b-2867-45bd-aedb-007b01e94d48 tempest-GroupsV314Test-907585005 None] Created volume successfully. Nov 01 12:27:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:27:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:27:45 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] Cloning volume b9d51b2e-f396-4094-a548-38976fdececf to volume aec003a9-7f3d-40bc-8314-aaffae480a39 Nov 01 12:27:45 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] Creating offline snapshot 2731f3ed-0641-4fd0-9106-9b82cc21a768 of volume b9d51b2e-f396-4094-a548-38976fdececf {{(pid=86574) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:27:45 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1835927-8246-478d-9c9c-44a7d4241928]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:27:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:45 devstack sudo[97303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf Nov 01 12:27:45 devstack sudo[97303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:46 devstack sudo[97303]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf" returned: 0 in 0.630s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf.2731f3ed-0641-4fd0-9106-9b82cc21a768 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:46 devstack sudo[97308]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf.2731f3ed-0641-4fd0-9106-9b82cc21a768 1G Nov 01 12:27:46 devstack sudo[97308]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:46 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-8bafad7c-3480-40bb-82f9-7f9a5d6c76ba tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:27:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8bafad7c-3480-40bb-82f9-7f9a5d6c76ba tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Flow 'volume_create_manager' (04b2bcbf-e275-4bbe-afa2-3ad71f4755de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:27:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8bafad7c-3480-40bb-82f9-7f9a5d6c76ba tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d337be1-2a9a-40ac-bdc2-2b6c1c50fd41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8bafad7c-3480-40bb-82f9-7f9a5d6c76ba tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0d337be1-2a9a-40ac-bdc2-2b6c1c50fd41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-714229801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae269714-5f4b-4e48-a734-330a72598aa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18526cfd138449b781793f7c23ceb754',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:27:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:27:47Z,use_quota=True,user_id='58e98b0372cd4ee7a76fc6b6dca798ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8bafad7c-3480-40bb-82f9-7f9a5d6c76ba tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0845186e-c17f-4cb0-ac7c-e2927cc5d724) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8bafad7c-3480-40bb-82f9-7f9a5d6c76ba tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0845186e-c17f-4cb0-ac7c-e2927cc5d724) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8bafad7c-3480-40bb-82f9-7f9a5d6c76ba tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af4952c7-8c3d-46f8-a2aa-6c01060cb5a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8bafad7c-3480-40bb-82f9-7f9a5d6c76ba tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (af4952c7-8c3d-46f8-a2aa-6c01060cb5a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ae269714-5f4b-4e48-a734-330a72598aa3', 'volume_name': 'volume-ae269714-5f4b-4e48-a734-330a72598aa3', 'volume_size': 2}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8bafad7c-3480-40bb-82f9-7f9a5d6c76ba tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b84e0b0-9a22-485e-b290-26809ebc1dfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8bafad7c-3480-40bb-82f9-7f9a5d6c76ba tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5b84e0b0-9a22-485e-b290-26809ebc1dfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:46 devstack sudo[97308]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8bafad7c-3480-40bb-82f9-7f9a5d6c76ba tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c71032d9-08a8-4218-b5d7-54387536a528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:46 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-8bafad7c-3480-40bb-82f9-7f9a5d6c76ba tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Volume ae269714-5f4b-4e48-a734-330a72598aa3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ae269714-5f4b-4e48-a734-330a72598aa3', 'volume_size': 2} Nov 01 12:27:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8bafad7c-3480-40bb-82f9-7f9a5d6c76ba tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:27:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf.2731f3ed-0641-4fd0-9106-9b82cc21a768 1G" returned: 0 in 0.576s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9d51b2e-f396-4094-a548-38976fdececf -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf.2731f3ed-0641-4fd0-9106-9b82cc21a768 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:46 devstack sudo[97314]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9d51b2e-f396-4094-a548-38976fdececf -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf.2731f3ed-0641-4fd0-9106-9b82cc21a768 Nov 01 12:27:46 devstack sudo[97314]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:47 devstack sudo[97314]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-b9d51b2e-f396-4094-a548-38976fdececf -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf.2731f3ed-0641-4fd0-9106-9b82cc21a768" returned: 0 in 0.325s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:47 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf.2731f3ed-0641-4fd0-9106-9b82cc21a768 is being set with open permissions: ugo+rw: NotImplementedError Nov 01 12:27:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf.2731f3ed-0641-4fd0-9106-9b82cc21a768 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:47 devstack sudo[97319]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf.2731f3ed-0641-4fd0-9106-9b82cc21a768 Nov 01 12:27:47 devstack sudo[97319]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:47 devstack sudo[97319]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf.2731f3ed-0641-4fd0-9106-9b82cc21a768" returned: 0 in 0.260s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:47 devstack sudo[97322]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf.info Nov 01 12:27:47 devstack sudo[97322]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:47 devstack sudo[97322]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf.info" returned: 0 in 0.327s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:47 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf.info is being set with open permissions: ugo+rw: NotImplementedError Nov 01 12:27:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:47 devstack sudo[97325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf.info Nov 01 12:27:47 devstack sudo[97325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:47 devstack sudo[97325]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf.info" returned: 0 in 0.277s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:48 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] Acquiring lock "cinder-quobyte-aec003a9-7f3d-40bc-8314-aaffae480a39" by "_copy_volume_from_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:27:48 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] Lock "cinder-quobyte-aec003a9-7f3d-40bc-8314-aaffae480a39" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:27:48 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] snapshot: 2731f3ed-0641-4fd0-9106-9b82cc21a768, volume: aec003a9-7f3d-40bc-8314-aaffae480a39, {{(pid=86574) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 01 12:27:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:27:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:27:48 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:27:48 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:27:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:27:48 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb915d24-ee5f-4611-999f-7e0464256bbe]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:27:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf.2731f3ed-0641-4fd0-9106-9b82cc21a768 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:48 devstack sudo[97329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf.2731f3ed-0641-4fd0-9106-9b82cc21a768 Nov 01 12:27:48 devstack sudo[97329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:48 devstack sudo[97329]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf.2731f3ed-0641-4fd0-9106-9b82cc21a768" returned: 0 in 0.485s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:48 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9d51b2e-f396-4094-a548-38976fdececf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:27:48 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[dfe3322d-6d29-45e8-8929-a01eff880c21]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:27:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:48 devstack sudo[97334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf Nov 01 12:27:48 devstack sudo[97334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:48 devstack sudo[97334]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf" returned: 0 in 0.396s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:48 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf {{(pid=86574) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 01 12:27:48 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] Creating direct copy from snapshot {{(pid=86574) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 01 12:27:49 devstack cinder-volume[86574]: DEBUG cinder.utils [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] Path /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-aec003a9-7f3d-40bc-8314-aaffae480a39 not found in is_blk_device check {{(pid=86574) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 01 12:27:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-aec003a9-7f3d-40bc-8314-aaffae480a39 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:49 devstack sudo[97339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-aec003a9-7f3d-40bc-8314-aaffae480a39 Nov 01 12:27:49 devstack sudo[97339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:56 devstack sudo[97339]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-aec003a9-7f3d-40bc-8314-aaffae480a39" returned: 0 in 7.741s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:56 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] Image conversion details: src /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf, size 1024.00 MB, duration 7.74 sec, destination /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-aec003a9-7f3d-40bc-8314-aaffae480a39 {{(pid=86574) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 12:27:56 devstack cinder-volume[86574]: INFO cinder.image.image_utils [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] Converted 1024.00 MB image at 132.26 MB/s Nov 01 12:27:56 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-aec003a9-7f3d-40bc-8314-aaffae480a39 is being set with open permissions: ugo+rw: NotImplementedError Nov 01 12:27:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-aec003a9-7f3d-40bc-8314-aaffae480a39 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:56 devstack sudo[97384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-aec003a9-7f3d-40bc-8314-aaffae480a39 Nov 01 12:27:56 devstack sudo[97384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:56 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-6bb78a74-698f-4981-9038-c2fe91679eba tempest-VolumeQuotasAdminTestJSON-931435341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:27:56 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6bb78a74-698f-4981-9038-c2fe91679eba tempest-VolumeQuotasAdminTestJSON-931435341 None] Flow 'volume_create_manager' (c3fbc3f6-449a-43f7-8d08-41ba564b921b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:27:56 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6bb78a74-698f-4981-9038-c2fe91679eba tempest-VolumeQuotasAdminTestJSON-931435341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07a7af67-a579-4fed-bcda-b9cc4be53c62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:56 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6bb78a74-698f-4981-9038-c2fe91679eba tempest-VolumeQuotasAdminTestJSON-931435341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (07a7af67-a579-4fed-bcda-b9cc4be53c62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:27:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-63945998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=854cfcc5-c6e9-497a-84bd-56918c016ffe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='674af3abae2645da9753caec1feb932d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:27:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:27:57Z,use_quota=True,user_id='93f0f85f11ee4c9b966f9513136698aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:56 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6bb78a74-698f-4981-9038-c2fe91679eba tempest-VolumeQuotasAdminTestJSON-931435341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0565043-f664-4481-be3e-1d9ed740daf8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:56 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6bb78a74-698f-4981-9038-c2fe91679eba tempest-VolumeQuotasAdminTestJSON-931435341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0565043-f664-4481-be3e-1d9ed740daf8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:56 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6bb78a74-698f-4981-9038-c2fe91679eba tempest-VolumeQuotasAdminTestJSON-931435341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26578f66-6a1f-4e47-bd78-a762fca275b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:56 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6bb78a74-698f-4981-9038-c2fe91679eba tempest-VolumeQuotasAdminTestJSON-931435341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (26578f66-6a1f-4e47-bd78-a762fca275b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '854cfcc5-c6e9-497a-84bd-56918c016ffe', 'volume_name': 'volume-854cfcc5-c6e9-497a-84bd-56918c016ffe', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:56 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6bb78a74-698f-4981-9038-c2fe91679eba tempest-VolumeQuotasAdminTestJSON-931435341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c17ab9a-527f-4bc8-9c75-1454c659ef07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:56 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6bb78a74-698f-4981-9038-c2fe91679eba tempest-VolumeQuotasAdminTestJSON-931435341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c17ab9a-527f-4bc8-9c75-1454c659ef07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:56 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6bb78a74-698f-4981-9038-c2fe91679eba tempest-VolumeQuotasAdminTestJSON-931435341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3d2214f-3de4-4c0e-b208-b75ea5592a3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:56 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-6bb78a74-698f-4981-9038-c2fe91679eba tempest-VolumeQuotasAdminTestJSON-931435341 None] Volume 854cfcc5-c6e9-497a-84bd-56918c016ffe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-854cfcc5-c6e9-497a-84bd-56918c016ffe', 'volume_size': 1} Nov 01 12:27:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-6bb78a74-698f-4981-9038-c2fe91679eba tempest-VolumeQuotasAdminTestJSON-931435341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:27:56 devstack sudo[97384]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-aec003a9-7f3d-40bc-8314-aaffae480a39" returned: 0 in 0.244s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:56 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] Lock "cinder-quobyte-aec003a9-7f3d-40bc-8314-aaffae480a39" released by "_copy_volume_from_snapshot" :: held 8.959s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:27:57 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] Acquiring lock "cinder-quobyte-2731f3ed-0641-4fd0-9106-9b82cc21a768" by "_delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:27:57 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] Lock "cinder-quobyte-2731f3ed-0641-4fd0-9106-9b82cc21a768" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:27:57 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] Deleting offline snapshot 2731f3ed-0641-4fd0-9106-9b82cc21a768 of volume b9d51b2e-f396-4094-a548-38976fdececf {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:27:57 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] snapshot_file for this snap is: volume-b9d51b2e-f396-4094-a548-38976fdececf.2731f3ed-0641-4fd0-9106-9b82cc21a768 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:27:57 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[30705b1e-8b1d-4ba0-84fb-2e27c11f86bb]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:27:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf.2731f3ed-0641-4fd0-9106-9b82cc21a768 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:57 devstack sudo[97387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf.2731f3ed-0641-4fd0-9106-9b82cc21a768 Nov 01 12:27:57 devstack sudo[97387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:57 devstack sudo[97387]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf.2731f3ed-0641-4fd0-9106-9b82cc21a768" returned: 0 in 0.384s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:57 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b9d51b2e-f396-4094-a548-38976fdececf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:27:57 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[80a75845-5c8e-44b2-b7cf-74552a3ce7c7]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:27:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:57 devstack sudo[97394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf Nov 01 12:27:57 devstack sudo[97394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:58 devstack sudo[97394]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf" returned: 0 in 0.550s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf.2731f3ed-0641-4fd0-9106-9b82cc21a768 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:58 devstack sudo[97400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf.2731f3ed-0641-4fd0-9106-9b82cc21a768 Nov 01 12:27:58 devstack sudo[97400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:58 devstack sudo[97400]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf.2731f3ed-0641-4fd0-9106-9b82cc21a768" returned: 0 in 0.354s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf.2731f3ed-0641-4fd0-9106-9b82cc21a768 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:58 devstack sudo[97405]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf.2731f3ed-0641-4fd0-9106-9b82cc21a768 Nov 01 12:27:58 devstack sudo[97405]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:58 devstack sudo[97405]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf.2731f3ed-0641-4fd0-9106-9b82cc21a768" returned: 0 in 0.273s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:58 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] Lock "cinder-quobyte-2731f3ed-0641-4fd0-9106-9b82cc21a768" released by "_delete_snapshot" :: held 1.676s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:27:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.229s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:27:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8bafad7c-3480-40bb-82f9-7f9a5d6c76ba tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.967s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:27:58 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-8bafad7c-3480-40bb-82f9-7f9a5d6c76ba tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:27:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-714229801',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ae269714-5f4b-4e48-a734-330a72598aa3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='18526cfd138449b781793f7c23ceb754',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:27:47Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:27:47Z,use_quota=True,user_id='58e98b0372cd4ee7a76fc6b6dca798ee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:27:58 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-8bafad7c-3480-40bb-82f9-7f9a5d6c76ba tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Creating volume ae269714-5f4b-4e48-a734-330a72598aa3 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:27:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8bafad7c-3480-40bb-82f9-7f9a5d6c76ba tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:27:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8bafad7c-3480-40bb-82f9-7f9a5d6c76ba tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:27:58 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-8bafad7c-3480-40bb-82f9-7f9a5d6c76ba tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:27:58 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-8bafad7c-3480-40bb-82f9-7f9a5d6c76ba tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:27:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8bafad7c-3480-40bb-82f9-7f9a5d6c76ba tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:27:58 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-8bafad7c-3480-40bb-82f9-7f9a5d6c76ba tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:27:58 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-8bafad7c-3480-40bb-82f9-7f9a5d6c76ba tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:27:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8bafad7c-3480-40bb-82f9-7f9a5d6c76ba tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ae269714-5f4b-4e48-a734-330a72598aa3 2147483648 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:58 devstack sudo[97408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ae269714-5f4b-4e48-a734-330a72598aa3 2147483648 Nov 01 12:27:58 devstack sudo[97408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:58 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-1efb449f-a3f6-4461-a3b7-631252512832 tempest-GroupsV314Test-907585005 None] Create group from source-group-012f89ec-4e8a-4e7c-938a-e2053681c04c completed successfully. Nov 01 12:27:59 devstack sudo[97408]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8bafad7c-3480-40bb-82f9-7f9a5d6c76ba tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ae269714-5f4b-4e48-a734-330a72598aa3 2147483648" returned: 0 in 0.509s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8bafad7c-3480-40bb-82f9-7f9a5d6c76ba tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ae269714-5f4b-4e48-a734-330a72598aa3 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:59 devstack sudo[97414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ae269714-5f4b-4e48-a734-330a72598aa3 Nov 01 12:27:59 devstack sudo[97414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:59 devstack sudo[97414]: pam_unix(sudo:session): session closed for user root Nov 01 12:27:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8bafad7c-3480-40bb-82f9-7f9a5d6c76ba tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ae269714-5f4b-4e48-a734-330a72598aa3" returned: 0 in 0.254s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:27:59 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-8bafad7c-3480-40bb-82f9-7f9a5d6c76ba tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] <== create_volume: return (806ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:27:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8bafad7c-3480-40bb-82f9-7f9a5d6c76ba tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.810s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:27:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-6bb78a74-698f-4981-9038-c2fe91679eba tempest-VolumeQuotasAdminTestJSON-931435341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.644s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:27:59 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-6bb78a74-698f-4981-9038-c2fe91679eba tempest-VolumeQuotasAdminTestJSON-931435341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:27:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-63945998',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=854cfcc5-c6e9-497a-84bd-56918c016ffe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='674af3abae2645da9753caec1feb932d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:27:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:27:57Z,use_quota=True,user_id='93f0f85f11ee4c9b966f9513136698aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:27:59 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-6bb78a74-698f-4981-9038-c2fe91679eba tempest-VolumeQuotasAdminTestJSON-931435341 None] Creating volume 854cfcc5-c6e9-497a-84bd-56918c016ffe {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:27:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-6bb78a74-698f-4981-9038-c2fe91679eba tempest-VolumeQuotasAdminTestJSON-931435341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:27:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-6bb78a74-698f-4981-9038-c2fe91679eba tempest-VolumeQuotasAdminTestJSON-931435341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:27:59 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-6bb78a74-698f-4981-9038-c2fe91679eba tempest-VolumeQuotasAdminTestJSON-931435341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:27:59 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-6bb78a74-698f-4981-9038-c2fe91679eba tempest-VolumeQuotasAdminTestJSON-931435341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:27:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-6bb78a74-698f-4981-9038-c2fe91679eba tempest-VolumeQuotasAdminTestJSON-931435341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:27:59 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-6bb78a74-698f-4981-9038-c2fe91679eba tempest-VolumeQuotasAdminTestJSON-931435341 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:27:59 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-6bb78a74-698f-4981-9038-c2fe91679eba tempest-VolumeQuotasAdminTestJSON-931435341 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:27:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6bb78a74-698f-4981-9038-c2fe91679eba tempest-VolumeQuotasAdminTestJSON-931435341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-854cfcc5-c6e9-497a-84bd-56918c016ffe 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:27:59 devstack sudo[97417]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-854cfcc5-c6e9-497a-84bd-56918c016ffe 1073741824 Nov 01 12:27:59 devstack sudo[97417]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:27:59 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8bafad7c-3480-40bb-82f9-7f9a5d6c76ba tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c71032d9-08a8-4218-b5d7-54387536a528) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ae269714-5f4b-4e48-a734-330a72598aa3', 'volume_size': 2}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:59 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8bafad7c-3480-40bb-82f9-7f9a5d6c76ba tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af8a4dfe-97db-4552-98d8-f2e0811c4717) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:27:59 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-8bafad7c-3480-40bb-82f9-7f9a5d6c76ba tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Volume volume-ae269714-5f4b-4e48-a734-330a72598aa3 (ae269714-5f4b-4e48-a734-330a72598aa3): created successfully Nov 01 12:27:59 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8bafad7c-3480-40bb-82f9-7f9a5d6c76ba tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (af8a4dfe-97db-4552-98d8-f2e0811c4717) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:27:59 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8bafad7c-3480-40bb-82f9-7f9a5d6c76ba tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Flow 'volume_create_manager' (04b2bcbf-e275-4bbe-afa2-3ad71f4755de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:27:59 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-8bafad7c-3480-40bb-82f9-7f9a5d6c76ba tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Created volume successfully. Nov 01 12:28:00 devstack sudo[97417]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6bb78a74-698f-4981-9038-c2fe91679eba tempest-VolumeQuotasAdminTestJSON-931435341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-854cfcc5-c6e9-497a-84bd-56918c016ffe 1073741824" returned: 0 in 0.525s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6bb78a74-698f-4981-9038-c2fe91679eba tempest-VolumeQuotasAdminTestJSON-931435341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-854cfcc5-c6e9-497a-84bd-56918c016ffe {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:00 devstack sudo[97423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-854cfcc5-c6e9-497a-84bd-56918c016ffe Nov 01 12:28:00 devstack sudo[97423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-2705265f-ca47-405e-8dc6-44b8025cc851 tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:00 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0db85975-0d94-485d-9936-3fe210e9b412 tempest-GroupsV314Test-907585005 None] Acquiring lock "cinder-quobyte-aec003a9-7f3d-40bc-8314-aaffae480a39" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:28:00 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0db85975-0d94-485d-9936-3fe210e9b412 tempest-GroupsV314Test-907585005 None] Lock "cinder-quobyte-aec003a9-7f3d-40bc-8314-aaffae480a39" acquired by "delete_volume" :: waited 0.018s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:28:00 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[e98b13c7-57fd-417c-9a69-41af3d642d4a]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:28:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0db85975-0d94-485d-9936-3fe210e9b412 tempest-GroupsV314Test-907585005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-aec003a9-7f3d-40bc-8314-aaffae480a39 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:00 devstack sudo[97423]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6bb78a74-698f-4981-9038-c2fe91679eba tempest-VolumeQuotasAdminTestJSON-931435341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-854cfcc5-c6e9-497a-84bd-56918c016ffe" returned: 0 in 0.304s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:00 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-6bb78a74-698f-4981-9038-c2fe91679eba tempest-VolumeQuotasAdminTestJSON-931435341 None] <== create_volume: return (875ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:28:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-6bb78a74-698f-4981-9038-c2fe91679eba tempest-VolumeQuotasAdminTestJSON-931435341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.878s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-2705265f-ca47-405e-8dc6-44b8025cc851 tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.222s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:00 devstack sudo[97425]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-aec003a9-7f3d-40bc-8314-aaffae480a39 Nov 01 12:28:00 devstack sudo[97425]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:00 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6bb78a74-698f-4981-9038-c2fe91679eba tempest-VolumeQuotasAdminTestJSON-931435341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d3d2214f-3de4-4c0e-b208-b75ea5592a3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-854cfcc5-c6e9-497a-84bd-56918c016ffe', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:00 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6bb78a74-698f-4981-9038-c2fe91679eba tempest-VolumeQuotasAdminTestJSON-931435341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9db4f96-aaea-444c-8fcc-dfae84e454f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:00 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-2705265f-ca47-405e-8dc6-44b8025cc851 tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Creating offline snapshot b5439955-dfc8-42fa-92b6-6fa5e3c6a056 of volume ae269714-5f4b-4e48-a734-330a72598aa3 {{(pid=86574) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:28:00 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-6bb78a74-698f-4981-9038-c2fe91679eba tempest-VolumeQuotasAdminTestJSON-931435341 None] Volume volume-854cfcc5-c6e9-497a-84bd-56918c016ffe (854cfcc5-c6e9-497a-84bd-56918c016ffe): created successfully Nov 01 12:28:00 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6bb78a74-698f-4981-9038-c2fe91679eba tempest-VolumeQuotasAdminTestJSON-931435341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c9db4f96-aaea-444c-8fcc-dfae84e454f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:00 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6bb78a74-698f-4981-9038-c2fe91679eba tempest-VolumeQuotasAdminTestJSON-931435341 None] Flow 'volume_create_manager' (c3fbc3f6-449a-43f7-8d08-41ba564b921b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:28:00 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1d33e8d-c9d6-4b48-9c92-2db5e53a8949]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:28:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2705265f-ca47-405e-8dc6-44b8025cc851 tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ae269714-5f4b-4e48-a734-330a72598aa3 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:00 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-6bb78a74-698f-4981-9038-c2fe91679eba tempest-VolumeQuotasAdminTestJSON-931435341 None] Created volume successfully. Nov 01 12:28:00 devstack sudo[97428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ae269714-5f4b-4e48-a734-330a72598aa3 Nov 01 12:28:00 devstack sudo[97428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:00 devstack sudo[97425]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0db85975-0d94-485d-9936-3fe210e9b412 tempest-GroupsV314Test-907585005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-aec003a9-7f3d-40bc-8314-aaffae480a39" returned: 0 in 0.379s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0db85975-0d94-485d-9936-3fe210e9b412 tempest-GroupsV314Test-907585005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-aec003a9-7f3d-40bc-8314-aaffae480a39 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:00 devstack sudo[97433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-aec003a9-7f3d-40bc-8314-aaffae480a39 Nov 01 12:28:00 devstack sudo[97433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:00 devstack sudo[97428]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2705265f-ca47-405e-8dc6-44b8025cc851 tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ae269714-5f4b-4e48-a734-330a72598aa3" returned: 0 in 0.397s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2705265f-ca47-405e-8dc6-44b8025cc851 tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ae269714-5f4b-4e48-a734-330a72598aa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ae269714-5f4b-4e48-a734-330a72598aa3.b5439955-dfc8-42fa-92b6-6fa5e3c6a056 2G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:00 devstack sudo[97438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ae269714-5f4b-4e48-a734-330a72598aa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ae269714-5f4b-4e48-a734-330a72598aa3.b5439955-dfc8-42fa-92b6-6fa5e3c6a056 2G Nov 01 12:28:00 devstack sudo[97438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:01 devstack sudo[97433]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0db85975-0d94-485d-9936-3fe210e9b412 tempest-GroupsV314Test-907585005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-aec003a9-7f3d-40bc-8314-aaffae480a39" returned: 0 in 0.272s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:01 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0db85975-0d94-485d-9936-3fe210e9b412 tempest-GroupsV314Test-907585005 None] Lock "cinder-quobyte-aec003a9-7f3d-40bc-8314-aaffae480a39" released by "delete_volume" :: held 0.715s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:28:01 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-0db85975-0d94-485d-9936-3fe210e9b412 tempest-GroupsV314Test-907585005 None] Created reservations ['41c7cf5b-e821-4e1f-9ad0-4986045b3b91'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:28:01 devstack cinder-volume[86574]: WARNING cinder.quota [None req-0db85975-0d94-485d-9936-3fe210e9b412 tempest-GroupsV314Test-907585005 None] Deprecated: Default quota for resource: volumes_tempest-GroupsV314Test-volume-type-1209101995 is set by the default quota flag: quota_volumes_tempest-GroupsV314Test-volume-type-1209101995, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:28:01 devstack cinder-volume[86574]: WARNING cinder.quota [None req-0db85975-0d94-485d-9936-3fe210e9b412 tempest-GroupsV314Test-907585005 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsV314Test-volume-type-1209101995 is set by the default quota flag: quota_gigabytes_tempest-GroupsV314Test-volume-type-1209101995, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:28:01 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-bd9812c8-8aaf-45b8-ab28-9e82d4726a7e tempest-VolumeQuotasAdminTestJSON-931435341 None] Acquiring lock "cinder-854cfcc5-c6e9-497a-84bd-56918c016ffe-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:28:01 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-0db85975-0d94-485d-9936-3fe210e9b412 tempest-GroupsV314Test-907585005 None] Created reservations ['bdc1fdc0-2dc5-4a62-8795-e85a8ef3fb90', '29be6c94-d8d3-405e-a868-ee3aa67d9109', '7db91b61-9f3c-462e-8930-336dda9928d0', '420e6c10-9a72-41c2-8480-90c6f1424abe'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:28:01 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-bd9812c8-8aaf-45b8-ab28-9e82d4726a7e tempest-VolumeQuotasAdminTestJSON-931435341 None] Lock "cinder-854cfcc5-c6e9-497a-84bd-56918c016ffe-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:28:01 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-bd9812c8-8aaf-45b8-ab28-9e82d4726a7e tempest-VolumeQuotasAdminTestJSON-931435341 None] Acquiring lock "cinder-quobyte-854cfcc5-c6e9-497a-84bd-56918c016ffe" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:28:01 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-bd9812c8-8aaf-45b8-ab28-9e82d4726a7e tempest-VolumeQuotasAdminTestJSON-931435341 None] Lock "cinder-quobyte-854cfcc5-c6e9-497a-84bd-56918c016ffe" acquired by "delete_volume" :: waited 0.035s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:28:01 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[519af3a4-e0b1-4ff1-9244-7f0a40f8aaa3]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:28:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bd9812c8-8aaf-45b8-ab28-9e82d4726a7e tempest-VolumeQuotasAdminTestJSON-931435341 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-854cfcc5-c6e9-497a-84bd-56918c016ffe {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0db85975-0d94-485d-9936-3fe210e9b412 tempest-GroupsV314Test-907585005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0db85975-0d94-485d-9936-3fe210e9b412 tempest-GroupsV314Test-907585005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:01 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-0db85975-0d94-485d-9936-3fe210e9b412 tempest-GroupsV314Test-907585005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:28:01 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-0db85975-0d94-485d-9936-3fe210e9b412 tempest-GroupsV314Test-907585005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:28:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0db85975-0d94-485d-9936-3fe210e9b412 tempest-GroupsV314Test-907585005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0db85975-0d94-485d-9936-3fe210e9b412 tempest-GroupsV314Test-907585005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:01 devstack sudo[97445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:28:01 devstack sudo[97445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:01 devstack sudo[97444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-854cfcc5-c6e9-497a-84bd-56918c016ffe Nov 01 12:28:01 devstack sudo[97444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:01 devstack sudo[97438]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2705265f-ca47-405e-8dc6-44b8025cc851 tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ae269714-5f4b-4e48-a734-330a72598aa3,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ae269714-5f4b-4e48-a734-330a72598aa3.b5439955-dfc8-42fa-92b6-6fa5e3c6a056 2G" returned: 0 in 0.503s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2705265f-ca47-405e-8dc6-44b8025cc851 tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae269714-5f4b-4e48-a734-330a72598aa3 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ae269714-5f4b-4e48-a734-330a72598aa3.b5439955-dfc8-42fa-92b6-6fa5e3c6a056 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:01 devstack sudo[97449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae269714-5f4b-4e48-a734-330a72598aa3 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ae269714-5f4b-4e48-a734-330a72598aa3.b5439955-dfc8-42fa-92b6-6fa5e3c6a056 Nov 01 12:28:01 devstack sudo[97449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:01 devstack sudo[97445]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0db85975-0d94-485d-9936-3fe210e9b412 tempest-GroupsV314Test-907585005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.270s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:01 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-0db85975-0d94-485d-9936-3fe210e9b412 tempest-GroupsV314Test-907585005 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:28:01 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-0db85975-0d94-485d-9936-3fe210e9b412 tempest-GroupsV314Test-907585005 None] Delete group completed successfully. Nov 01 12:28:01 devstack sudo[97444]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bd9812c8-8aaf-45b8-ab28-9e82d4726a7e tempest-VolumeQuotasAdminTestJSON-931435341 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-854cfcc5-c6e9-497a-84bd-56918c016ffe" returned: 0 in 0.437s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bd9812c8-8aaf-45b8-ab28-9e82d4726a7e tempest-VolumeQuotasAdminTestJSON-931435341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-854cfcc5-c6e9-497a-84bd-56918c016ffe {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:01 devstack sudo[97459]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-854cfcc5-c6e9-497a-84bd-56918c016ffe Nov 01 12:28:01 devstack sudo[97459]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:01 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e2418a6d-8e3f-4cfe-8eb7-cfaef7e862dd tempest-GroupsV314Test-907585005 None] Acquiring lock "cinder-quobyte-b9d51b2e-f396-4094-a548-38976fdececf" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:28:01 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e2418a6d-8e3f-4cfe-8eb7-cfaef7e862dd tempest-GroupsV314Test-907585005 None] Lock "cinder-quobyte-b9d51b2e-f396-4094-a548-38976fdececf" acquired by "delete_volume" :: waited 0.041s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:28:01 devstack sudo[97449]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2705265f-ca47-405e-8dc6-44b8025cc851 tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ae269714-5f4b-4e48-a734-330a72598aa3 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ae269714-5f4b-4e48-a734-330a72598aa3.b5439955-dfc8-42fa-92b6-6fa5e3c6a056" returned: 0 in 0.495s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:01 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-2705265f-ca47-405e-8dc6-44b8025cc851 tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ae269714-5f4b-4e48-a734-330a72598aa3.b5439955-dfc8-42fa-92b6-6fa5e3c6a056 is being set with open permissions: ugo+rw Nov 01 12:28:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2705265f-ca47-405e-8dc6-44b8025cc851 tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ae269714-5f4b-4e48-a734-330a72598aa3.b5439955-dfc8-42fa-92b6-6fa5e3c6a056 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:01 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c16497b-317f-4675-abfb-0260d2eafa5c]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:28:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e2418a6d-8e3f-4cfe-8eb7-cfaef7e862dd tempest-GroupsV314Test-907585005 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:01 devstack sudo[97462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ae269714-5f4b-4e48-a734-330a72598aa3.b5439955-dfc8-42fa-92b6-6fa5e3c6a056 Nov 01 12:28:01 devstack sudo[97462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:02 devstack sudo[97459]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bd9812c8-8aaf-45b8-ab28-9e82d4726a7e tempest-VolumeQuotasAdminTestJSON-931435341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-854cfcc5-c6e9-497a-84bd-56918c016ffe" returned: 0 in 0.342s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:02 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-bd9812c8-8aaf-45b8-ab28-9e82d4726a7e tempest-VolumeQuotasAdminTestJSON-931435341 None] Lock "cinder-quobyte-854cfcc5-c6e9-497a-84bd-56918c016ffe" released by "delete_volume" :: held 0.827s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:28:02 devstack sudo[97463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf Nov 01 12:28:02 devstack sudo[97463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:02 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-bd9812c8-8aaf-45b8-ab28-9e82d4726a7e tempest-VolumeQuotasAdminTestJSON-931435341 None] Created reservations ['9c063d4d-bfa8-4041-9809-7aa1133e897b', 'df6f6b67-e262-4838-b52b-956ff395cf01', '10e0959b-e8b7-40f5-9d18-893790f2a905', '95590e3d-4ef7-4c7f-be28-8ea4f2a58c77'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:28:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-bd9812c8-8aaf-45b8-ab28-9e82d4726a7e tempest-VolumeQuotasAdminTestJSON-931435341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-bd9812c8-8aaf-45b8-ab28-9e82d4726a7e tempest-VolumeQuotasAdminTestJSON-931435341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:02 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-bd9812c8-8aaf-45b8-ab28-9e82d4726a7e tempest-VolumeQuotasAdminTestJSON-931435341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:28:02 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-bd9812c8-8aaf-45b8-ab28-9e82d4726a7e tempest-VolumeQuotasAdminTestJSON-931435341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:28:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-bd9812c8-8aaf-45b8-ab28-9e82d4726a7e tempest-VolumeQuotasAdminTestJSON-931435341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bd9812c8-8aaf-45b8-ab28-9e82d4726a7e tempest-VolumeQuotasAdminTestJSON-931435341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:02 devstack sudo[97467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:28:02 devstack sudo[97467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:02 devstack sudo[97462]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2705265f-ca47-405e-8dc6-44b8025cc851 tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ae269714-5f4b-4e48-a734-330a72598aa3.b5439955-dfc8-42fa-92b6-6fa5e3c6a056" returned: 0 in 0.385s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2705265f-ca47-405e-8dc6-44b8025cc851 tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ae269714-5f4b-4e48-a734-330a72598aa3.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:02 devstack sudo[97473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ae269714-5f4b-4e48-a734-330a72598aa3.info Nov 01 12:28:02 devstack sudo[97473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:02 devstack sudo[97463]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e2418a6d-8e3f-4cfe-8eb7-cfaef7e862dd tempest-GroupsV314Test-907585005 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf" returned: 0 in 0.530s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e2418a6d-8e3f-4cfe-8eb7-cfaef7e862dd tempest-GroupsV314Test-907585005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:02 devstack sudo[97475]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf Nov 01 12:28:02 devstack sudo[97475]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:02 devstack sudo[97467]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bd9812c8-8aaf-45b8-ab28-9e82d4726a7e tempest-VolumeQuotasAdminTestJSON-931435341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.463s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:02 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-bd9812c8-8aaf-45b8-ab28-9e82d4726a7e tempest-VolumeQuotasAdminTestJSON-931435341 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:28:02 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-bd9812c8-8aaf-45b8-ab28-9e82d4726a7e tempest-VolumeQuotasAdminTestJSON-931435341 None] Deleted volume successfully. Nov 01 12:28:02 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-bd9812c8-8aaf-45b8-ab28-9e82d4726a7e tempest-VolumeQuotasAdminTestJSON-931435341 None] Lock "cinder-854cfcc5-c6e9-497a-84bd-56918c016ffe-delete_volume" released by "delete_volume" :: held 1.584s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:28:02 devstack sudo[97473]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2705265f-ca47-405e-8dc6-44b8025cc851 tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ae269714-5f4b-4e48-a734-330a72598aa3.info" returned: 0 in 0.385s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:02 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-2705265f-ca47-405e-8dc6-44b8025cc851 tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ae269714-5f4b-4e48-a734-330a72598aa3.info is being set with open permissions: ugo+rw Nov 01 12:28:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2705265f-ca47-405e-8dc6-44b8025cc851 tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ae269714-5f4b-4e48-a734-330a72598aa3.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:02 devstack sudo[97475]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e2418a6d-8e3f-4cfe-8eb7-cfaef7e862dd tempest-GroupsV314Test-907585005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b9d51b2e-f396-4094-a548-38976fdececf" returned: 0 in 0.323s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:02 devstack sudo[97480]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ae269714-5f4b-4e48-a734-330a72598aa3.info Nov 01 12:28:02 devstack sudo[97480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:02 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-24729366-141d-463a-a759-4392c2952019 tempest-AttachVolumeShelveTestJSON-916880141 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:28:02 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-24729366-141d-463a-a759-4392c2952019 tempest-AttachVolumeShelveTestJSON-916880141 None] Flow 'volume_create_manager' (644d3a19-f478-4f95-80ac-f9e84fad1e12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:28:02 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-24729366-141d-463a-a759-4392c2952019 tempest-AttachVolumeShelveTestJSON-916880141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11182f4b-721b-4067-934f-e692c4393c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:02 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e2418a6d-8e3f-4cfe-8eb7-cfaef7e862dd tempest-GroupsV314Test-907585005 None] Lock "cinder-quobyte-b9d51b2e-f396-4094-a548-38976fdececf" released by "delete_volume" :: held 1.021s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:28:02 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-24729366-141d-463a-a759-4392c2952019 tempest-AttachVolumeShelveTestJSON-916880141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11182f4b-721b-4067-934f-e692c4393c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-27185865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29158f88-ff3b-46f0-b825-6b63f0cf1e20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9855a0441ecf45fab89e09ca05293326',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:28:03Z,use_quota=True,user_id='3c74b8bf6c12426490515f3c4a1721d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:02 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-24729366-141d-463a-a759-4392c2952019 tempest-AttachVolumeShelveTestJSON-916880141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa79089e-154d-4c81-9a88-a49a31597c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:02 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-24729366-141d-463a-a759-4392c2952019 tempest-AttachVolumeShelveTestJSON-916880141 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (fa79089e-154d-4c81-9a88-a49a31597c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:02 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-24729366-141d-463a-a759-4392c2952019 tempest-AttachVolumeShelveTestJSON-916880141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e81eb00-7588-48bb-81fa-60f5b0513553) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:02 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-24729366-141d-463a-a759-4392c2952019 tempest-AttachVolumeShelveTestJSON-916880141 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6e81eb00-7588-48bb-81fa-60f5b0513553) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '29158f88-ff3b-46f0-b825-6b63f0cf1e20', 'volume_name': 'volume-29158f88-ff3b-46f0-b825-6b63f0cf1e20', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:02 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-24729366-141d-463a-a759-4392c2952019 tempest-AttachVolumeShelveTestJSON-916880141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25b9f7a4-65c5-4d95-ab14-94ee96b83bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:02 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-24729366-141d-463a-a759-4392c2952019 tempest-AttachVolumeShelveTestJSON-916880141 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25b9f7a4-65c5-4d95-ab14-94ee96b83bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:02 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-24729366-141d-463a-a759-4392c2952019 tempest-AttachVolumeShelveTestJSON-916880141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb826dca-0014-47f0-bbc2-98802144246a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:02 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-24729366-141d-463a-a759-4392c2952019 tempest-AttachVolumeShelveTestJSON-916880141 None] Volume 29158f88-ff3b-46f0-b825-6b63f0cf1e20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-29158f88-ff3b-46f0-b825-6b63f0cf1e20', 'volume_size': 1} Nov 01 12:28:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-24729366-141d-463a-a759-4392c2952019 tempest-AttachVolumeShelveTestJSON-916880141 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-e2418a6d-8e3f-4cfe-8eb7-cfaef7e862dd tempest-GroupsV314Test-907585005 None] Created reservations ['e032f186-d825-4d83-ab33-4547dae67128'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-e2418a6d-8e3f-4cfe-8eb7-cfaef7e862dd tempest-GroupsV314Test-907585005 None] Created reservations ['2b0ef0af-11eb-4a03-89c2-7805c3abde55', 'fa41b7dd-3146-40c4-8d3c-91ed74ed19b5', '8b05443c-58ff-49ee-a769-04bbbac2e72d', '267dc2b6-788b-4018-99ab-cb3c76ef56fb'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:28:03 devstack sudo[97480]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2705265f-ca47-405e-8dc6-44b8025cc851 tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ae269714-5f4b-4e48-a734-330a72598aa3.info" returned: 0 in 0.299s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-2705265f-ca47-405e-8dc6-44b8025cc851 tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.698s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-24729366-141d-463a-a759-4392c2952019 tempest-AttachVolumeShelveTestJSON-916880141 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.183s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-24729366-141d-463a-a759-4392c2952019 tempest-AttachVolumeShelveTestJSON-916880141 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:28:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-27185865',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=29158f88-ff3b-46f0-b825-6b63f0cf1e20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9855a0441ecf45fab89e09ca05293326',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:28:03Z,use_quota=True,user_id='3c74b8bf6c12426490515f3c4a1721d1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-24729366-141d-463a-a759-4392c2952019 tempest-AttachVolumeShelveTestJSON-916880141 None] Creating volume 29158f88-ff3b-46f0-b825-6b63f0cf1e20 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-24729366-141d-463a-a759-4392c2952019 tempest-AttachVolumeShelveTestJSON-916880141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-24729366-141d-463a-a759-4392c2952019 tempest-AttachVolumeShelveTestJSON-916880141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-24729366-141d-463a-a759-4392c2952019 tempest-AttachVolumeShelveTestJSON-916880141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-24729366-141d-463a-a759-4392c2952019 tempest-AttachVolumeShelveTestJSON-916880141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-24729366-141d-463a-a759-4392c2952019 tempest-AttachVolumeShelveTestJSON-916880141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-24729366-141d-463a-a759-4392c2952019 tempest-AttachVolumeShelveTestJSON-916880141 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:28:03 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-24729366-141d-463a-a759-4392c2952019 tempest-AttachVolumeShelveTestJSON-916880141 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-24729366-141d-463a-a759-4392c2952019 tempest-AttachVolumeShelveTestJSON-916880141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-29158f88-ff3b-46f0-b825-6b63f0cf1e20 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:03 devstack sudo[97483]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-29158f88-ff3b-46f0-b825-6b63f0cf1e20 1073741824 Nov 01 12:28:03 devstack sudo[97483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:03 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-2705265f-ca47-405e-8dc6-44b8025cc851 tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Create snapshot completed successfully Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-d1db81f0-8d7a-4f18-bfe8-2912a7f2c12b tempest-VolumeQuotasAdminTestJSON-931435341 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d1db81f0-8d7a-4f18-bfe8-2912a7f2c12b tempest-VolumeQuotasAdminTestJSON-931435341 None] Flow 'volume_create_manager' (432f55aa-38c0-4d10-88f6-c9949b313cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d1db81f0-8d7a-4f18-bfe8-2912a7f2c12b tempest-VolumeQuotasAdminTestJSON-931435341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ec37218-ce23-46f8-90ed-1a2938278dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d1db81f0-8d7a-4f18-bfe8-2912a7f2c12b tempest-VolumeQuotasAdminTestJSON-931435341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9ec37218-ce23-46f8-90ed-1a2938278dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1263866496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af09bbf1-e628-478a-b2e6-3b00159f7e23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='674af3abae2645da9753caec1feb932d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:28:03Z,use_quota=True,user_id='93f0f85f11ee4c9b966f9513136698aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d1db81f0-8d7a-4f18-bfe8-2912a7f2c12b tempest-VolumeQuotasAdminTestJSON-931435341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bd7859a-ddac-492d-9b59-69cd2ad67e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d1db81f0-8d7a-4f18-bfe8-2912a7f2c12b tempest-VolumeQuotasAdminTestJSON-931435341 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7bd7859a-ddac-492d-9b59-69cd2ad67e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d1db81f0-8d7a-4f18-bfe8-2912a7f2c12b tempest-VolumeQuotasAdminTestJSON-931435341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76c2d72f-a231-4964-ba05-da0b2c303210) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d1db81f0-8d7a-4f18-bfe8-2912a7f2c12b tempest-VolumeQuotasAdminTestJSON-931435341 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76c2d72f-a231-4964-ba05-da0b2c303210) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af09bbf1-e628-478a-b2e6-3b00159f7e23', 'volume_name': 'volume-af09bbf1-e628-478a-b2e6-3b00159f7e23', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d1db81f0-8d7a-4f18-bfe8-2912a7f2c12b tempest-VolumeQuotasAdminTestJSON-931435341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14a12084-904e-43d3-ab9d-b4365dc15d78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d1db81f0-8d7a-4f18-bfe8-2912a7f2c12b tempest-VolumeQuotasAdminTestJSON-931435341 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (14a12084-904e-43d3-ab9d-b4365dc15d78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d1db81f0-8d7a-4f18-bfe8-2912a7f2c12b tempest-VolumeQuotasAdminTestJSON-931435341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88d441f2-64bf-49a3-8990-fdb3681d10cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:03 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-d1db81f0-8d7a-4f18-bfe8-2912a7f2c12b tempest-VolumeQuotasAdminTestJSON-931435341 None] Volume af09bbf1-e628-478a-b2e6-3b00159f7e23: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af09bbf1-e628-478a-b2e6-3b00159f7e23', 'volume_size': 1} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d1db81f0-8d7a-4f18-bfe8-2912a7f2c12b tempest-VolumeQuotasAdminTestJSON-931435341 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e2418a6d-8e3f-4cfe-8eb7-cfaef7e862dd tempest-GroupsV314Test-907585005 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e2418a6d-8e3f-4cfe-8eb7-cfaef7e862dd tempest-GroupsV314Test-907585005 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e2418a6d-8e3f-4cfe-8eb7-cfaef7e862dd tempest-GroupsV314Test-907585005 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e2418a6d-8e3f-4cfe-8eb7-cfaef7e862dd tempest-GroupsV314Test-907585005 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e2418a6d-8e3f-4cfe-8eb7-cfaef7e862dd tempest-GroupsV314Test-907585005 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e2418a6d-8e3f-4cfe-8eb7-cfaef7e862dd tempest-GroupsV314Test-907585005 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:03 devstack sudo[97486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:28:03 devstack sudo[97486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-494df2e2-39a8-47d5-8663-7d70019a07ce tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Acquiring lock "cinder-b5439955-dfc8-42fa-92b6-6fa5e3c6a056-delete_snapshot" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-494df2e2-39a8-47d5-8663-7d70019a07ce tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Lock "cinder-b5439955-dfc8-42fa-92b6-6fa5e3c6a056-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-494df2e2-39a8-47d5-8663-7d70019a07ce tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Acquiring lock "cinder-quobyte-ae269714-5f4b-4e48-a734-330a72598aa3" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-494df2e2-39a8-47d5-8663-7d70019a07ce tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Lock "cinder-quobyte-ae269714-5f4b-4e48-a734-330a72598aa3" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-494df2e2-39a8-47d5-8663-7d70019a07ce tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Acquiring lock "cinder-quobyte-b5439955-dfc8-42fa-92b6-6fa5e3c6a056" by "_delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-494df2e2-39a8-47d5-8663-7d70019a07ce tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Lock "cinder-quobyte-b5439955-dfc8-42fa-92b6-6fa5e3c6a056" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-494df2e2-39a8-47d5-8663-7d70019a07ce tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Deleting offline snapshot b5439955-dfc8-42fa-92b6-6fa5e3c6a056 of volume ae269714-5f4b-4e48-a734-330a72598aa3 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-494df2e2-39a8-47d5-8663-7d70019a07ce tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] snapshot_file for this snap is: volume-ae269714-5f4b-4e48-a734-330a72598aa3.b5439955-dfc8-42fa-92b6-6fa5e3c6a056 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[2fcff20f-e684-4e33-897c-732664e8c100]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-494df2e2-39a8-47d5-8663-7d70019a07ce tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ae269714-5f4b-4e48-a734-330a72598aa3.b5439955-dfc8-42fa-92b6-6fa5e3c6a056 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:03 devstack sudo[97486]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e2418a6d-8e3f-4cfe-8eb7-cfaef7e862dd tempest-GroupsV314Test-907585005 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.269s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-e2418a6d-8e3f-4cfe-8eb7-cfaef7e862dd tempest-GroupsV314Test-907585005 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:28:03 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-e2418a6d-8e3f-4cfe-8eb7-cfaef7e862dd tempest-GroupsV314Test-907585005 None] Delete group completed successfully. Nov 01 12:28:03 devstack sudo[97483]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-24729366-141d-463a-a759-4392c2952019 tempest-AttachVolumeShelveTestJSON-916880141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-29158f88-ff3b-46f0-b825-6b63f0cf1e20 1073741824" returned: 0 in 0.497s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-24729366-141d-463a-a759-4392c2952019 tempest-AttachVolumeShelveTestJSON-916880141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-29158f88-ff3b-46f0-b825-6b63f0cf1e20 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:03 devstack sudo[97492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ae269714-5f4b-4e48-a734-330a72598aa3.b5439955-dfc8-42fa-92b6-6fa5e3c6a056 Nov 01 12:28:03 devstack sudo[97492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:03 devstack sudo[97493]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-29158f88-ff3b-46f0-b825-6b63f0cf1e20 Nov 01 12:28:03 devstack sudo[97493]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:03 devstack sudo[97493]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-24729366-141d-463a-a759-4392c2952019 tempest-AttachVolumeShelveTestJSON-916880141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-29158f88-ff3b-46f0-b825-6b63f0cf1e20" returned: 0 in 0.255s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-24729366-141d-463a-a759-4392c2952019 tempest-AttachVolumeShelveTestJSON-916880141 None] <== create_volume: return (801ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-24729366-141d-463a-a759-4392c2952019 tempest-AttachVolumeShelveTestJSON-916880141 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.805s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d1db81f0-8d7a-4f18-bfe8-2912a7f2c12b tempest-VolumeQuotasAdminTestJSON-931435341 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.642s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d1db81f0-8d7a-4f18-bfe8-2912a7f2c12b tempest-VolumeQuotasAdminTestJSON-931435341 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:28:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1263866496',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af09bbf1-e628-478a-b2e6-3b00159f7e23,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='674af3abae2645da9753caec1feb932d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:28:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:28:03Z,use_quota=True,user_id='93f0f85f11ee4c9b966f9513136698aa',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-d1db81f0-8d7a-4f18-bfe8-2912a7f2c12b tempest-VolumeQuotasAdminTestJSON-931435341 None] Creating volume af09bbf1-e628-478a-b2e6-3b00159f7e23 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d1db81f0-8d7a-4f18-bfe8-2912a7f2c12b tempest-VolumeQuotasAdminTestJSON-931435341 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d1db81f0-8d7a-4f18-bfe8-2912a7f2c12b tempest-VolumeQuotasAdminTestJSON-931435341 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d1db81f0-8d7a-4f18-bfe8-2912a7f2c12b tempest-VolumeQuotasAdminTestJSON-931435341 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d1db81f0-8d7a-4f18-bfe8-2912a7f2c12b tempest-VolumeQuotasAdminTestJSON-931435341 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d1db81f0-8d7a-4f18-bfe8-2912a7f2c12b tempest-VolumeQuotasAdminTestJSON-931435341 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d1db81f0-8d7a-4f18-bfe8-2912a7f2c12b tempest-VolumeQuotasAdminTestJSON-931435341 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:28:03 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-d1db81f0-8d7a-4f18-bfe8-2912a7f2c12b tempest-VolumeQuotasAdminTestJSON-931435341 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d1db81f0-8d7a-4f18-bfe8-2912a7f2c12b tempest-VolumeQuotasAdminTestJSON-931435341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af09bbf1-e628-478a-b2e6-3b00159f7e23 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:03 devstack sudo[97492]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-24729366-141d-463a-a759-4392c2952019 tempest-AttachVolumeShelveTestJSON-916880141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bb826dca-0014-47f0-bbc2-98802144246a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-29158f88-ff3b-46f0-b825-6b63f0cf1e20', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-24729366-141d-463a-a759-4392c2952019 tempest-AttachVolumeShelveTestJSON-916880141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df920658-38f3-4ff2-ab4b-4f3d42b6fb3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:03 devstack sudo[97503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af09bbf1-e628-478a-b2e6-3b00159f7e23 1073741824 Nov 01 12:28:03 devstack sudo[97503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-494df2e2-39a8-47d5-8663-7d70019a07ce tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ae269714-5f4b-4e48-a734-330a72598aa3.b5439955-dfc8-42fa-92b6-6fa5e3c6a056" returned: 0 in 0.423s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-494df2e2-39a8-47d5-8663-7d70019a07ce tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ae269714-5f4b-4e48-a734-330a72598aa3(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:28:04 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-24729366-141d-463a-a759-4392c2952019 tempest-AttachVolumeShelveTestJSON-916880141 None] Volume volume-29158f88-ff3b-46f0-b825-6b63f0cf1e20 (29158f88-ff3b-46f0-b825-6b63f0cf1e20): created successfully Nov 01 12:28:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-24729366-141d-463a-a759-4392c2952019 tempest-AttachVolumeShelveTestJSON-916880141 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df920658-38f3-4ff2-ab4b-4f3d42b6fb3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-24729366-141d-463a-a759-4392c2952019 tempest-AttachVolumeShelveTestJSON-916880141 None] Flow 'volume_create_manager' (644d3a19-f478-4f95-80ac-f9e84fad1e12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:28:04 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad8642d1-06a8-410a-b26a-008f24cf4cf3]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:28:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-494df2e2-39a8-47d5-8663-7d70019a07ce tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ae269714-5f4b-4e48-a734-330a72598aa3 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:04 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-24729366-141d-463a-a759-4392c2952019 tempest-AttachVolumeShelveTestJSON-916880141 None] Created volume successfully. Nov 01 12:28:04 devstack sudo[97505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ae269714-5f4b-4e48-a734-330a72598aa3 Nov 01 12:28:04 devstack sudo[97505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:04 devstack sudo[97505]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-494df2e2-39a8-47d5-8663-7d70019a07ce tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ae269714-5f4b-4e48-a734-330a72598aa3" returned: 0 in 0.425s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-494df2e2-39a8-47d5-8663-7d70019a07ce tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ae269714-5f4b-4e48-a734-330a72598aa3.b5439955-dfc8-42fa-92b6-6fa5e3c6a056 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:04 devstack sudo[97503]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d1db81f0-8d7a-4f18-bfe8-2912a7f2c12b tempest-VolumeQuotasAdminTestJSON-931435341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af09bbf1-e628-478a-b2e6-3b00159f7e23 1073741824" returned: 0 in 0.534s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:04 devstack sudo[97514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ae269714-5f4b-4e48-a734-330a72598aa3.b5439955-dfc8-42fa-92b6-6fa5e3c6a056 Nov 01 12:28:04 devstack sudo[97514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d1db81f0-8d7a-4f18-bfe8-2912a7f2c12b tempest-VolumeQuotasAdminTestJSON-931435341 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af09bbf1-e628-478a-b2e6-3b00159f7e23 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:04 devstack sudo[97516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af09bbf1-e628-478a-b2e6-3b00159f7e23 Nov 01 12:28:04 devstack sudo[97516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:04 devstack sudo[97516]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d1db81f0-8d7a-4f18-bfe8-2912a7f2c12b tempest-VolumeQuotasAdminTestJSON-931435341 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af09bbf1-e628-478a-b2e6-3b00159f7e23" returned: 0 in 0.297s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:04 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d1db81f0-8d7a-4f18-bfe8-2912a7f2c12b tempest-VolumeQuotasAdminTestJSON-931435341 None] <== create_volume: return (891ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:28:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d1db81f0-8d7a-4f18-bfe8-2912a7f2c12b tempest-VolumeQuotasAdminTestJSON-931435341 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.895s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d1db81f0-8d7a-4f18-bfe8-2912a7f2c12b tempest-VolumeQuotasAdminTestJSON-931435341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (88d441f2-64bf-49a3-8990-fdb3681d10cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af09bbf1-e628-478a-b2e6-3b00159f7e23', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d1db81f0-8d7a-4f18-bfe8-2912a7f2c12b tempest-VolumeQuotasAdminTestJSON-931435341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbde12ce-0d6b-448d-a5d5-22ad0dbd0b4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:04 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-d1db81f0-8d7a-4f18-bfe8-2912a7f2c12b tempest-VolumeQuotasAdminTestJSON-931435341 None] Volume volume-af09bbf1-e628-478a-b2e6-3b00159f7e23 (af09bbf1-e628-478a-b2e6-3b00159f7e23): created successfully Nov 01 12:28:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d1db81f0-8d7a-4f18-bfe8-2912a7f2c12b tempest-VolumeQuotasAdminTestJSON-931435341 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cbde12ce-0d6b-448d-a5d5-22ad0dbd0b4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:04 devstack sudo[97514]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d1db81f0-8d7a-4f18-bfe8-2912a7f2c12b tempest-VolumeQuotasAdminTestJSON-931435341 None] Flow 'volume_create_manager' (432f55aa-38c0-4d10-88f6-c9949b313cc5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:28:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-494df2e2-39a8-47d5-8663-7d70019a07ce tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ae269714-5f4b-4e48-a734-330a72598aa3.b5439955-dfc8-42fa-92b6-6fa5e3c6a056" returned: 0 in 0.434s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-494df2e2-39a8-47d5-8663-7d70019a07ce tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ae269714-5f4b-4e48-a734-330a72598aa3.b5439955-dfc8-42fa-92b6-6fa5e3c6a056 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:04 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-d1db81f0-8d7a-4f18-bfe8-2912a7f2c12b tempest-VolumeQuotasAdminTestJSON-931435341 None] Created volume successfully. Nov 01 12:28:04 devstack sudo[97524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ae269714-5f4b-4e48-a734-330a72598aa3.b5439955-dfc8-42fa-92b6-6fa5e3c6a056 Nov 01 12:28:04 devstack sudo[97524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:05 devstack sudo[97524]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-494df2e2-39a8-47d5-8663-7d70019a07ce tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ae269714-5f4b-4e48-a734-330a72598aa3.b5439955-dfc8-42fa-92b6-6fa5e3c6a056" returned: 0 in 0.291s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:05 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-494df2e2-39a8-47d5-8663-7d70019a07ce tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Lock "cinder-quobyte-b5439955-dfc8-42fa-92b6-6fa5e3c6a056" released by "_delete_snapshot" :: held 1.736s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:28:05 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-494df2e2-39a8-47d5-8663-7d70019a07ce tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Lock "cinder-quobyte-ae269714-5f4b-4e48-a734-330a72598aa3" released by "delete_snapshot" :: held 1.766s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:28:05 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-494df2e2-39a8-47d5-8663-7d70019a07ce tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Created reservations ['db7d3ced-3d35-4454-b0d4-f4fe7e00b693', 'b26d0fc6-eece-4853-b408-314ccb575c5b', '4db61204-4d6e-4bc1-8b44-4080fa6327f1', 'b8f9d50e-c41b-428b-8c95-becefc7cbe48'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:28:05 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-494df2e2-39a8-47d5-8663-7d70019a07ce tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Delete snapshot completed successfully. Nov 01 12:28:05 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-494df2e2-39a8-47d5-8663-7d70019a07ce tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Lock "cinder-b5439955-dfc8-42fa-92b6-6fa5e3c6a056-delete_snapshot" released by "delete_snapshot" :: held 1.974s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:28:05 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6cd811f9-1f20-4804-b88c-9ba62d458730 tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Acquiring lock "cinder-ae269714-5f4b-4e48-a734-330a72598aa3-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:28:05 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6cd811f9-1f20-4804-b88c-9ba62d458730 tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Lock "cinder-ae269714-5f4b-4e48-a734-330a72598aa3-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:28:05 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6cd811f9-1f20-4804-b88c-9ba62d458730 tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Acquiring lock "cinder-quobyte-ae269714-5f4b-4e48-a734-330a72598aa3" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:28:05 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6cd811f9-1f20-4804-b88c-9ba62d458730 tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Lock "cinder-quobyte-ae269714-5f4b-4e48-a734-330a72598aa3" acquired by "delete_volume" :: waited 0.027s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:28:05 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[76162759-e7a5-4d0b-9676-e3b7bbbd505b]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:28:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6cd811f9-1f20-4804-b88c-9ba62d458730 tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ae269714-5f4b-4e48-a734-330a72598aa3 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:06 devstack sudo[97529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ae269714-5f4b-4e48-a734-330a72598aa3 Nov 01 12:28:06 devstack sudo[97529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:06 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-69324474-00c8-4457-be80-9aaa1e9f05e4 tempest-VolumeQuotasAdminTestJSON-1860986576 None] Transfer volume completed successfully. Nov 01 12:28:06 devstack sudo[97529]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6cd811f9-1f20-4804-b88c-9ba62d458730 tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ae269714-5f4b-4e48-a734-330a72598aa3" returned: 0 in 0.547s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6cd811f9-1f20-4804-b88c-9ba62d458730 tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ae269714-5f4b-4e48-a734-330a72598aa3 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:06 devstack sudo[97536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ae269714-5f4b-4e48-a734-330a72598aa3 Nov 01 12:28:06 devstack sudo[97536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:06 devstack sudo[97536]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6cd811f9-1f20-4804-b88c-9ba62d458730 tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ae269714-5f4b-4e48-a734-330a72598aa3" returned: 0 in 0.402s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:06 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6cd811f9-1f20-4804-b88c-9ba62d458730 tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Lock "cinder-quobyte-ae269714-5f4b-4e48-a734-330a72598aa3" released by "delete_volume" :: held 1.070s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:28:07 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-6cd811f9-1f20-4804-b88c-9ba62d458730 tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Created reservations ['583c8359-1cfa-4933-bc0c-ddd4f9bec47a', '1df59763-3598-4c28-acb6-2ad38029b290', 'e7d499df-6a9f-4f11-8c6d-ec50bc95fa6d', 'ac90a6e1-0967-4ea2-a061-56cc32e86fe1'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:28:07 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-86b18dd6-808b-4a3c-a20a-3d468bbefc5d tempest-VolumeQuotasAdminTestJSON-1182576894 None] Acquiring lock "cinder-af09bbf1-e628-478a-b2e6-3b00159f7e23-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:28:07 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-86b18dd6-808b-4a3c-a20a-3d468bbefc5d tempest-VolumeQuotasAdminTestJSON-1182576894 None] Lock "cinder-af09bbf1-e628-478a-b2e6-3b00159f7e23-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:28:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-6cd811f9-1f20-4804-b88c-9ba62d458730 tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-6cd811f9-1f20-4804-b88c-9ba62d458730 tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:07 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-6cd811f9-1f20-4804-b88c-9ba62d458730 tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:28:07 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-6cd811f9-1f20-4804-b88c-9ba62d458730 tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:28:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-6cd811f9-1f20-4804-b88c-9ba62d458730 tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6cd811f9-1f20-4804-b88c-9ba62d458730 tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:07 devstack sudo[97544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:28:07 devstack sudo[97544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:07 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-86b18dd6-808b-4a3c-a20a-3d468bbefc5d tempest-VolumeQuotasAdminTestJSON-1182576894 None] Acquiring lock "cinder-quobyte-af09bbf1-e628-478a-b2e6-3b00159f7e23" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:28:07 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-86b18dd6-808b-4a3c-a20a-3d468bbefc5d tempest-VolumeQuotasAdminTestJSON-1182576894 None] Lock "cinder-quobyte-af09bbf1-e628-478a-b2e6-3b00159f7e23" acquired by "delete_volume" :: waited 0.027s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:28:07 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[71f8adfd-0916-4bf2-8168-257d88a0b54a]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:28:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-86b18dd6-808b-4a3c-a20a-3d468bbefc5d tempest-VolumeQuotasAdminTestJSON-1182576894 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af09bbf1-e628-478a-b2e6-3b00159f7e23 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:07 devstack sudo[97553]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af09bbf1-e628-478a-b2e6-3b00159f7e23 Nov 01 12:28:07 devstack sudo[97553]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:07 devstack sudo[97544]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6cd811f9-1f20-4804-b88c-9ba62d458730 tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.354s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:07 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-6cd811f9-1f20-4804-b88c-9ba62d458730 tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:28:07 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-6cd811f9-1f20-4804-b88c-9ba62d458730 tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Deleted volume successfully. Nov 01 12:28:07 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6cd811f9-1f20-4804-b88c-9ba62d458730 tempest-VolumesSnapshotNegativeTestJSON-1517678921 None] Lock "cinder-ae269714-5f4b-4e48-a734-330a72598aa3-delete_volume" released by "delete_volume" :: held 1.893s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:28:07 devstack sudo[97553]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-86b18dd6-808b-4a3c-a20a-3d468bbefc5d tempest-VolumeQuotasAdminTestJSON-1182576894 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af09bbf1-e628-478a-b2e6-3b00159f7e23" returned: 0 in 0.439s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-86b18dd6-808b-4a3c-a20a-3d468bbefc5d tempest-VolumeQuotasAdminTestJSON-1182576894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af09bbf1-e628-478a-b2e6-3b00159f7e23 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:07 devstack sudo[97561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af09bbf1-e628-478a-b2e6-3b00159f7e23 Nov 01 12:28:07 devstack sudo[97561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:08 devstack sudo[97561]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-86b18dd6-808b-4a3c-a20a-3d468bbefc5d tempest-VolumeQuotasAdminTestJSON-1182576894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-af09bbf1-e628-478a-b2e6-3b00159f7e23" returned: 0 in 0.413s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:08 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-86b18dd6-808b-4a3c-a20a-3d468bbefc5d tempest-VolumeQuotasAdminTestJSON-1182576894 None] Lock "cinder-quobyte-af09bbf1-e628-478a-b2e6-3b00159f7e23" released by "delete_volume" :: held 0.926s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:28:08 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-86b18dd6-808b-4a3c-a20a-3d468bbefc5d tempest-VolumeQuotasAdminTestJSON-1182576894 None] Created reservations ['2d85214d-de74-490d-a412-15b3e5e89001', 'c189eaa0-fa5b-41d1-a783-177a7a44fe6c', '66d01157-f9ee-4a2f-ac3d-78e7426ce3aa', 'a3472195-0ac5-460f-9615-99472c2b56bc'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:28:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-86b18dd6-808b-4a3c-a20a-3d468bbefc5d tempest-VolumeQuotasAdminTestJSON-1182576894 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-86b18dd6-808b-4a3c-a20a-3d468bbefc5d tempest-VolumeQuotasAdminTestJSON-1182576894 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:08 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-86b18dd6-808b-4a3c-a20a-3d468bbefc5d tempest-VolumeQuotasAdminTestJSON-1182576894 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:28:08 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-86b18dd6-808b-4a3c-a20a-3d468bbefc5d tempest-VolumeQuotasAdminTestJSON-1182576894 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:28:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-86b18dd6-808b-4a3c-a20a-3d468bbefc5d tempest-VolumeQuotasAdminTestJSON-1182576894 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-86b18dd6-808b-4a3c-a20a-3d468bbefc5d tempest-VolumeQuotasAdminTestJSON-1182576894 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:08 devstack sudo[97564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:28:08 devstack sudo[97564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:08 devstack sudo[97564]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-86b18dd6-808b-4a3c-a20a-3d468bbefc5d tempest-VolumeQuotasAdminTestJSON-1182576894 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.320s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:08 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-86b18dd6-808b-4a3c-a20a-3d468bbefc5d tempest-VolumeQuotasAdminTestJSON-1182576894 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:28:08 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-86b18dd6-808b-4a3c-a20a-3d468bbefc5d tempest-VolumeQuotasAdminTestJSON-1182576894 None] Deleted volume successfully. Nov 01 12:28:08 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-86b18dd6-808b-4a3c-a20a-3d468bbefc5d tempest-VolumeQuotasAdminTestJSON-1182576894 None] Lock "cinder-af09bbf1-e628-478a-b2e6-3b00159f7e23-delete_volume" released by "delete_volume" :: held 1.780s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:28:13 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-2e18faaf-45fa-462f-b30d-79623cde3ea3 tempest-GroupsV320Test-981740343 None] Group tempest-GroupsV320Test-Group-840906016: creating Nov 01 12:28:13 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-2e18faaf-45fa-462f-b30d-79623cde3ea3 tempest-GroupsV320Test-981740343 None] Group tempest-GroupsV320Test-Group-840906016: created successfully Nov 01 12:28:13 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-2e18faaf-45fa-462f-b30d-79623cde3ea3 tempest-GroupsV320Test-981740343 None] Create group completed successfully. Nov 01 12:28:15 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-8723b335-d880-47ea-92db-adf2efdea2c9 tempest-GroupsV320Test-981740343 None] Created reservations ['71650abb-1fe7-42b4-9f20-07fb4b7f6c05'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:28:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8723b335-d880-47ea-92db-adf2efdea2c9 tempest-GroupsV320Test-981740343 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8723b335-d880-47ea-92db-adf2efdea2c9 tempest-GroupsV320Test-981740343 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:15 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-8723b335-d880-47ea-92db-adf2efdea2c9 tempest-GroupsV320Test-981740343 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:28:15 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-8723b335-d880-47ea-92db-adf2efdea2c9 tempest-GroupsV320Test-981740343 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:28:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8723b335-d880-47ea-92db-adf2efdea2c9 tempest-GroupsV320Test-981740343 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8723b335-d880-47ea-92db-adf2efdea2c9 tempest-GroupsV320Test-981740343 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:15 devstack sudo[97595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:28:15 devstack sudo[97595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:15 devstack sudo[97595]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8723b335-d880-47ea-92db-adf2efdea2c9 tempest-GroupsV320Test-981740343 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.314s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:15 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-8723b335-d880-47ea-92db-adf2efdea2c9 tempest-GroupsV320Test-981740343 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:28:15 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-8723b335-d880-47ea-92db-adf2efdea2c9 tempest-GroupsV320Test-981740343 None] Delete group completed successfully. Nov 01 12:28:18 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-ee3531b4-bd0a-4880-9592-06fe2295447f req-2548299e-b2ef-4f3f-af62-0ebbdbc5e782 tempest-AttachVolumeShelveTestJSON-916880141 None] No connector for attachment 74534ee2-219a-4738-b504-0d50f6cde262; skipping storage backend terminate_connection call. {{(pid=86574) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:5010}} Nov 01 12:28:18 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-ee3531b4-bd0a-4880-9592-06fe2295447f req-2548299e-b2ef-4f3f-af62-0ebbdbc5e782 tempest-AttachVolumeShelveTestJSON-916880141 None] Deleting attachment 74534ee2-219a-4738-b504-0d50f6cde262. {{(pid=86574) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 12:28:21 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:UPDATE=107,cinder:SELECT=91,cinder:INSERT=18,cinder:DELETE=6 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:28:21 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:SELECT=89,cinder:UPDATE=97,cinder:INSERT=30,cinder:DELETE=4 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:28:22 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-12cec8ba-c22e-49ef-b490-76429e3a2ae2 tempest-VolumeTypesAccessTest-1331579106 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:28:22 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-12cec8ba-c22e-49ef-b490-76429e3a2ae2 tempest-VolumeTypesAccessTest-1331579106 None] Flow 'volume_create_manager' (16eb0cab-5629-426e-b5ed-1c21279eb7ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:28:22 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-12cec8ba-c22e-49ef-b490-76429e3a2ae2 tempest-VolumeTypesAccessTest-1331579106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae0d597b-ce5c-477c-ba7b-963d891b4299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:22 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-12cec8ba-c22e-49ef-b490-76429e3a2ae2 tempest-VolumeTypesAccessTest-1331579106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae0d597b-ce5c-477c-ba7b-963d891b4299) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1356270855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d4d6a6d-0f4c-42bf-ab6a-0cbc9edf9010,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='357a9de320af4d44ae3d574f5dc99c22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:28:22Z,use_quota=True,user_id='ecbf266e633e475587b6f1577d1ca38a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(567f1ac9-f681-4202-8af7-cc2b9cc7fa45),volume_type_id=567f1ac9-f681-4202-8af7-cc2b9cc7fa45)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:22 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-12cec8ba-c22e-49ef-b490-76429e3a2ae2 tempest-VolumeTypesAccessTest-1331579106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b795f94-805b-4bba-a5ae-1d05d899b8b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:22 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-12cec8ba-c22e-49ef-b490-76429e3a2ae2 tempest-VolumeTypesAccessTest-1331579106 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9b795f94-805b-4bba-a5ae-1d05d899b8b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:22 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-12cec8ba-c22e-49ef-b490-76429e3a2ae2 tempest-VolumeTypesAccessTest-1331579106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (872f6c5f-e9de-49c3-beef-02ad937e6fd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:22 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-12cec8ba-c22e-49ef-b490-76429e3a2ae2 tempest-VolumeTypesAccessTest-1331579106 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (872f6c5f-e9de-49c3-beef-02ad937e6fd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0d4d6a6d-0f4c-42bf-ab6a-0cbc9edf9010', 'volume_name': 'volume-0d4d6a6d-0f4c-42bf-ab6a-0cbc9edf9010', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:22 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-12cec8ba-c22e-49ef-b490-76429e3a2ae2 tempest-VolumeTypesAccessTest-1331579106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df230a22-f7f5-4142-8b71-ee869223eefb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:22 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-12cec8ba-c22e-49ef-b490-76429e3a2ae2 tempest-VolumeTypesAccessTest-1331579106 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df230a22-f7f5-4142-8b71-ee869223eefb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:22 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-12cec8ba-c22e-49ef-b490-76429e3a2ae2 tempest-VolumeTypesAccessTest-1331579106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e0263d5-3219-4c82-ba52-3790fae3b50b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:22 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-12cec8ba-c22e-49ef-b490-76429e3a2ae2 tempest-VolumeTypesAccessTest-1331579106 None] Volume 0d4d6a6d-0f4c-42bf-ab6a-0cbc9edf9010: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0d4d6a6d-0f4c-42bf-ab6a-0cbc9edf9010', 'volume_size': 1} Nov 01 12:28:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-12cec8ba-c22e-49ef-b490-76429e3a2ae2 tempest-VolumeTypesAccessTest-1331579106 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-12cec8ba-c22e-49ef-b490-76429e3a2ae2 tempest-VolumeTypesAccessTest-1331579106 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:22 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-12cec8ba-c22e-49ef-b490-76429e3a2ae2 tempest-VolumeTypesAccessTest-1331579106 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:28:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1356270855',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0d4d6a6d-0f4c-42bf-ab6a-0cbc9edf9010,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='357a9de320af4d44ae3d574f5dc99c22',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:28:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:28:22Z,use_quota=True,user_id='ecbf266e633e475587b6f1577d1ca38a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(567f1ac9-f681-4202-8af7-cc2b9cc7fa45),volume_type_id=567f1ac9-f681-4202-8af7-cc2b9cc7fa45)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:28:22 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-12cec8ba-c22e-49ef-b490-76429e3a2ae2 tempest-VolumeTypesAccessTest-1331579106 None] Creating volume 0d4d6a6d-0f4c-42bf-ab6a-0cbc9edf9010 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:28:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-12cec8ba-c22e-49ef-b490-76429e3a2ae2 tempest-VolumeTypesAccessTest-1331579106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-12cec8ba-c22e-49ef-b490-76429e3a2ae2 tempest-VolumeTypesAccessTest-1331579106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:22 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-12cec8ba-c22e-49ef-b490-76429e3a2ae2 tempest-VolumeTypesAccessTest-1331579106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:28:22 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-12cec8ba-c22e-49ef-b490-76429e3a2ae2 tempest-VolumeTypesAccessTest-1331579106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:28:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-12cec8ba-c22e-49ef-b490-76429e3a2ae2 tempest-VolumeTypesAccessTest-1331579106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:22 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-12cec8ba-c22e-49ef-b490-76429e3a2ae2 tempest-VolumeTypesAccessTest-1331579106 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:28:22 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-12cec8ba-c22e-49ef-b490-76429e3a2ae2 tempest-VolumeTypesAccessTest-1331579106 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:28:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-12cec8ba-c22e-49ef-b490-76429e3a2ae2 tempest-VolumeTypesAccessTest-1331579106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0d4d6a6d-0f4c-42bf-ab6a-0cbc9edf9010 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:22 devstack sudo[97602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0d4d6a6d-0f4c-42bf-ab6a-0cbc9edf9010 1073741824 Nov 01 12:28:22 devstack sudo[97602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:22 devstack sudo[97602]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-12cec8ba-c22e-49ef-b490-76429e3a2ae2 tempest-VolumeTypesAccessTest-1331579106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0d4d6a6d-0f4c-42bf-ab6a-0cbc9edf9010 1073741824" returned: 0 in 0.567s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-12cec8ba-c22e-49ef-b490-76429e3a2ae2 tempest-VolumeTypesAccessTest-1331579106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0d4d6a6d-0f4c-42bf-ab6a-0cbc9edf9010 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:22 devstack sudo[97609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0d4d6a6d-0f4c-42bf-ab6a-0cbc9edf9010 Nov 01 12:28:22 devstack sudo[97609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:23 devstack sudo[97609]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-12cec8ba-c22e-49ef-b490-76429e3a2ae2 tempest-VolumeTypesAccessTest-1331579106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0d4d6a6d-0f4c-42bf-ab6a-0cbc9edf9010" returned: 0 in 0.345s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:23 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-12cec8ba-c22e-49ef-b490-76429e3a2ae2 tempest-VolumeTypesAccessTest-1331579106 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:28:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-12cec8ba-c22e-49ef-b490-76429e3a2ae2 tempest-VolumeTypesAccessTest-1331579106 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:23 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-12cec8ba-c22e-49ef-b490-76429e3a2ae2 tempest-VolumeTypesAccessTest-1331579106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3e0263d5-3219-4c82-ba52-3790fae3b50b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0d4d6a6d-0f4c-42bf-ab6a-0cbc9edf9010', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:23 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-12cec8ba-c22e-49ef-b490-76429e3a2ae2 tempest-VolumeTypesAccessTest-1331579106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bea25ca3-d7aa-4032-b836-e2bd172a046c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:23 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-12cec8ba-c22e-49ef-b490-76429e3a2ae2 tempest-VolumeTypesAccessTest-1331579106 None] Volume volume-0d4d6a6d-0f4c-42bf-ab6a-0cbc9edf9010 (0d4d6a6d-0f4c-42bf-ab6a-0cbc9edf9010): created successfully Nov 01 12:28:23 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-12cec8ba-c22e-49ef-b490-76429e3a2ae2 tempest-VolumeTypesAccessTest-1331579106 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bea25ca3-d7aa-4032-b836-e2bd172a046c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:23 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-12cec8ba-c22e-49ef-b490-76429e3a2ae2 tempest-VolumeTypesAccessTest-1331579106 None] Flow 'volume_create_manager' (16eb0cab-5629-426e-b5ed-1c21279eb7ab) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:28:23 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-12cec8ba-c22e-49ef-b490-76429e3a2ae2 tempest-VolumeTypesAccessTest-1331579106 None] Created volume successfully. Nov 01 12:28:24 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-c6e53297-0bc6-446f-b999-df41eeca703e tempest-VolumeTypesAccessTest-1331579106 None] Acquiring lock "cinder-0d4d6a6d-0f4c-42bf-ab6a-0cbc9edf9010-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:28:24 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-c6e53297-0bc6-446f-b999-df41eeca703e tempest-VolumeTypesAccessTest-1331579106 None] Lock "cinder-0d4d6a6d-0f4c-42bf-ab6a-0cbc9edf9010-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:28:24 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-c6e53297-0bc6-446f-b999-df41eeca703e tempest-VolumeTypesAccessTest-1331579106 None] Acquiring lock "cinder-quobyte-0d4d6a6d-0f4c-42bf-ab6a-0cbc9edf9010" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:28:24 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-c6e53297-0bc6-446f-b999-df41eeca703e tempest-VolumeTypesAccessTest-1331579106 None] Lock "cinder-quobyte-0d4d6a6d-0f4c-42bf-ab6a-0cbc9edf9010" acquired by "delete_volume" :: waited 0.028s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:28:24 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff19c40-bf19-4326-ba37-00e0fa6c93e1]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:28:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c6e53297-0bc6-446f-b999-df41eeca703e tempest-VolumeTypesAccessTest-1331579106 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0d4d6a6d-0f4c-42bf-ab6a-0cbc9edf9010 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:24 devstack sudo[97612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0d4d6a6d-0f4c-42bf-ab6a-0cbc9edf9010 Nov 01 12:28:24 devstack sudo[97612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:24 devstack sudo[97612]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c6e53297-0bc6-446f-b999-df41eeca703e tempest-VolumeTypesAccessTest-1331579106 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0d4d6a6d-0f4c-42bf-ab6a-0cbc9edf9010" returned: 0 in 0.543s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c6e53297-0bc6-446f-b999-df41eeca703e tempest-VolumeTypesAccessTest-1331579106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0d4d6a6d-0f4c-42bf-ab6a-0cbc9edf9010 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:24 devstack sudo[97617]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0d4d6a6d-0f4c-42bf-ab6a-0cbc9edf9010 Nov 01 12:28:24 devstack sudo[97617]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:25 devstack sudo[97617]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c6e53297-0bc6-446f-b999-df41eeca703e tempest-VolumeTypesAccessTest-1331579106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0d4d6a6d-0f4c-42bf-ab6a-0cbc9edf9010" returned: 0 in 0.395s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:25 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-c6e53297-0bc6-446f-b999-df41eeca703e tempest-VolumeTypesAccessTest-1331579106 None] Lock "cinder-quobyte-0d4d6a6d-0f4c-42bf-ab6a-0cbc9edf9010" released by "delete_volume" :: held 1.016s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:28:25 devstack cinder-volume[86574]: WARNING cinder.quota [None req-c6e53297-0bc6-446f-b999-df41eeca703e tempest-VolumeTypesAccessTest-1331579106 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-1802886262 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-1802886262, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:28:25 devstack cinder-volume[86574]: WARNING cinder.quota [None req-c6e53297-0bc6-446f-b999-df41eeca703e tempest-VolumeTypesAccessTest-1331579106 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-1802886262 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-1802886262, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:28:25 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-c6e53297-0bc6-446f-b999-df41eeca703e tempest-VolumeTypesAccessTest-1331579106 None] Created reservations ['dd4bc305-9cac-42a4-b3f3-d898b0266e29', 'b0862bde-c3d1-471f-816f-bf164b26573b', '08b7be63-3acc-4f83-a457-dc61a992ba07', '6c8a979a-a5cd-4292-8a06-d2167964505b'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:28:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-c6e53297-0bc6-446f-b999-df41eeca703e tempest-VolumeTypesAccessTest-1331579106 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-c6e53297-0bc6-446f-b999-df41eeca703e tempest-VolumeTypesAccessTest-1331579106 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:25 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-c6e53297-0bc6-446f-b999-df41eeca703e tempest-VolumeTypesAccessTest-1331579106 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:28:25 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-c6e53297-0bc6-446f-b999-df41eeca703e tempest-VolumeTypesAccessTest-1331579106 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:28:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-c6e53297-0bc6-446f-b999-df41eeca703e tempest-VolumeTypesAccessTest-1331579106 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c6e53297-0bc6-446f-b999-df41eeca703e tempest-VolumeTypesAccessTest-1331579106 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:25 devstack sudo[97620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:28:25 devstack sudo[97620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:26 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-edbe11e8-3a75-4723-89aa-29a1add8a3bf tempest-VolumeQuotasNegativeTestJSON-887952646 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:28:26 devstack sudo[97620]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-edbe11e8-3a75-4723-89aa-29a1add8a3bf tempest-VolumeQuotasNegativeTestJSON-887952646 None] Flow 'volume_create_manager' (8dd42a3a-0f1f-4a34-8110-6f672f5cb207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:28:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-edbe11e8-3a75-4723-89aa-29a1add8a3bf tempest-VolumeQuotasNegativeTestJSON-887952646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c449e011-58f3-4320-9fb5-6817006fc4fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c6e53297-0bc6-446f-b999-df41eeca703e tempest-VolumeTypesAccessTest-1331579106 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.616s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:26 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-c6e53297-0bc6-446f-b999-df41eeca703e tempest-VolumeTypesAccessTest-1331579106 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:28:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-edbe11e8-3a75-4723-89aa-29a1add8a3bf tempest-VolumeQuotasNegativeTestJSON-887952646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c449e011-58f3-4320-9fb5-6817006fc4fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-880635167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb77de62-1c8e-4f63-a125-836b0fdf6a3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62f8b524aac54869a66cf2fcfceca76e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:28:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:28:26Z,use_quota=True,user_id='cee57128ef154262b35398e03af6f204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-edbe11e8-3a75-4723-89aa-29a1add8a3bf tempest-VolumeQuotasNegativeTestJSON-887952646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4549689f-3036-4022-878f-2c362acfdad0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-edbe11e8-3a75-4723-89aa-29a1add8a3bf tempest-VolumeQuotasNegativeTestJSON-887952646 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4549689f-3036-4022-878f-2c362acfdad0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-edbe11e8-3a75-4723-89aa-29a1add8a3bf tempest-VolumeQuotasNegativeTestJSON-887952646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c85ca58e-ae1f-4db0-bb41-197ffed72366) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-edbe11e8-3a75-4723-89aa-29a1add8a3bf tempest-VolumeQuotasNegativeTestJSON-887952646 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c85ca58e-ae1f-4db0-bb41-197ffed72366) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb77de62-1c8e-4f63-a125-836b0fdf6a3a', 'volume_name': 'volume-eb77de62-1c8e-4f63-a125-836b0fdf6a3a', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-edbe11e8-3a75-4723-89aa-29a1add8a3bf tempest-VolumeQuotasNegativeTestJSON-887952646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9fa0154-2969-4410-ba16-6fd90a2f0ad2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-edbe11e8-3a75-4723-89aa-29a1add8a3bf tempest-VolumeQuotasNegativeTestJSON-887952646 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a9fa0154-2969-4410-ba16-6fd90a2f0ad2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-edbe11e8-3a75-4723-89aa-29a1add8a3bf tempest-VolumeQuotasNegativeTestJSON-887952646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d42257a3-2e3d-4028-aa42-0f574aff462e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:26 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-edbe11e8-3a75-4723-89aa-29a1add8a3bf tempest-VolumeQuotasNegativeTestJSON-887952646 None] Volume eb77de62-1c8e-4f63-a125-836b0fdf6a3a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb77de62-1c8e-4f63-a125-836b0fdf6a3a', 'volume_size': 1} Nov 01 12:28:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-edbe11e8-3a75-4723-89aa-29a1add8a3bf tempest-VolumeQuotasNegativeTestJSON-887952646 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-edbe11e8-3a75-4723-89aa-29a1add8a3bf tempest-VolumeQuotasNegativeTestJSON-887952646 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:26 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-edbe11e8-3a75-4723-89aa-29a1add8a3bf tempest-VolumeQuotasNegativeTestJSON-887952646 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:28:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-880635167',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb77de62-1c8e-4f63-a125-836b0fdf6a3a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='62f8b524aac54869a66cf2fcfceca76e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:28:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:28:26Z,use_quota=True,user_id='cee57128ef154262b35398e03af6f204',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:28:26 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-edbe11e8-3a75-4723-89aa-29a1add8a3bf tempest-VolumeQuotasNegativeTestJSON-887952646 None] Creating volume eb77de62-1c8e-4f63-a125-836b0fdf6a3a {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:28:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-edbe11e8-3a75-4723-89aa-29a1add8a3bf tempest-VolumeQuotasNegativeTestJSON-887952646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-edbe11e8-3a75-4723-89aa-29a1add8a3bf tempest-VolumeQuotasNegativeTestJSON-887952646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:26 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-edbe11e8-3a75-4723-89aa-29a1add8a3bf tempest-VolumeQuotasNegativeTestJSON-887952646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:28:26 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-edbe11e8-3a75-4723-89aa-29a1add8a3bf tempest-VolumeQuotasNegativeTestJSON-887952646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:28:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-edbe11e8-3a75-4723-89aa-29a1add8a3bf tempest-VolumeQuotasNegativeTestJSON-887952646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:26 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-edbe11e8-3a75-4723-89aa-29a1add8a3bf tempest-VolumeQuotasNegativeTestJSON-887952646 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:28:26 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-edbe11e8-3a75-4723-89aa-29a1add8a3bf tempest-VolumeQuotasNegativeTestJSON-887952646 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:28:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-edbe11e8-3a75-4723-89aa-29a1add8a3bf tempest-VolumeQuotasNegativeTestJSON-887952646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-eb77de62-1c8e-4f63-a125-836b0fdf6a3a 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:26 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-c6e53297-0bc6-446f-b999-df41eeca703e tempest-VolumeTypesAccessTest-1331579106 None] Deleted volume successfully. Nov 01 12:28:26 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-c6e53297-0bc6-446f-b999-df41eeca703e tempest-VolumeTypesAccessTest-1331579106 None] Lock "cinder-0d4d6a6d-0f4c-42bf-ab6a-0cbc9edf9010-delete_volume" released by "delete_volume" :: held 2.086s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:28:26 devstack sudo[97624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-eb77de62-1c8e-4f63-a125-836b0fdf6a3a 1073741824 Nov 01 12:28:26 devstack sudo[97624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:27 devstack sudo[97624]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-edbe11e8-3a75-4723-89aa-29a1add8a3bf tempest-VolumeQuotasNegativeTestJSON-887952646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-eb77de62-1c8e-4f63-a125-836b0fdf6a3a 1073741824" returned: 0 in 0.769s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-edbe11e8-3a75-4723-89aa-29a1add8a3bf tempest-VolumeQuotasNegativeTestJSON-887952646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-eb77de62-1c8e-4f63-a125-836b0fdf6a3a {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:27 devstack sudo[97630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-eb77de62-1c8e-4f63-a125-836b0fdf6a3a Nov 01 12:28:27 devstack sudo[97630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:27 devstack sudo[97630]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-edbe11e8-3a75-4723-89aa-29a1add8a3bf tempest-VolumeQuotasNegativeTestJSON-887952646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-eb77de62-1c8e-4f63-a125-836b0fdf6a3a" returned: 0 in 0.501s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:27 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-edbe11e8-3a75-4723-89aa-29a1add8a3bf tempest-VolumeQuotasNegativeTestJSON-887952646 None] <== create_volume: return (1346ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:28:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-edbe11e8-3a75-4723-89aa-29a1add8a3bf tempest-VolumeQuotasNegativeTestJSON-887952646 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.353s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-edbe11e8-3a75-4723-89aa-29a1add8a3bf tempest-VolumeQuotasNegativeTestJSON-887952646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d42257a3-2e3d-4028-aa42-0f574aff462e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb77de62-1c8e-4f63-a125-836b0fdf6a3a', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-edbe11e8-3a75-4723-89aa-29a1add8a3bf tempest-VolumeQuotasNegativeTestJSON-887952646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (757e8dbf-66b2-460b-b56a-58b49ad99526) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:27 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-edbe11e8-3a75-4723-89aa-29a1add8a3bf tempest-VolumeQuotasNegativeTestJSON-887952646 None] Volume volume-eb77de62-1c8e-4f63-a125-836b0fdf6a3a (eb77de62-1c8e-4f63-a125-836b0fdf6a3a): created successfully Nov 01 12:28:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-edbe11e8-3a75-4723-89aa-29a1add8a3bf tempest-VolumeQuotasNegativeTestJSON-887952646 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (757e8dbf-66b2-460b-b56a-58b49ad99526) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-edbe11e8-3a75-4723-89aa-29a1add8a3bf tempest-VolumeQuotasNegativeTestJSON-887952646 None] Flow 'volume_create_manager' (8dd42a3a-0f1f-4a34-8110-6f672f5cb207) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:28:27 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-edbe11e8-3a75-4723-89aa-29a1add8a3bf tempest-VolumeQuotasNegativeTestJSON-887952646 None] Created volume successfully. Nov 01 12:28:30 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6266a164-ddfd-43db-8599-b04f12dd42ad tempest-VolumeQuotasNegativeTestJSON-887952646 None] Acquiring lock "cinder-eb77de62-1c8e-4f63-a125-836b0fdf6a3a-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:28:30 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6266a164-ddfd-43db-8599-b04f12dd42ad tempest-VolumeQuotasNegativeTestJSON-887952646 None] Lock "cinder-eb77de62-1c8e-4f63-a125-836b0fdf6a3a-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:28:30 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6266a164-ddfd-43db-8599-b04f12dd42ad tempest-VolumeQuotasNegativeTestJSON-887952646 None] Acquiring lock "cinder-quobyte-eb77de62-1c8e-4f63-a125-836b0fdf6a3a" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:28:30 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6266a164-ddfd-43db-8599-b04f12dd42ad tempest-VolumeQuotasNegativeTestJSON-887952646 None] Lock "cinder-quobyte-eb77de62-1c8e-4f63-a125-836b0fdf6a3a" acquired by "delete_volume" :: waited 0.022s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:28:30 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[3731816c-d942-47ab-886b-982a170e130b]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:28:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6266a164-ddfd-43db-8599-b04f12dd42ad tempest-VolumeQuotasNegativeTestJSON-887952646 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-eb77de62-1c8e-4f63-a125-836b0fdf6a3a {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:30 devstack sudo[97668]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-eb77de62-1c8e-4f63-a125-836b0fdf6a3a Nov 01 12:28:30 devstack sudo[97668]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:30 devstack sudo[97668]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6266a164-ddfd-43db-8599-b04f12dd42ad tempest-VolumeQuotasNegativeTestJSON-887952646 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-eb77de62-1c8e-4f63-a125-836b0fdf6a3a" returned: 0 in 0.496s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6266a164-ddfd-43db-8599-b04f12dd42ad tempest-VolumeQuotasNegativeTestJSON-887952646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-eb77de62-1c8e-4f63-a125-836b0fdf6a3a {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:30 devstack sudo[97680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-eb77de62-1c8e-4f63-a125-836b0fdf6a3a Nov 01 12:28:30 devstack sudo[97680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:31 devstack sudo[97680]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6266a164-ddfd-43db-8599-b04f12dd42ad tempest-VolumeQuotasNegativeTestJSON-887952646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-eb77de62-1c8e-4f63-a125-836b0fdf6a3a" returned: 0 in 0.379s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:31 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6266a164-ddfd-43db-8599-b04f12dd42ad tempest-VolumeQuotasNegativeTestJSON-887952646 None] Lock "cinder-quobyte-eb77de62-1c8e-4f63-a125-836b0fdf6a3a" released by "delete_volume" :: held 0.943s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:28:31 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-6266a164-ddfd-43db-8599-b04f12dd42ad tempest-VolumeQuotasNegativeTestJSON-887952646 None] Created reservations ['68df8245-c42a-49cc-9e39-0d2e2f3b2e59', '6f240d42-f41c-4caf-9e3b-22070929137e', 'd723f883-d933-4e52-b30c-2a7d483129ce', '0ff4db53-498c-45ef-ad4d-2db92e7439d0'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:28:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-6266a164-ddfd-43db-8599-b04f12dd42ad tempest-VolumeQuotasNegativeTestJSON-887952646 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-6266a164-ddfd-43db-8599-b04f12dd42ad tempest-VolumeQuotasNegativeTestJSON-887952646 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:31 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-6266a164-ddfd-43db-8599-b04f12dd42ad tempest-VolumeQuotasNegativeTestJSON-887952646 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:28:31 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-6266a164-ddfd-43db-8599-b04f12dd42ad tempest-VolumeQuotasNegativeTestJSON-887952646 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:28:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-6266a164-ddfd-43db-8599-b04f12dd42ad tempest-VolumeQuotasNegativeTestJSON-887952646 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6266a164-ddfd-43db-8599-b04f12dd42ad tempest-VolumeQuotasNegativeTestJSON-887952646 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:31 devstack sudo[97683]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:28:31 devstack sudo[97683]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:31 devstack sudo[97683]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6266a164-ddfd-43db-8599-b04f12dd42ad tempest-VolumeQuotasNegativeTestJSON-887952646 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.299s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:31 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-6266a164-ddfd-43db-8599-b04f12dd42ad tempest-VolumeQuotasNegativeTestJSON-887952646 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:28:31 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-6266a164-ddfd-43db-8599-b04f12dd42ad tempest-VolumeQuotasNegativeTestJSON-887952646 None] Deleted volume successfully. Nov 01 12:28:31 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6266a164-ddfd-43db-8599-b04f12dd42ad tempest-VolumeQuotasNegativeTestJSON-887952646 None] Lock "cinder-eb77de62-1c8e-4f63-a125-836b0fdf6a3a-delete_volume" released by "delete_volume" :: held 1.583s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:28:39 devstack cinder-volume[86574]: DEBUG oslo_service.periodic_task [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86574) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:28:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:28:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:28:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:39 devstack sudo[97799]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:28:39 devstack sudo[97799]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:40 devstack sudo[97799]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.407s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:40 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:28:40 devstack cinder-volume[86574]: DEBUG oslo_service.periodic_task [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running periodic task VolumeManager._thread_info {{(pid=86574) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:28:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] thread count: 28 {{(pid=86574) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 12:28:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] thread info: [<_MainThread(MainThread, started 131331184930944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86574) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 12:28:41 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:SELECT=14,cinder:INSERT=5,cinder:UPDATE=23,cinder:DELETE=1 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:28:41 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:SELECT=13,cinder:UPDATE=20,cinder:DELETE=3,cinder:INSERT=5 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:28:46 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:28:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] Flow 'volume_create_manager' (edc74624-4585-4ac8-9151-9e439cb01125) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:28:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (707e474d-1d91-4a08-b60b-4c7bb6cdd135) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (707e474d-1d91-4a08-b60b-4c7bb6cdd135) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-88796777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c5cde7f-8cb2-4c83-b07d-aecb28344fc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb4f13e6c60b414ebcd3b417fa075510',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:28:46Z,use_quota=True,user_id='b1dafc5661dc4ef1aff37d2e0bfaa2b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efa54ebb-d439-40b3-a1a1-48812ca37f71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (efa54ebb-d439-40b3-a1a1-48812ca37f71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3a0ab86-b82d-4d00-8bfc-2a57655a0878) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:46 devstack cinder-volume[86574]: DEBUG cinder.image.glance [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] Creating Keystone auth plugin from conf {{(pid=86574) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 01 12:28:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d3a0ab86-b82d-4d00-8bfc-2a57655a0878) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '2c5cde7f-8cb2-4c83-b07d-aecb28344fc8', 'volume_name': 'volume-2c5cde7f-8cb2-4c83-b07d-aecb28344fc8', 'volume_size': 1, 'image_id': 'f937a0d6-76b6-4a84-a698-e474557181cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f937a0d6-76b6-4a84-a698-e474557181cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4892ea0f5a04c4d8b924ece0f60a2a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f937a0d6-76b6-4a84-a698-e474557181cd', 'created_at': datetime.datetime(2026, 11, 1, 11, 14, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 14, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f937a0d6-76b6-4a84-a698-e474557181cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0b6be11-bbd3-4884-835a-19d77bdba9ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0b6be11-bbd3-4884-835a-19d77bdba9ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e599e382-995a-476d-94c5-380df35cf540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:47 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] Volume 2c5cde7f-8cb2-4c83-b07d-aecb28344fc8: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-2c5cde7f-8cb2-4c83-b07d-aecb28344fc8', 'volume_size': 1, 'image_id': 'f937a0d6-76b6-4a84-a698-e474557181cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f937a0d6-76b6-4a84-a698-e474557181cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4892ea0f5a04c4d8b924ece0f60a2a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f937a0d6-76b6-4a84-a698-e474557181cd', 'created_at': datetime.datetime(2026, 11, 1, 11, 14, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 14, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f937a0d6-76b6-4a84-a698-e474557181cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 01 12:28:47 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] Trying to clone 2c5cde7f-8cb2-4c83-b07d-aecb28344fc8 from image f937a0d6-76b6-4a84-a698-e474557181cd at location (None, [{'url': 'file:///opt/stack/data/glance/images/f937a0d6-76b6-4a84-a698-e474557181cd', 'metadata': {}}]). {{(pid=86574) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 01 12:28:47 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_ptoth4e4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86574) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 01 12:28:47 devstack cinder-volume[86574]: INFO cinder.image.image_utils [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] Image download 20.69 MB at 20.69 MB/s Nov 01 12:28:47 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[1dd40c40-f26e-4832-822d-416e83800354]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:28:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_ptoth4e4devstack@QuobyteHD {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:47 devstack sudo[97817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_ptoth4e4devstack@QuobyteHD Nov 01 12:28:47 devstack sudo[97817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:48 devstack sudo[97817]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_ptoth4e4devstack@QuobyteHD" returned: 0 in 0.398s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:48 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] Temporary image f937a0d6-76b6-4a84-a698-e474557181cd is fetched for user b1dafc5661dc4ef1aff37d2e0bfaa2b5. {{(pid=86574) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 01 12:28:48 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb651e29-7d62-4bc7-a583-2978badb2a71]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:28:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_ptoth4e4devstack@QuobyteHD {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:48 devstack sudo[97823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_ptoth4e4devstack@QuobyteHD Nov 01 12:28:48 devstack sudo[97823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:48 devstack sudo[97823]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_ptoth4e4devstack@QuobyteHD" returned: 0 in 0.364s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:48 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:28:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-88796777',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2c5cde7f-8cb2-4c83-b07d-aecb28344fc8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fb4f13e6c60b414ebcd3b417fa075510',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:28:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:28:46Z,use_quota=True,user_id='b1dafc5661dc4ef1aff37d2e0bfaa2b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:28:48 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] Creating volume 2c5cde7f-8cb2-4c83-b07d-aecb28344fc8 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:28:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:48 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:28:48 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:28:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:48 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:28:48 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:28:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-2c5cde7f-8cb2-4c83-b07d-aecb28344fc8 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:48 devstack sudo[97829]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-2c5cde7f-8cb2-4c83-b07d-aecb28344fc8 1073741824 Nov 01 12:28:48 devstack sudo[97829]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:49 devstack sudo[97829]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-2c5cde7f-8cb2-4c83-b07d-aecb28344fc8 1073741824" returned: 0 in 0.521s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-2c5cde7f-8cb2-4c83-b07d-aecb28344fc8 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:49 devstack sudo[97835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-2c5cde7f-8cb2-4c83-b07d-aecb28344fc8 Nov 01 12:28:49 devstack sudo[97835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:49 devstack sudo[97835]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-2c5cde7f-8cb2-4c83-b07d-aecb28344fc8" returned: 0 in 0.318s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:49 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] <== create_volume: return (898ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:28:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.903s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:49 devstack cinder-volume[86574]: DEBUG cinder.volume.volume_utils [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] Attempting download of f937a0d6-76b6-4a84-a698-e474557181cd ((None, [{'url': 'file:///opt/stack/data/glance/images/f937a0d6-76b6-4a84-a698-e474557181cd', 'metadata': {}}])) to volume 2c5cde7f-8cb2-4c83-b07d-aecb28344fc8. {{(pid=86574) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 01 12:28:49 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[4df85e21-6e68-4dbe-88a5-5e8602f18b89]: (4, 'raw') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:28:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f937a0d6-76b6-4a84-a698-e474557181cd_glx9gp5e {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:49 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-e77ef985-a5c8-46aa-a019-39d1b414c838 tempest-VolumesListAdminTestJSON-1397181012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:28:49 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e77ef985-a5c8-46aa-a019-39d1b414c838 tempest-VolumesListAdminTestJSON-1397181012 None] Flow 'volume_create_manager' (4894e9db-9ff8-4c3f-92d7-f2f371fcdda6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:28:49 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e77ef985-a5c8-46aa-a019-39d1b414c838 tempest-VolumesListAdminTestJSON-1397181012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c25187e-c90d-4fda-a420-53e6be0a02f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:49 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e77ef985-a5c8-46aa-a019-39d1b414c838 tempest-VolumesListAdminTestJSON-1397181012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9c25187e-c90d-4fda-a420-53e6be0a02f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1073071874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52bd8059-8588-4253-bfbd-3e48fbf45cdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a863054ef6cc4d9e9abff11f66eae4c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:28:49Z,use_quota=True,user_id='8c91e567be8f4b768f284b946cee5c41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:49 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e77ef985-a5c8-46aa-a019-39d1b414c838 tempest-VolumesListAdminTestJSON-1397181012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0352bb6-88e3-4b81-86bd-fd70d5bcc6cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:49 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e77ef985-a5c8-46aa-a019-39d1b414c838 tempest-VolumesListAdminTestJSON-1397181012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0352bb6-88e3-4b81-86bd-fd70d5bcc6cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:49 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e77ef985-a5c8-46aa-a019-39d1b414c838 tempest-VolumesListAdminTestJSON-1397181012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a291242-5961-4ce7-895f-744f48303e59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:49 devstack sudo[97838]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f937a0d6-76b6-4a84-a698-e474557181cd_glx9gp5e Nov 01 12:28:49 devstack sudo[97838]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:49 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e77ef985-a5c8-46aa-a019-39d1b414c838 tempest-VolumesListAdminTestJSON-1397181012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a291242-5961-4ce7-895f-744f48303e59) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '52bd8059-8588-4253-bfbd-3e48fbf45cdd', 'volume_name': 'volume-52bd8059-8588-4253-bfbd-3e48fbf45cdd', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:49 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e77ef985-a5c8-46aa-a019-39d1b414c838 tempest-VolumesListAdminTestJSON-1397181012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b20a02fb-7331-422a-aaec-2feeed9883ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:49 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e77ef985-a5c8-46aa-a019-39d1b414c838 tempest-VolumesListAdminTestJSON-1397181012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b20a02fb-7331-422a-aaec-2feeed9883ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:49 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e77ef985-a5c8-46aa-a019-39d1b414c838 tempest-VolumesListAdminTestJSON-1397181012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5f7a3f7-07bb-46a4-9701-9f7356b9be55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:49 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-e77ef985-a5c8-46aa-a019-39d1b414c838 tempest-VolumesListAdminTestJSON-1397181012 None] Volume 52bd8059-8588-4253-bfbd-3e48fbf45cdd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-52bd8059-8588-4253-bfbd-3e48fbf45cdd', 'volume_size': 1} Nov 01 12:28:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e77ef985-a5c8-46aa-a019-39d1b414c838 tempest-VolumesListAdminTestJSON-1397181012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e77ef985-a5c8-46aa-a019-39d1b414c838 tempest-VolumesListAdminTestJSON-1397181012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:49 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e77ef985-a5c8-46aa-a019-39d1b414c838 tempest-VolumesListAdminTestJSON-1397181012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:28:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1073071874',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=52bd8059-8588-4253-bfbd-3e48fbf45cdd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a863054ef6cc4d9e9abff11f66eae4c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:28:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:28:49Z,use_quota=True,user_id='8c91e567be8f4b768f284b946cee5c41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:28:49 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-e77ef985-a5c8-46aa-a019-39d1b414c838 tempest-VolumesListAdminTestJSON-1397181012 None] Creating volume 52bd8059-8588-4253-bfbd-3e48fbf45cdd {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:28:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e77ef985-a5c8-46aa-a019-39d1b414c838 tempest-VolumesListAdminTestJSON-1397181012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e77ef985-a5c8-46aa-a019-39d1b414c838 tempest-VolumesListAdminTestJSON-1397181012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:49 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e77ef985-a5c8-46aa-a019-39d1b414c838 tempest-VolumesListAdminTestJSON-1397181012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:28:49 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e77ef985-a5c8-46aa-a019-39d1b414c838 tempest-VolumesListAdminTestJSON-1397181012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:28:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e77ef985-a5c8-46aa-a019-39d1b414c838 tempest-VolumesListAdminTestJSON-1397181012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:49 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e77ef985-a5c8-46aa-a019-39d1b414c838 tempest-VolumesListAdminTestJSON-1397181012 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:28:49 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-e77ef985-a5c8-46aa-a019-39d1b414c838 tempest-VolumesListAdminTestJSON-1397181012 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:28:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e77ef985-a5c8-46aa-a019-39d1b414c838 tempest-VolumesListAdminTestJSON-1397181012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-52bd8059-8588-4253-bfbd-3e48fbf45cdd 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:49 devstack sudo[97840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-52bd8059-8588-4253-bfbd-3e48fbf45cdd 1073741824 Nov 01 12:28:49 devstack sudo[97840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:49 devstack sudo[97838]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f937a0d6-76b6-4a84-a698-e474557181cd_glx9gp5e" returned: 0 in 0.357s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f937a0d6-76b6-4a84-a698-e474557181cd_glx9gp5e {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:50 devstack sudo[97844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f937a0d6-76b6-4a84-a698-e474557181cd_glx9gp5e Nov 01 12:28:50 devstack sudo[97844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:50 devstack sudo[97840]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e77ef985-a5c8-46aa-a019-39d1b414c838 tempest-VolumesListAdminTestJSON-1397181012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-52bd8059-8588-4253-bfbd-3e48fbf45cdd 1073741824" returned: 0 in 0.488s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e77ef985-a5c8-46aa-a019-39d1b414c838 tempest-VolumesListAdminTestJSON-1397181012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-52bd8059-8588-4253-bfbd-3e48fbf45cdd {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:50 devstack sudo[97850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-52bd8059-8588-4253-bfbd-3e48fbf45cdd Nov 01 12:28:50 devstack sudo[97850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:50 devstack sudo[97844]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f937a0d6-76b6-4a84-a698-e474557181cd_glx9gp5e" returned: 1 in 0.384s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f937a0d6-76b6-4a84-a698-e474557181cd_glx9gp5e' failed. Not Retrying. {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 12:28:50 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[31e99063-2852-4161-bce7-7556b16e6954]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:28:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_ptoth4e4devstack@QuobyteHD {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:50 devstack sudo[97854]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_ptoth4e4devstack@QuobyteHD Nov 01 12:28:50 devstack sudo[97854]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:50 devstack sudo[97850]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e77ef985-a5c8-46aa-a019-39d1b414c838 tempest-VolumesListAdminTestJSON-1397181012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-52bd8059-8588-4253-bfbd-3e48fbf45cdd" returned: 0 in 0.295s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:50 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e77ef985-a5c8-46aa-a019-39d1b414c838 tempest-VolumesListAdminTestJSON-1397181012 None] <== create_volume: return (850ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:28:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e77ef985-a5c8-46aa-a019-39d1b414c838 tempest-VolumesListAdminTestJSON-1397181012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e77ef985-a5c8-46aa-a019-39d1b414c838 tempest-VolumesListAdminTestJSON-1397181012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5f7a3f7-07bb-46a4-9701-9f7356b9be55) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-52bd8059-8588-4253-bfbd-3e48fbf45cdd', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e77ef985-a5c8-46aa-a019-39d1b414c838 tempest-VolumesListAdminTestJSON-1397181012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00b215ba-6f38-4a6a-8397-a62b37ce2880) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:50 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-e77ef985-a5c8-46aa-a019-39d1b414c838 tempest-VolumesListAdminTestJSON-1397181012 None] Volume volume-52bd8059-8588-4253-bfbd-3e48fbf45cdd (52bd8059-8588-4253-bfbd-3e48fbf45cdd): created successfully Nov 01 12:28:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e77ef985-a5c8-46aa-a019-39d1b414c838 tempest-VolumesListAdminTestJSON-1397181012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00b215ba-6f38-4a6a-8397-a62b37ce2880) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e77ef985-a5c8-46aa-a019-39d1b414c838 tempest-VolumesListAdminTestJSON-1397181012 None] Flow 'volume_create_manager' (4894e9db-9ff8-4c3f-92d7-f2f371fcdda6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:28:50 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-e77ef985-a5c8-46aa-a019-39d1b414c838 tempest-VolumesListAdminTestJSON-1397181012 None] Created volume successfully. Nov 01 12:28:50 devstack sudo[97854]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_ptoth4e4devstack@QuobyteHD" returned: 0 in 0.358s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:50 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] f937a0d6-76b6-4a84-a698-e474557181cd was qcow2, converting to qcow2 {{(pid=86574) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 01 12:28:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_ptoth4e4devstack@QuobyteHD /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-2c5cde7f-8cb2-4c83-b07d-aecb28344fc8 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:50 devstack sudo[97860]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_ptoth4e4devstack@QuobyteHD /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-2c5cde7f-8cb2-4c83-b07d-aecb28344fc8 Nov 01 12:28:50 devstack sudo[97860]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:52 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-b818d20b-7282-46a2-a693-45da6eb3de6e tempest-VolumesListAdminTestJSON-1397181012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:28:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b818d20b-7282-46a2-a693-45da6eb3de6e tempest-VolumesListAdminTestJSON-1397181012 None] Flow 'volume_create_manager' (f489e9b3-2ce0-4500-aef7-e30d2612b37c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:28:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b818d20b-7282-46a2-a693-45da6eb3de6e tempest-VolumesListAdminTestJSON-1397181012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dc2f4d3-2632-4d99-9707-78edb8dd8153) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b818d20b-7282-46a2-a693-45da6eb3de6e tempest-VolumesListAdminTestJSON-1397181012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3dc2f4d3-2632-4d99-9707-78edb8dd8153) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:28:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-302450019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0765c2ac-6237-4776-9f9f-1a6a66830072,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a863054ef6cc4d9e9abff11f66eae4c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:28:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:28:52Z,use_quota=True,user_id='8c91e567be8f4b768f284b946cee5c41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b818d20b-7282-46a2-a693-45da6eb3de6e tempest-VolumesListAdminTestJSON-1397181012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de761e12-9bec-48ee-a79b-777562bbeef3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b818d20b-7282-46a2-a693-45da6eb3de6e tempest-VolumesListAdminTestJSON-1397181012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de761e12-9bec-48ee-a79b-777562bbeef3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b818d20b-7282-46a2-a693-45da6eb3de6e tempest-VolumesListAdminTestJSON-1397181012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c91b5bb-ffda-4928-9d3b-fe71543cebb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b818d20b-7282-46a2-a693-45da6eb3de6e tempest-VolumesListAdminTestJSON-1397181012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5c91b5bb-ffda-4928-9d3b-fe71543cebb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0765c2ac-6237-4776-9f9f-1a6a66830072', 'volume_name': 'volume-0765c2ac-6237-4776-9f9f-1a6a66830072', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b818d20b-7282-46a2-a693-45da6eb3de6e tempest-VolumesListAdminTestJSON-1397181012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0eea48e-6424-4290-b133-c2d57c40418b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b818d20b-7282-46a2-a693-45da6eb3de6e tempest-VolumesListAdminTestJSON-1397181012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f0eea48e-6424-4290-b133-c2d57c40418b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b818d20b-7282-46a2-a693-45da6eb3de6e tempest-VolumesListAdminTestJSON-1397181012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e46f578e-a3ec-4b0b-b7fe-560a9a9b26e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:52 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-b818d20b-7282-46a2-a693-45da6eb3de6e tempest-VolumesListAdminTestJSON-1397181012 None] Volume 0765c2ac-6237-4776-9f9f-1a6a66830072: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0765c2ac-6237-4776-9f9f-1a6a66830072', 'volume_size': 1} Nov 01 12:28:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b818d20b-7282-46a2-a693-45da6eb3de6e tempest-VolumesListAdminTestJSON-1397181012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b818d20b-7282-46a2-a693-45da6eb3de6e tempest-VolumesListAdminTestJSON-1397181012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:52 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-b818d20b-7282-46a2-a693-45da6eb3de6e tempest-VolumesListAdminTestJSON-1397181012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:28:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-302450019',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0765c2ac-6237-4776-9f9f-1a6a66830072,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a863054ef6cc4d9e9abff11f66eae4c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:28:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:28:52Z,use_quota=True,user_id='8c91e567be8f4b768f284b946cee5c41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:28:52 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-b818d20b-7282-46a2-a693-45da6eb3de6e tempest-VolumesListAdminTestJSON-1397181012 None] Creating volume 0765c2ac-6237-4776-9f9f-1a6a66830072 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:28:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b818d20b-7282-46a2-a693-45da6eb3de6e tempest-VolumesListAdminTestJSON-1397181012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b818d20b-7282-46a2-a693-45da6eb3de6e tempest-VolumesListAdminTestJSON-1397181012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:52 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-b818d20b-7282-46a2-a693-45da6eb3de6e tempest-VolumesListAdminTestJSON-1397181012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:28:52 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-b818d20b-7282-46a2-a693-45da6eb3de6e tempest-VolumesListAdminTestJSON-1397181012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:28:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b818d20b-7282-46a2-a693-45da6eb3de6e tempest-VolumesListAdminTestJSON-1397181012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:52 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-b818d20b-7282-46a2-a693-45da6eb3de6e tempest-VolumesListAdminTestJSON-1397181012 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:28:52 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-b818d20b-7282-46a2-a693-45da6eb3de6e tempest-VolumesListAdminTestJSON-1397181012 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:28:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b818d20b-7282-46a2-a693-45da6eb3de6e tempest-VolumesListAdminTestJSON-1397181012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0765c2ac-6237-4776-9f9f-1a6a66830072 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:52 devstack sudo[97873]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0765c2ac-6237-4776-9f9f-1a6a66830072 1073741824 Nov 01 12:28:52 devstack sudo[97873]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:52 devstack sudo[97860]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_ptoth4e4devstack@QuobyteHD /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-2c5cde7f-8cb2-4c83-b07d-aecb28344fc8" returned: 0 in 2.069s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:52 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_ptoth4e4devstack@QuobyteHD, size 112.00 MB, duration 2.07 sec, destination /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-2c5cde7f-8cb2-4c83-b07d-aecb28344fc8 {{(pid=86574) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 12:28:52 devstack cinder-volume[86574]: INFO cinder.image.image_utils [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] Converted 112.00 MB image at 54.08 MB/s Nov 01 12:28:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-2c5cde7f-8cb2-4c83-b07d-aecb28344fc8 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:52 devstack sudo[97878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-2c5cde7f-8cb2-4c83-b07d-aecb28344fc8 1G Nov 01 12:28:52 devstack sudo[97878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:52 devstack sudo[97873]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b818d20b-7282-46a2-a693-45da6eb3de6e tempest-VolumesListAdminTestJSON-1397181012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0765c2ac-6237-4776-9f9f-1a6a66830072 1073741824" returned: 0 in 0.544s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b818d20b-7282-46a2-a693-45da6eb3de6e tempest-VolumesListAdminTestJSON-1397181012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0765c2ac-6237-4776-9f9f-1a6a66830072 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:52 devstack sudo[97881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0765c2ac-6237-4776-9f9f-1a6a66830072 Nov 01 12:28:52 devstack sudo[97881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:53 devstack sudo[97878]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-2c5cde7f-8cb2-4c83-b07d-aecb28344fc8 1G" returned: 0 in 0.445s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:53 devstack cinder-volume[86574]: DEBUG cinder.volume.volume_utils [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] Downloaded image f937a0d6-76b6-4a84-a698-e474557181cd ((None, [{'url': 'file:///opt/stack/data/glance/images/f937a0d6-76b6-4a84-a698-e474557181cd', 'metadata': {}}])) to volume 2c5cde7f-8cb2-4c83-b07d-aecb28344fc8 successfully. {{(pid=86574) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 01 12:28:53 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] Temporary image f937a0d6-76b6-4a84-a698-e474557181cd for user b1dafc5661dc4ef1aff37d2e0bfaa2b5 is deleted. {{(pid=86574) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 01 12:28:53 devstack cinder-volume[86574]: DEBUG cinder.volume.volume_utils [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] Marking volume 2c5cde7f-8cb2-4c83-b07d-aecb28344fc8 as bootable. {{(pid=86574) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 01 12:28:53 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] Copying metadata from image f937a0d6-76b6-4a84-a698-e474557181cd to 2c5cde7f-8cb2-4c83-b07d-aecb28344fc8. {{(pid=86574) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 01 12:28:53 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] Creating volume glance metadata for volume 2c5cde7f-8cb2-4c83-b07d-aecb28344fc8 backed by image f937a0d6-76b6-4a84-a698-e474557181cd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f937a0d6-76b6-4a84-a698-e474557181cd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86574) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 01 12:28:53 devstack sudo[97881]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b818d20b-7282-46a2-a693-45da6eb3de6e tempest-VolumesListAdminTestJSON-1397181012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0765c2ac-6237-4776-9f9f-1a6a66830072" returned: 0 in 0.268s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:53 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-b818d20b-7282-46a2-a693-45da6eb3de6e tempest-VolumesListAdminTestJSON-1397181012 None] <== create_volume: return (917ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:28:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b818d20b-7282-46a2-a693-45da6eb3de6e tempest-VolumesListAdminTestJSON-1397181012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b818d20b-7282-46a2-a693-45da6eb3de6e tempest-VolumesListAdminTestJSON-1397181012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e46f578e-a3ec-4b0b-b7fe-560a9a9b26e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0765c2ac-6237-4776-9f9f-1a6a66830072', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b818d20b-7282-46a2-a693-45da6eb3de6e tempest-VolumesListAdminTestJSON-1397181012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e288e5ee-79fd-4767-8f83-8ad3f8cf73ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:53 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-b818d20b-7282-46a2-a693-45da6eb3de6e tempest-VolumesListAdminTestJSON-1397181012 None] Volume volume-0765c2ac-6237-4776-9f9f-1a6a66830072 (0765c2ac-6237-4776-9f9f-1a6a66830072): created successfully Nov 01 12:28:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b818d20b-7282-46a2-a693-45da6eb3de6e tempest-VolumesListAdminTestJSON-1397181012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e288e5ee-79fd-4767-8f83-8ad3f8cf73ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b818d20b-7282-46a2-a693-45da6eb3de6e tempest-VolumesListAdminTestJSON-1397181012 None] Flow 'volume_create_manager' (f489e9b3-2ce0-4500-aef7-e30d2612b37c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:28:53 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-b818d20b-7282-46a2-a693-45da6eb3de6e tempest-VolumesListAdminTestJSON-1397181012 None] Created volume successfully. Nov 01 12:28:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e599e382-995a-476d-94c5-380df35cf540) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2c5cde7f-8cb2-4c83-b07d-aecb28344fc8', 'volume_size': 1, 'image_id': 'f937a0d6-76b6-4a84-a698-e474557181cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f937a0d6-76b6-4a84-a698-e474557181cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4892ea0f5a04c4d8b924ece0f60a2a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f937a0d6-76b6-4a84-a698-e474557181cd', 'created_at': datetime.datetime(2026, 11, 1, 11, 14, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 14, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f937a0d6-76b6-4a84-a698-e474557181cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8098baf-2df9-4dc9-950e-330ee2b7f198) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:53 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] Volume volume-2c5cde7f-8cb2-4c83-b07d-aecb28344fc8 (2c5cde7f-8cb2-4c83-b07d-aecb28344fc8): created successfully Nov 01 12:28:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b8098baf-2df9-4dc9-950e-330ee2b7f198) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] Flow 'volume_create_manager' (edc74624-4585-4ac8-9151-9e439cb01125) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:28:53 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-2becb6a0-62bf-4ee6-8bc3-653b6791918a tempest-TestShelveInstance-1384273023 None] Created volume successfully. Nov 01 12:28:55 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-5c313dd8-016e-49d9-b169-6190cd1b574a tempest-VolumesListAdminTestJSON-1397181012 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:28:55 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5c313dd8-016e-49d9-b169-6190cd1b574a tempest-VolumesListAdminTestJSON-1397181012 None] Flow 'volume_create_manager' (10e7cb2b-c57d-405c-84b9-be32afa890ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:28:55 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5c313dd8-016e-49d9-b169-6190cd1b574a tempest-VolumesListAdminTestJSON-1397181012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adca198c-fa76-4661-9650-874c135ff58e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:55 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5c313dd8-016e-49d9-b169-6190cd1b574a tempest-VolumesListAdminTestJSON-1397181012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adca198c-fa76-4661-9650-874c135ff58e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-659882423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=615e4274-b4a6-4033-b175-956b1b32d6c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a863054ef6cc4d9e9abff11f66eae4c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:28:55Z,use_quota=True,user_id='8c91e567be8f4b768f284b946cee5c41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:55 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5c313dd8-016e-49d9-b169-6190cd1b574a tempest-VolumesListAdminTestJSON-1397181012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71f3af38-c53b-443b-807b-9211647c8c7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:55 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5c313dd8-016e-49d9-b169-6190cd1b574a tempest-VolumesListAdminTestJSON-1397181012 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (71f3af38-c53b-443b-807b-9211647c8c7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:55 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5c313dd8-016e-49d9-b169-6190cd1b574a tempest-VolumesListAdminTestJSON-1397181012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15e1c3ef-544e-4300-97da-05eeefbc425d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:55 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5c313dd8-016e-49d9-b169-6190cd1b574a tempest-VolumesListAdminTestJSON-1397181012 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (15e1c3ef-544e-4300-97da-05eeefbc425d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '615e4274-b4a6-4033-b175-956b1b32d6c6', 'volume_name': 'volume-615e4274-b4a6-4033-b175-956b1b32d6c6', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:55 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5c313dd8-016e-49d9-b169-6190cd1b574a tempest-VolumesListAdminTestJSON-1397181012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd4125d5-2af4-405d-a07b-e3dcb4e8e832) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:55 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5c313dd8-016e-49d9-b169-6190cd1b574a tempest-VolumesListAdminTestJSON-1397181012 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd4125d5-2af4-405d-a07b-e3dcb4e8e832) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:55 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5c313dd8-016e-49d9-b169-6190cd1b574a tempest-VolumesListAdminTestJSON-1397181012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15245f6c-30b6-42d8-8dd4-20c595b691d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:55 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-5c313dd8-016e-49d9-b169-6190cd1b574a tempest-VolumesListAdminTestJSON-1397181012 None] Volume 615e4274-b4a6-4033-b175-956b1b32d6c6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-615e4274-b4a6-4033-b175-956b1b32d6c6', 'volume_size': 1} Nov 01 12:28:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5c313dd8-016e-49d9-b169-6190cd1b574a tempest-VolumesListAdminTestJSON-1397181012 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5c313dd8-016e-49d9-b169-6190cd1b574a tempest-VolumesListAdminTestJSON-1397181012 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:55 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-5c313dd8-016e-49d9-b169-6190cd1b574a tempest-VolumesListAdminTestJSON-1397181012 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:28:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-659882423',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=615e4274-b4a6-4033-b175-956b1b32d6c6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a863054ef6cc4d9e9abff11f66eae4c9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:28:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:28:55Z,use_quota=True,user_id='8c91e567be8f4b768f284b946cee5c41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:28:55 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-5c313dd8-016e-49d9-b169-6190cd1b574a tempest-VolumesListAdminTestJSON-1397181012 None] Creating volume 615e4274-b4a6-4033-b175-956b1b32d6c6 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:28:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5c313dd8-016e-49d9-b169-6190cd1b574a tempest-VolumesListAdminTestJSON-1397181012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5c313dd8-016e-49d9-b169-6190cd1b574a tempest-VolumesListAdminTestJSON-1397181012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:55 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-5c313dd8-016e-49d9-b169-6190cd1b574a tempest-VolumesListAdminTestJSON-1397181012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:28:55 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-5c313dd8-016e-49d9-b169-6190cd1b574a tempest-VolumesListAdminTestJSON-1397181012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:28:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5c313dd8-016e-49d9-b169-6190cd1b574a tempest-VolumesListAdminTestJSON-1397181012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:55 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-5c313dd8-016e-49d9-b169-6190cd1b574a tempest-VolumesListAdminTestJSON-1397181012 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:28:55 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-5c313dd8-016e-49d9-b169-6190cd1b574a tempest-VolumesListAdminTestJSON-1397181012 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:28:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5c313dd8-016e-49d9-b169-6190cd1b574a tempest-VolumesListAdminTestJSON-1397181012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-615e4274-b4a6-4033-b175-956b1b32d6c6 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:55 devstack sudo[97887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-615e4274-b4a6-4033-b175-956b1b32d6c6 1073741824 Nov 01 12:28:55 devstack sudo[97887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:55 devstack sudo[97887]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5c313dd8-016e-49d9-b169-6190cd1b574a tempest-VolumesListAdminTestJSON-1397181012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-615e4274-b4a6-4033-b175-956b1b32d6c6 1073741824" returned: 0 in 0.567s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5c313dd8-016e-49d9-b169-6190cd1b574a tempest-VolumesListAdminTestJSON-1397181012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-615e4274-b4a6-4033-b175-956b1b32d6c6 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:55 devstack sudo[97896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-615e4274-b4a6-4033-b175-956b1b32d6c6 Nov 01 12:28:55 devstack sudo[97896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:56 devstack sudo[97896]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5c313dd8-016e-49d9-b169-6190cd1b574a tempest-VolumesListAdminTestJSON-1397181012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-615e4274-b4a6-4033-b175-956b1b32d6c6" returned: 0 in 0.333s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:56 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-5c313dd8-016e-49d9-b169-6190cd1b574a tempest-VolumesListAdminTestJSON-1397181012 None] <== create_volume: return (951ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:28:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5c313dd8-016e-49d9-b169-6190cd1b574a tempest-VolumesListAdminTestJSON-1397181012 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.956s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:56 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5c313dd8-016e-49d9-b169-6190cd1b574a tempest-VolumesListAdminTestJSON-1397181012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (15245f6c-30b6-42d8-8dd4-20c595b691d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-615e4274-b4a6-4033-b175-956b1b32d6c6', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:56 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5c313dd8-016e-49d9-b169-6190cd1b574a tempest-VolumesListAdminTestJSON-1397181012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bccfb05-fe59-4db6-852e-f1d965356d55) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:56 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-5c313dd8-016e-49d9-b169-6190cd1b574a tempest-VolumesListAdminTestJSON-1397181012 None] Volume volume-615e4274-b4a6-4033-b175-956b1b32d6c6 (615e4274-b4a6-4033-b175-956b1b32d6c6): created successfully Nov 01 12:28:56 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5c313dd8-016e-49d9-b169-6190cd1b574a tempest-VolumesListAdminTestJSON-1397181012 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4bccfb05-fe59-4db6-852e-f1d965356d55) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:56 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5c313dd8-016e-49d9-b169-6190cd1b574a tempest-VolumesListAdminTestJSON-1397181012 None] Flow 'volume_create_manager' (10e7cb2b-c57d-405c-84b9-be32afa890ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:28:56 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-5c313dd8-016e-49d9-b169-6190cd1b574a tempest-VolumesListAdminTestJSON-1397181012 None] Created volume successfully. Nov 01 12:28:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-04260961-811d-4a8e-bd84-c595cf418db5 req-2494bd82-5541-4e6d-acf6-a9771ffa7d53 tempest-TestShelveInstance-1384273023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-04260961-811d-4a8e-bd84-c595cf418db5 req-2494bd82-5541-4e6d-acf6-a9771ffa7d53 tempest-TestShelveInstance-1384273023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-04260961-811d-4a8e-bd84-c595cf418db5 req-2494bd82-5541-4e6d-acf6-a9771ffa7d53 tempest-TestShelveInstance-1384273023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:57 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-04260961-811d-4a8e-bd84-c595cf418db5 req-2494bd82-5541-4e6d-acf6-a9771ffa7d53 tempest-TestShelveInstance-1384273023 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb', 'name': 'volume-2c5cde7f-8cb2-4c83-b07d-aecb28344fc8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bfdb6644-73f5-4d53-a535-f7b4dea5fb31', 'enforce_multipath': True} {{(pid=86574) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 12:28:57 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-04260961-811d-4a8e-bd84-c595cf418db5 req-2494bd82-5541-4e6d-acf6-a9771ffa7d53 tempest-TestShelveInstance-1384273023 None] attachment_update completed successfully. Nov 01 12:28:58 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-968d6758-f3ea-4c66-af72-1196635ca83e tempest-VolumesListAdminTestJSON-618490848 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:28:58 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-968d6758-f3ea-4c66-af72-1196635ca83e tempest-VolumesListAdminTestJSON-618490848 None] Flow 'volume_create_manager' (73dd61dd-2e41-4d4d-bdf1-df8e4692747f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:28:58 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-968d6758-f3ea-4c66-af72-1196635ca83e tempest-VolumesListAdminTestJSON-618490848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1852f0cd-d26c-4b4e-a310-a03be2f61b47) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:58 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-968d6758-f3ea-4c66-af72-1196635ca83e tempest-VolumesListAdminTestJSON-618490848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1852f0cd-d26c-4b4e-a310-a03be2f61b47) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0a9472e-2df3-4dab-9f5e-18cd4ac93d0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9a9c7801da2428197196cd6c306c8ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:28:59Z,use_quota=True,user_id='7546f3749fb540ee838c85ba8e5482e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:58 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-968d6758-f3ea-4c66-af72-1196635ca83e tempest-VolumesListAdminTestJSON-618490848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ae07589-0a45-4240-8998-f2bf361da1b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:58 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-968d6758-f3ea-4c66-af72-1196635ca83e tempest-VolumesListAdminTestJSON-618490848 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2ae07589-0a45-4240-8998-f2bf361da1b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:58 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-968d6758-f3ea-4c66-af72-1196635ca83e tempest-VolumesListAdminTestJSON-618490848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4559c375-fe4f-4c2b-a1f0-4875b35b35d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:58 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-968d6758-f3ea-4c66-af72-1196635ca83e tempest-VolumesListAdminTestJSON-618490848 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4559c375-fe4f-4c2b-a1f0-4875b35b35d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a0a9472e-2df3-4dab-9f5e-18cd4ac93d0b', 'volume_name': 'volume-a0a9472e-2df3-4dab-9f5e-18cd4ac93d0b', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:58 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-968d6758-f3ea-4c66-af72-1196635ca83e tempest-VolumesListAdminTestJSON-618490848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97966c04-e86f-427d-b935-0992253122ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:58 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-968d6758-f3ea-4c66-af72-1196635ca83e tempest-VolumesListAdminTestJSON-618490848 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (97966c04-e86f-427d-b935-0992253122ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:28:58 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-968d6758-f3ea-4c66-af72-1196635ca83e tempest-VolumesListAdminTestJSON-618490848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5b1105b-f55e-4df2-8a75-2f9126706b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:28:58 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-968d6758-f3ea-4c66-af72-1196635ca83e tempest-VolumesListAdminTestJSON-618490848 None] Volume a0a9472e-2df3-4dab-9f5e-18cd4ac93d0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a0a9472e-2df3-4dab-9f5e-18cd4ac93d0b', 'volume_size': 1} Nov 01 12:28:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-968d6758-f3ea-4c66-af72-1196635ca83e tempest-VolumesListAdminTestJSON-618490848 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-968d6758-f3ea-4c66-af72-1196635ca83e tempest-VolumesListAdminTestJSON-618490848 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:58 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-968d6758-f3ea-4c66-af72-1196635ca83e tempest-VolumesListAdminTestJSON-618490848 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:28:58Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a0a9472e-2df3-4dab-9f5e-18cd4ac93d0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9a9c7801da2428197196cd6c306c8ae',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:28:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:28:59Z,use_quota=True,user_id='7546f3749fb540ee838c85ba8e5482e8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:28:58 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-968d6758-f3ea-4c66-af72-1196635ca83e tempest-VolumesListAdminTestJSON-618490848 None] Creating volume a0a9472e-2df3-4dab-9f5e-18cd4ac93d0b {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:28:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-968d6758-f3ea-4c66-af72-1196635ca83e tempest-VolumesListAdminTestJSON-618490848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:28:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-968d6758-f3ea-4c66-af72-1196635ca83e tempest-VolumesListAdminTestJSON-618490848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:28:58 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-968d6758-f3ea-4c66-af72-1196635ca83e tempest-VolumesListAdminTestJSON-618490848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:28:58 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-968d6758-f3ea-4c66-af72-1196635ca83e tempest-VolumesListAdminTestJSON-618490848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:28:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-968d6758-f3ea-4c66-af72-1196635ca83e tempest-VolumesListAdminTestJSON-618490848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:28:58 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-968d6758-f3ea-4c66-af72-1196635ca83e tempest-VolumesListAdminTestJSON-618490848 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:28:58 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-968d6758-f3ea-4c66-af72-1196635ca83e tempest-VolumesListAdminTestJSON-618490848 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:28:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-968d6758-f3ea-4c66-af72-1196635ca83e tempest-VolumesListAdminTestJSON-618490848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-a0a9472e-2df3-4dab-9f5e-18cd4ac93d0b 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:58 devstack sudo[97911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-a0a9472e-2df3-4dab-9f5e-18cd4ac93d0b 1073741824 Nov 01 12:28:58 devstack sudo[97911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:28:59 devstack sudo[97911]: pam_unix(sudo:session): session closed for user root Nov 01 12:28:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-968d6758-f3ea-4c66-af72-1196635ca83e tempest-VolumesListAdminTestJSON-618490848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-a0a9472e-2df3-4dab-9f5e-18cd4ac93d0b 1073741824" returned: 0 in 0.845s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:28:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-968d6758-f3ea-4c66-af72-1196635ca83e tempest-VolumesListAdminTestJSON-618490848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-a0a9472e-2df3-4dab-9f5e-18cd4ac93d0b {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:28:59 devstack sudo[97938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-a0a9472e-2df3-4dab-9f5e-18cd4ac93d0b Nov 01 12:28:59 devstack sudo[97938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:00 devstack sudo[97938]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-968d6758-f3ea-4c66-af72-1196635ca83e tempest-VolumesListAdminTestJSON-618490848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-a0a9472e-2df3-4dab-9f5e-18cd4ac93d0b" returned: 0 in 0.423s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:00 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-968d6758-f3ea-4c66-af72-1196635ca83e tempest-VolumesListAdminTestJSON-618490848 None] <== create_volume: return (1339ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:29:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-968d6758-f3ea-4c66-af72-1196635ca83e tempest-VolumesListAdminTestJSON-618490848 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.342s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:29:00 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-968d6758-f3ea-4c66-af72-1196635ca83e tempest-VolumesListAdminTestJSON-618490848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f5b1105b-f55e-4df2-8a75-2f9126706b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a0a9472e-2df3-4dab-9f5e-18cd4ac93d0b', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:00 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-968d6758-f3ea-4c66-af72-1196635ca83e tempest-VolumesListAdminTestJSON-618490848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad93824a-a38c-4890-903a-2fab13b4d064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:00 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-968d6758-f3ea-4c66-af72-1196635ca83e tempest-VolumesListAdminTestJSON-618490848 None] Volume volume-a0a9472e-2df3-4dab-9f5e-18cd4ac93d0b (a0a9472e-2df3-4dab-9f5e-18cd4ac93d0b): created successfully Nov 01 12:29:00 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-968d6758-f3ea-4c66-af72-1196635ca83e tempest-VolumesListAdminTestJSON-618490848 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ad93824a-a38c-4890-903a-2fab13b4d064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:00 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-968d6758-f3ea-4c66-af72-1196635ca83e tempest-VolumesListAdminTestJSON-618490848 None] Flow 'volume_create_manager' (73dd61dd-2e41-4d4d-bdf1-df8e4692747f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:29:00 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-968d6758-f3ea-4c66-af72-1196635ca83e tempest-VolumesListAdminTestJSON-618490848 None] Created volume successfully. Nov 01 12:29:00 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-bf6a7f5e-4da3-49c3-ba76-2fa3d54d0060 tempest-VolumesListAdminTestJSON-618490848 None] Acquiring lock "cinder-a0a9472e-2df3-4dab-9f5e-18cd4ac93d0b-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:29:00 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-bf6a7f5e-4da3-49c3-ba76-2fa3d54d0060 tempest-VolumesListAdminTestJSON-618490848 None] Lock "cinder-a0a9472e-2df3-4dab-9f5e-18cd4ac93d0b-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:29:00 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-bf6a7f5e-4da3-49c3-ba76-2fa3d54d0060 tempest-VolumesListAdminTestJSON-618490848 None] Acquiring lock "cinder-quobyte-a0a9472e-2df3-4dab-9f5e-18cd4ac93d0b" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:29:00 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-bf6a7f5e-4da3-49c3-ba76-2fa3d54d0060 tempest-VolumesListAdminTestJSON-618490848 None] Lock "cinder-quobyte-a0a9472e-2df3-4dab-9f5e-18cd4ac93d0b" acquired by "delete_volume" :: waited 0.025s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:29:00 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff0547ab-d74c-429a-81df-7aad72def914]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:29:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bf6a7f5e-4da3-49c3-ba76-2fa3d54d0060 tempest-VolumesListAdminTestJSON-618490848 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-a0a9472e-2df3-4dab-9f5e-18cd4ac93d0b {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:01 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f1890b83-f735-4706-a555-b0624a526436 tempest-VolumesListAdminTestJSON-1397181012 None] Acquiring lock "cinder-615e4274-b4a6-4033-b175-956b1b32d6c6-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:29:01 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f1890b83-f735-4706-a555-b0624a526436 tempest-VolumesListAdminTestJSON-1397181012 None] Lock "cinder-615e4274-b4a6-4033-b175-956b1b32d6c6-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:29:01 devstack sudo[97944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-a0a9472e-2df3-4dab-9f5e-18cd4ac93d0b Nov 01 12:29:01 devstack sudo[97944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:01 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f1890b83-f735-4706-a555-b0624a526436 tempest-VolumesListAdminTestJSON-1397181012 None] Acquiring lock "cinder-quobyte-615e4274-b4a6-4033-b175-956b1b32d6c6" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:29:01 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f1890b83-f735-4706-a555-b0624a526436 tempest-VolumesListAdminTestJSON-1397181012 None] Lock "cinder-quobyte-615e4274-b4a6-4033-b175-956b1b32d6c6" acquired by "delete_volume" :: waited 0.026s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:29:01 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[53102c68-ec2b-4592-b42e-fec0c95c36e8]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:29:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f1890b83-f735-4706-a555-b0624a526436 tempest-VolumesListAdminTestJSON-1397181012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-615e4274-b4a6-4033-b175-956b1b32d6c6 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:01 devstack sudo[97946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-615e4274-b4a6-4033-b175-956b1b32d6c6 Nov 01 12:29:01 devstack sudo[97946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:01 devstack sudo[97944]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bf6a7f5e-4da3-49c3-ba76-2fa3d54d0060 tempest-VolumesListAdminTestJSON-618490848 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-a0a9472e-2df3-4dab-9f5e-18cd4ac93d0b" returned: 0 in 0.855s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bf6a7f5e-4da3-49c3-ba76-2fa3d54d0060 tempest-VolumesListAdminTestJSON-618490848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-a0a9472e-2df3-4dab-9f5e-18cd4ac93d0b {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:01 devstack sudo[98051]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-a0a9472e-2df3-4dab-9f5e-18cd4ac93d0b Nov 01 12:29:01 devstack sudo[98051]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:01 devstack sudo[97946]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f1890b83-f735-4706-a555-b0624a526436 tempest-VolumesListAdminTestJSON-1397181012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-615e4274-b4a6-4033-b175-956b1b32d6c6" returned: 0 in 0.626s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f1890b83-f735-4706-a555-b0624a526436 tempest-VolumesListAdminTestJSON-1397181012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-615e4274-b4a6-4033-b175-956b1b32d6c6 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:01 devstack sudo[98055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-615e4274-b4a6-4033-b175-956b1b32d6c6 Nov 01 12:29:01 devstack sudo[98055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:02 devstack sudo[98055]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f1890b83-f735-4706-a555-b0624a526436 tempest-VolumesListAdminTestJSON-1397181012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-615e4274-b4a6-4033-b175-956b1b32d6c6" returned: 0 in 0.553s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bf6a7f5e-4da3-49c3-ba76-2fa3d54d0060 tempest-VolumesListAdminTestJSON-618490848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-a0a9472e-2df3-4dab-9f5e-18cd4ac93d0b" returned: 0 in 0.705s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:02 devstack sudo[98051]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:02 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f1890b83-f735-4706-a555-b0624a526436 tempest-VolumesListAdminTestJSON-1397181012 None] Lock "cinder-quobyte-615e4274-b4a6-4033-b175-956b1b32d6c6" released by "delete_volume" :: held 1.328s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:29:02 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-bf6a7f5e-4da3-49c3-ba76-2fa3d54d0060 tempest-VolumesListAdminTestJSON-618490848 None] Lock "cinder-quobyte-a0a9472e-2df3-4dab-9f5e-18cd4ac93d0b" released by "delete_volume" :: held 1.701s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:29:02 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-f1890b83-f735-4706-a555-b0624a526436 tempest-VolumesListAdminTestJSON-1397181012 None] Created reservations ['326bc06d-4671-4dd9-9ccf-6d94207fd568', 'a392193f-e4ec-417a-9775-d8b4bb672168', 'e14c02ef-609c-4f64-aec2-664e0fc4178e', 'dd729974-e7e3-4fd5-b9ef-1330eaad2f04'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:29:02 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-bf6a7f5e-4da3-49c3-ba76-2fa3d54d0060 tempest-VolumesListAdminTestJSON-618490848 None] Created reservations ['c1f09371-0e7c-4a36-b0ac-d5067da7606c', '9ab7b30a-2fa0-4c38-8aa0-c661214a0c64', 'bcfe9d3e-c2b1-46b6-a89e-6d0c437a4315', '6fc700bc-ce36-4119-bde1-81af0b6298e1'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:29:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f1890b83-f735-4706-a555-b0624a526436 tempest-VolumesListAdminTestJSON-1397181012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:29:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f1890b83-f735-4706-a555-b0624a526436 tempest-VolumesListAdminTestJSON-1397181012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:29:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f1890b83-f735-4706-a555-b0624a526436 tempest-VolumesListAdminTestJSON-1397181012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:29:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f1890b83-f735-4706-a555-b0624a526436 tempest-VolumesListAdminTestJSON-1397181012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:29:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f1890b83-f735-4706-a555-b0624a526436 tempest-VolumesListAdminTestJSON-1397181012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:29:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f1890b83-f735-4706-a555-b0624a526436 tempest-VolumesListAdminTestJSON-1397181012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-bf6a7f5e-4da3-49c3-ba76-2fa3d54d0060 tempest-VolumesListAdminTestJSON-618490848 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:29:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-bf6a7f5e-4da3-49c3-ba76-2fa3d54d0060 tempest-VolumesListAdminTestJSON-618490848 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:29:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-bf6a7f5e-4da3-49c3-ba76-2fa3d54d0060 tempest-VolumesListAdminTestJSON-618490848 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:29:03 devstack sudo[98423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:29:03 devstack sudo[98423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-bf6a7f5e-4da3-49c3-ba76-2fa3d54d0060 tempest-VolumesListAdminTestJSON-618490848 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:29:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-bf6a7f5e-4da3-49c3-ba76-2fa3d54d0060 tempest-VolumesListAdminTestJSON-618490848 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:29:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bf6a7f5e-4da3-49c3-ba76-2fa3d54d0060 tempest-VolumesListAdminTestJSON-618490848 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:03 devstack sudo[98428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:29:03 devstack sudo[98428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:03 devstack sudo[98423]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f1890b83-f735-4706-a555-b0624a526436 tempest-VolumesListAdminTestJSON-1397181012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.468s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:03 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-f1890b83-f735-4706-a555-b0624a526436 tempest-VolumesListAdminTestJSON-1397181012 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:29:03 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-f1890b83-f735-4706-a555-b0624a526436 tempest-VolumesListAdminTestJSON-1397181012 None] Deleted volume successfully. Nov 01 12:29:03 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f1890b83-f735-4706-a555-b0624a526436 tempest-VolumesListAdminTestJSON-1397181012 None] Lock "cinder-615e4274-b4a6-4033-b175-956b1b32d6c6-delete_volume" released by "delete_volume" :: held 2.470s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:29:03 devstack sudo[98428]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bf6a7f5e-4da3-49c3-ba76-2fa3d54d0060 tempest-VolumesListAdminTestJSON-618490848 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.584s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:03 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-bf6a7f5e-4da3-49c3-ba76-2fa3d54d0060 tempest-VolumesListAdminTestJSON-618490848 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:29:03 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-bf6a7f5e-4da3-49c3-ba76-2fa3d54d0060 tempest-VolumesListAdminTestJSON-618490848 None] Deleted volume successfully. Nov 01 12:29:03 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d43884b8-043c-44a9-bccb-59e6281725f8 tempest-VolumesListAdminTestJSON-1397181012 None] Acquiring lock "cinder-0765c2ac-6237-4776-9f9f-1a6a66830072-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:29:03 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d43884b8-043c-44a9-bccb-59e6281725f8 tempest-VolumesListAdminTestJSON-1397181012 None] Lock "cinder-0765c2ac-6237-4776-9f9f-1a6a66830072-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:29:03 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-bf6a7f5e-4da3-49c3-ba76-2fa3d54d0060 tempest-VolumesListAdminTestJSON-618490848 None] Lock "cinder-a0a9472e-2df3-4dab-9f5e-18cd4ac93d0b-delete_volume" released by "delete_volume" :: held 3.005s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:29:03 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d43884b8-043c-44a9-bccb-59e6281725f8 tempest-VolumesListAdminTestJSON-1397181012 None] Acquiring lock "cinder-quobyte-0765c2ac-6237-4776-9f9f-1a6a66830072" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:29:03 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d43884b8-043c-44a9-bccb-59e6281725f8 tempest-VolumesListAdminTestJSON-1397181012 None] Lock "cinder-quobyte-0765c2ac-6237-4776-9f9f-1a6a66830072" acquired by "delete_volume" :: waited 0.023s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:29:03 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[4676180b-41f4-4cae-b8db-9949ea4ebb4e]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:29:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d43884b8-043c-44a9-bccb-59e6281725f8 tempest-VolumesListAdminTestJSON-1397181012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0765c2ac-6237-4776-9f9f-1a6a66830072 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:04 devstack sudo[98445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0765c2ac-6237-4776-9f9f-1a6a66830072 Nov 01 12:29:04 devstack sudo[98445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:04 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-07e7a53b-706d-41de-a2a3-b5cd0c913c8b tempest-AttachVolumeShelveTestJSON-916880141 None] Acquiring lock "cinder-29158f88-ff3b-46f0-b825-6b63f0cf1e20-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:29:04 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-07e7a53b-706d-41de-a2a3-b5cd0c913c8b tempest-AttachVolumeShelveTestJSON-916880141 None] Lock "cinder-29158f88-ff3b-46f0-b825-6b63f0cf1e20-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:29:04 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-07e7a53b-706d-41de-a2a3-b5cd0c913c8b tempest-AttachVolumeShelveTestJSON-916880141 None] Acquiring lock "cinder-quobyte-29158f88-ff3b-46f0-b825-6b63f0cf1e20" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:29:04 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-07e7a53b-706d-41de-a2a3-b5cd0c913c8b tempest-AttachVolumeShelveTestJSON-916880141 None] Lock "cinder-quobyte-29158f88-ff3b-46f0-b825-6b63f0cf1e20" acquired by "delete_volume" :: waited 0.019s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:29:04 devstack sudo[98445]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d43884b8-043c-44a9-bccb-59e6281725f8 tempest-VolumesListAdminTestJSON-1397181012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0765c2ac-6237-4776-9f9f-1a6a66830072" returned: 0 in 0.592s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d43884b8-043c-44a9-bccb-59e6281725f8 tempest-VolumesListAdminTestJSON-1397181012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0765c2ac-6237-4776-9f9f-1a6a66830072 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:04 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[09c21e78-1a01-454a-9274-0c031d1c73da]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:29:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-07e7a53b-706d-41de-a2a3-b5cd0c913c8b tempest-AttachVolumeShelveTestJSON-916880141 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-29158f88-ff3b-46f0-b825-6b63f0cf1e20 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:04 devstack sudo[98452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0765c2ac-6237-4776-9f9f-1a6a66830072 Nov 01 12:29:04 devstack sudo[98452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:04 devstack sudo[98454]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-29158f88-ff3b-46f0-b825-6b63f0cf1e20 Nov 01 12:29:04 devstack sudo[98454]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:05 devstack sudo[98452]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d43884b8-043c-44a9-bccb-59e6281725f8 tempest-VolumesListAdminTestJSON-1397181012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0765c2ac-6237-4776-9f9f-1a6a66830072" returned: 0 in 0.672s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:05 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d43884b8-043c-44a9-bccb-59e6281725f8 tempest-VolumesListAdminTestJSON-1397181012 None] Lock "cinder-quobyte-0765c2ac-6237-4776-9f9f-1a6a66830072" released by "delete_volume" :: held 1.357s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:29:05 devstack sudo[98454]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-07e7a53b-706d-41de-a2a3-b5cd0c913c8b tempest-AttachVolumeShelveTestJSON-916880141 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-29158f88-ff3b-46f0-b825-6b63f0cf1e20" returned: 0 in 0.671s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-07e7a53b-706d-41de-a2a3-b5cd0c913c8b tempest-AttachVolumeShelveTestJSON-916880141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-29158f88-ff3b-46f0-b825-6b63f0cf1e20 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:05 devstack sudo[98460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-29158f88-ff3b-46f0-b825-6b63f0cf1e20 Nov 01 12:29:05 devstack sudo[98460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:05 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-d43884b8-043c-44a9-bccb-59e6281725f8 tempest-VolumesListAdminTestJSON-1397181012 None] Created reservations ['882b1258-b8a6-46bb-a1ec-51d318814773', 'e1cd03d3-a323-4ca7-a698-d9353c0f09d8', '776080c4-7880-46e4-8ee3-3fdf45a88b4d', 'b51e0fd7-adea-41f4-845a-7ef7a0e033dd'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:29:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d43884b8-043c-44a9-bccb-59e6281725f8 tempest-VolumesListAdminTestJSON-1397181012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:29:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d43884b8-043c-44a9-bccb-59e6281725f8 tempest-VolumesListAdminTestJSON-1397181012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:29:05 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d43884b8-043c-44a9-bccb-59e6281725f8 tempest-VolumesListAdminTestJSON-1397181012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:29:05 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d43884b8-043c-44a9-bccb-59e6281725f8 tempest-VolumesListAdminTestJSON-1397181012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:29:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d43884b8-043c-44a9-bccb-59e6281725f8 tempest-VolumesListAdminTestJSON-1397181012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:29:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d43884b8-043c-44a9-bccb-59e6281725f8 tempest-VolumesListAdminTestJSON-1397181012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:05 devstack sudo[98462]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:29:05 devstack sudo[98462]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:05 devstack sudo[98460]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-07e7a53b-706d-41de-a2a3-b5cd0c913c8b tempest-AttachVolumeShelveTestJSON-916880141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-29158f88-ff3b-46f0-b825-6b63f0cf1e20" returned: 0 in 0.363s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:05 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-07e7a53b-706d-41de-a2a3-b5cd0c913c8b tempest-AttachVolumeShelveTestJSON-916880141 None] Lock "cinder-quobyte-29158f88-ff3b-46f0-b825-6b63f0cf1e20" released by "delete_volume" :: held 1.165s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:29:05 devstack sudo[98462]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:05 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-07e7a53b-706d-41de-a2a3-b5cd0c913c8b tempest-AttachVolumeShelveTestJSON-916880141 None] Created reservations ['b7bc6529-c501-4c1a-91c2-db18e8c9a314', '757e6fd3-2655-4645-b7b3-55ed6d777525', '5c681b0c-756d-46be-bd94-572ea3bb7d22', '4bed4179-7b5f-46cb-8c1e-4dd0324f3e71'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:29:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d43884b8-043c-44a9-bccb-59e6281725f8 tempest-VolumesListAdminTestJSON-1397181012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.324s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:05 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-d43884b8-043c-44a9-bccb-59e6281725f8 tempest-VolumesListAdminTestJSON-1397181012 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:29:05 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-d43884b8-043c-44a9-bccb-59e6281725f8 tempest-VolumesListAdminTestJSON-1397181012 None] Deleted volume successfully. Nov 01 12:29:05 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d43884b8-043c-44a9-bccb-59e6281725f8 tempest-VolumesListAdminTestJSON-1397181012 None] Lock "cinder-0765c2ac-6237-4776-9f9f-1a6a66830072-delete_volume" released by "delete_volume" :: held 2.029s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:29:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-07e7a53b-706d-41de-a2a3-b5cd0c913c8b tempest-AttachVolumeShelveTestJSON-916880141 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:29:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-07e7a53b-706d-41de-a2a3-b5cd0c913c8b tempest-AttachVolumeShelveTestJSON-916880141 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:29:05 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-07e7a53b-706d-41de-a2a3-b5cd0c913c8b tempest-AttachVolumeShelveTestJSON-916880141 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:29:05 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-07e7a53b-706d-41de-a2a3-b5cd0c913c8b tempest-AttachVolumeShelveTestJSON-916880141 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:29:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-07e7a53b-706d-41de-a2a3-b5cd0c913c8b tempest-AttachVolumeShelveTestJSON-916880141 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:29:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-07e7a53b-706d-41de-a2a3-b5cd0c913c8b tempest-AttachVolumeShelveTestJSON-916880141 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:05 devstack sudo[98466]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:29:05 devstack sudo[98466]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:06 devstack sudo[98466]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-07e7a53b-706d-41de-a2a3-b5cd0c913c8b tempest-AttachVolumeShelveTestJSON-916880141 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.461s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:06 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-07e7a53b-706d-41de-a2a3-b5cd0c913c8b tempest-AttachVolumeShelveTestJSON-916880141 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:29:06 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-07e7a53b-706d-41de-a2a3-b5cd0c913c8b tempest-AttachVolumeShelveTestJSON-916880141 None] Deleted volume successfully. Nov 01 12:29:06 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-07e7a53b-706d-41de-a2a3-b5cd0c913c8b tempest-AttachVolumeShelveTestJSON-916880141 None] Lock "cinder-29158f88-ff3b-46f0-b825-6b63f0cf1e20-delete_volume" released by "delete_volume" :: held 1.932s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:29:06 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-2af1d98a-a3cb-465c-9ed3-0ce5481f305d tempest-VolumesListAdminTestJSON-1397181012 None] Acquiring lock "cinder-52bd8059-8588-4253-bfbd-3e48fbf45cdd-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:29:06 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-2af1d98a-a3cb-465c-9ed3-0ce5481f305d tempest-VolumesListAdminTestJSON-1397181012 None] Lock "cinder-52bd8059-8588-4253-bfbd-3e48fbf45cdd-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:29:06 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-2af1d98a-a3cb-465c-9ed3-0ce5481f305d tempest-VolumesListAdminTestJSON-1397181012 None] Acquiring lock "cinder-quobyte-52bd8059-8588-4253-bfbd-3e48fbf45cdd" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:29:06 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-2af1d98a-a3cb-465c-9ed3-0ce5481f305d tempest-VolumesListAdminTestJSON-1397181012 None] Lock "cinder-quobyte-52bd8059-8588-4253-bfbd-3e48fbf45cdd" acquired by "delete_volume" :: waited 0.021s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:29:06 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[89d54901-1a30-48ab-b0e4-7397a53fbb50]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:29:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2af1d98a-a3cb-465c-9ed3-0ce5481f305d tempest-VolumesListAdminTestJSON-1397181012 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-52bd8059-8588-4253-bfbd-3e48fbf45cdd {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:06 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-5df6aa5c-323e-4e2b-9ec9-cad3b6ba7465 tempest-VolumesGetTest-2085089695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:29:06 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5df6aa5c-323e-4e2b-9ec9-cad3b6ba7465 tempest-VolumesGetTest-2085089695 None] Flow 'volume_create_manager' (aad4f9a8-f9be-4320-9b8b-003f97e05672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:29:06 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5df6aa5c-323e-4e2b-9ec9-cad3b6ba7465 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c2f5db0-2d0e-4142-b423-e151e541a1bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:06 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5df6aa5c-323e-4e2b-9ec9-cad3b6ba7465 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4c2f5db0-2d0e-4142-b423-e151e541a1bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:29:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-41010001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fb7a6ef-0ce8-43cf-8b10-18adb773324d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a63e120aaecb4ae28ad7cea68cca3834',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:29:07Z,use_quota=True,user_id='c7cc9459190a4f0d93d032c6c18de9ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:06 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5df6aa5c-323e-4e2b-9ec9-cad3b6ba7465 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac253828-ecfd-449f-96b7-d833ac23eb25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:06 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5df6aa5c-323e-4e2b-9ec9-cad3b6ba7465 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac253828-ecfd-449f-96b7-d833ac23eb25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:06 devstack sudo[98471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-52bd8059-8588-4253-bfbd-3e48fbf45cdd Nov 01 12:29:06 devstack sudo[98471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:06 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5df6aa5c-323e-4e2b-9ec9-cad3b6ba7465 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df05388e-f2c2-48e8-808a-bbe574696137) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:06 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5df6aa5c-323e-4e2b-9ec9-cad3b6ba7465 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (df05388e-f2c2-48e8-808a-bbe574696137) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1fb7a6ef-0ce8-43cf-8b10-18adb773324d', 'volume_name': 'volume-1fb7a6ef-0ce8-43cf-8b10-18adb773324d', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:06 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5df6aa5c-323e-4e2b-9ec9-cad3b6ba7465 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aaa4c71-dbb1-4e29-9a46-43f1dcba1fc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:06 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5df6aa5c-323e-4e2b-9ec9-cad3b6ba7465 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aaa4c71-dbb1-4e29-9a46-43f1dcba1fc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:06 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5df6aa5c-323e-4e2b-9ec9-cad3b6ba7465 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7be0fcc-3dc3-4c18-abc3-c4a12b30d730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:06 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-5df6aa5c-323e-4e2b-9ec9-cad3b6ba7465 tempest-VolumesGetTest-2085089695 None] Volume 1fb7a6ef-0ce8-43cf-8b10-18adb773324d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1fb7a6ef-0ce8-43cf-8b10-18adb773324d', 'volume_size': 1} Nov 01 12:29:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5df6aa5c-323e-4e2b-9ec9-cad3b6ba7465 tempest-VolumesGetTest-2085089695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:29:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5df6aa5c-323e-4e2b-9ec9-cad3b6ba7465 tempest-VolumesGetTest-2085089695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:29:06 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-5df6aa5c-323e-4e2b-9ec9-cad3b6ba7465 tempest-VolumesGetTest-2085089695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:29:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-41010001',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1fb7a6ef-0ce8-43cf-8b10-18adb773324d,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a63e120aaecb4ae28ad7cea68cca3834',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:29:07Z,use_quota=True,user_id='c7cc9459190a4f0d93d032c6c18de9ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:29:06 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-5df6aa5c-323e-4e2b-9ec9-cad3b6ba7465 tempest-VolumesGetTest-2085089695 None] Creating volume 1fb7a6ef-0ce8-43cf-8b10-18adb773324d {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:29:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5df6aa5c-323e-4e2b-9ec9-cad3b6ba7465 tempest-VolumesGetTest-2085089695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:29:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5df6aa5c-323e-4e2b-9ec9-cad3b6ba7465 tempest-VolumesGetTest-2085089695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:29:06 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-5df6aa5c-323e-4e2b-9ec9-cad3b6ba7465 tempest-VolumesGetTest-2085089695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:29:06 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-5df6aa5c-323e-4e2b-9ec9-cad3b6ba7465 tempest-VolumesGetTest-2085089695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:29:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5df6aa5c-323e-4e2b-9ec9-cad3b6ba7465 tempest-VolumesGetTest-2085089695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:29:06 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-5df6aa5c-323e-4e2b-9ec9-cad3b6ba7465 tempest-VolumesGetTest-2085089695 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:29:06 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-5df6aa5c-323e-4e2b-9ec9-cad3b6ba7465 tempest-VolumesGetTest-2085089695 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:29:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5df6aa5c-323e-4e2b-9ec9-cad3b6ba7465 tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1fb7a6ef-0ce8-43cf-8b10-18adb773324d 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:06 devstack sudo[98473]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1fb7a6ef-0ce8-43cf-8b10-18adb773324d 1073741824 Nov 01 12:29:06 devstack sudo[98473]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:07 devstack sudo[98473]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5df6aa5c-323e-4e2b-9ec9-cad3b6ba7465 tempest-VolumesGetTest-2085089695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1fb7a6ef-0ce8-43cf-8b10-18adb773324d 1073741824" returned: 0 in 0.542s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:07 devstack sudo[98471]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2af1d98a-a3cb-465c-9ed3-0ce5481f305d tempest-VolumesListAdminTestJSON-1397181012 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-52bd8059-8588-4253-bfbd-3e48fbf45cdd" returned: 0 in 0.812s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2af1d98a-a3cb-465c-9ed3-0ce5481f305d tempest-VolumesListAdminTestJSON-1397181012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-52bd8059-8588-4253-bfbd-3e48fbf45cdd {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:07 devstack sudo[98482]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-52bd8059-8588-4253-bfbd-3e48fbf45cdd Nov 01 12:29:07 devstack sudo[98482]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5df6aa5c-323e-4e2b-9ec9-cad3b6ba7465 tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1fb7a6ef-0ce8-43cf-8b10-18adb773324d {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:07 devstack sudo[98484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1fb7a6ef-0ce8-43cf-8b10-18adb773324d Nov 01 12:29:07 devstack sudo[98484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:07 devstack sudo[98482]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2af1d98a-a3cb-465c-9ed3-0ce5481f305d tempest-VolumesListAdminTestJSON-1397181012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-52bd8059-8588-4253-bfbd-3e48fbf45cdd" returned: 0 in 0.498s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:07 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-2af1d98a-a3cb-465c-9ed3-0ce5481f305d tempest-VolumesListAdminTestJSON-1397181012 None] Lock "cinder-quobyte-52bd8059-8588-4253-bfbd-3e48fbf45cdd" released by "delete_volume" :: held 1.389s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:29:07 devstack sudo[98484]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5df6aa5c-323e-4e2b-9ec9-cad3b6ba7465 tempest-VolumesGetTest-2085089695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1fb7a6ef-0ce8-43cf-8b10-18adb773324d" returned: 0 in 0.523s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:07 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-5df6aa5c-323e-4e2b-9ec9-cad3b6ba7465 tempest-VolumesGetTest-2085089695 None] <== create_volume: return (1174ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:29:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5df6aa5c-323e-4e2b-9ec9-cad3b6ba7465 tempest-VolumesGetTest-2085089695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.180s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:29:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5df6aa5c-323e-4e2b-9ec9-cad3b6ba7465 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7be0fcc-3dc3-4c18-abc3-c4a12b30d730) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1fb7a6ef-0ce8-43cf-8b10-18adb773324d', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5df6aa5c-323e-4e2b-9ec9-cad3b6ba7465 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (398b27cd-bf1f-4a5d-9b2e-1e665a2f8911) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:07 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-5df6aa5c-323e-4e2b-9ec9-cad3b6ba7465 tempest-VolumesGetTest-2085089695 None] Volume volume-1fb7a6ef-0ce8-43cf-8b10-18adb773324d (1fb7a6ef-0ce8-43cf-8b10-18adb773324d): created successfully Nov 01 12:29:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5df6aa5c-323e-4e2b-9ec9-cad3b6ba7465 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (398b27cd-bf1f-4a5d-9b2e-1e665a2f8911) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5df6aa5c-323e-4e2b-9ec9-cad3b6ba7465 tempest-VolumesGetTest-2085089695 None] Flow 'volume_create_manager' (aad4f9a8-f9be-4320-9b8b-003f97e05672) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:29:08 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-5df6aa5c-323e-4e2b-9ec9-cad3b6ba7465 tempest-VolumesGetTest-2085089695 None] Created volume successfully. Nov 01 12:29:08 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-2af1d98a-a3cb-465c-9ed3-0ce5481f305d tempest-VolumesListAdminTestJSON-1397181012 None] Created reservations ['911004d9-1353-4170-b073-36ac6d87d6e3', '2d7cef5b-c974-46eb-a683-c3f59b1d5a85', 'd85319b6-a065-45f6-beb1-26429199eaac', 'd2a99f9c-39f0-434d-a4c3-99203f7dcb05'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:29:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-2af1d98a-a3cb-465c-9ed3-0ce5481f305d tempest-VolumesListAdminTestJSON-1397181012 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:29:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-2af1d98a-a3cb-465c-9ed3-0ce5481f305d tempest-VolumesListAdminTestJSON-1397181012 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:29:08 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-2af1d98a-a3cb-465c-9ed3-0ce5481f305d tempest-VolumesListAdminTestJSON-1397181012 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:29:08 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-2af1d98a-a3cb-465c-9ed3-0ce5481f305d tempest-VolumesListAdminTestJSON-1397181012 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:29:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-2af1d98a-a3cb-465c-9ed3-0ce5481f305d tempest-VolumesListAdminTestJSON-1397181012 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:29:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2af1d98a-a3cb-465c-9ed3-0ce5481f305d tempest-VolumesListAdminTestJSON-1397181012 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:08 devstack sudo[98489]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:29:08 devstack sudo[98489]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:08 devstack sudo[98489]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2af1d98a-a3cb-465c-9ed3-0ce5481f305d tempest-VolumesListAdminTestJSON-1397181012 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.526s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:08 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-2af1d98a-a3cb-465c-9ed3-0ce5481f305d tempest-VolumesListAdminTestJSON-1397181012 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:29:08 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-2af1d98a-a3cb-465c-9ed3-0ce5481f305d tempest-VolumesListAdminTestJSON-1397181012 None] Deleted volume successfully. Nov 01 12:29:08 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-2af1d98a-a3cb-465c-9ed3-0ce5481f305d tempest-VolumesListAdminTestJSON-1397181012 None] Lock "cinder-52bd8059-8588-4253-bfbd-3e48fbf45cdd-delete_volume" released by "delete_volume" :: held 2.394s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:29:10 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-f2ca17f2-3c3d-4621-a873-503353ab8ad3 tempest-VolumesGetTest-2085089695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:29:10 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f2ca17f2-3c3d-4621-a873-503353ab8ad3 tempest-VolumesGetTest-2085089695 None] Flow 'volume_create_manager' (f5d5e09f-73e4-48b5-80ff-f4482df3ed81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:29:10 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f2ca17f2-3c3d-4621-a873-503353ab8ad3 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a78525c7-89b3-4839-83db-a7697547c456) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:10 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f2ca17f2-3c3d-4621-a873-503353ab8ad3 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a78525c7-89b3-4839-83db-a7697547c456) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:29:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1499795169',display_name='tempest-VolumesGetTest-Volume-2069497725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34b10954-dfdd-49bd-a248-d17c1a82aaf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a63e120aaecb4ae28ad7cea68cca3834',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:29:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:29:10Z,use_quota=True,user_id='c7cc9459190a4f0d93d032c6c18de9ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:10 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f2ca17f2-3c3d-4621-a873-503353ab8ad3 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4233b61-262a-41d8-b011-d197ffe0eeb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:10 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f2ca17f2-3c3d-4621-a873-503353ab8ad3 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c4233b61-262a-41d8-b011-d197ffe0eeb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:10 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f2ca17f2-3c3d-4621-a873-503353ab8ad3 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01ab3581-b4ca-4461-bad5-1513eb5dfe02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:10 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f2ca17f2-3c3d-4621-a873-503353ab8ad3 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (01ab3581-b4ca-4461-bad5-1513eb5dfe02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '34b10954-dfdd-49bd-a248-d17c1a82aaf7', 'volume_name': 'volume-34b10954-dfdd-49bd-a248-d17c1a82aaf7', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:10 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f2ca17f2-3c3d-4621-a873-503353ab8ad3 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4a8486e-c2ed-4a2b-be6a-56fa80852672) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:10 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f2ca17f2-3c3d-4621-a873-503353ab8ad3 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4a8486e-c2ed-4a2b-be6a-56fa80852672) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:10 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f2ca17f2-3c3d-4621-a873-503353ab8ad3 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ba8a3c2-9467-4916-929d-0133ee176fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:10 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-f2ca17f2-3c3d-4621-a873-503353ab8ad3 tempest-VolumesGetTest-2085089695 None] Volume 34b10954-dfdd-49bd-a248-d17c1a82aaf7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-34b10954-dfdd-49bd-a248-d17c1a82aaf7', 'volume_size': 1} Nov 01 12:29:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f2ca17f2-3c3d-4621-a873-503353ab8ad3 tempest-VolumesGetTest-2085089695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:29:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f2ca17f2-3c3d-4621-a873-503353ab8ad3 tempest-VolumesGetTest-2085089695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:29:10 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f2ca17f2-3c3d-4621-a873-503353ab8ad3 tempest-VolumesGetTest-2085089695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:29:10Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1499795169',display_name='tempest-VolumesGetTest-Volume-2069497725',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=34b10954-dfdd-49bd-a248-d17c1a82aaf7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a63e120aaecb4ae28ad7cea68cca3834',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:29:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:29:10Z,use_quota=True,user_id='c7cc9459190a4f0d93d032c6c18de9ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:29:10 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-f2ca17f2-3c3d-4621-a873-503353ab8ad3 tempest-VolumesGetTest-2085089695 None] Creating volume 34b10954-dfdd-49bd-a248-d17c1a82aaf7 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:29:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f2ca17f2-3c3d-4621-a873-503353ab8ad3 tempest-VolumesGetTest-2085089695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:29:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f2ca17f2-3c3d-4621-a873-503353ab8ad3 tempest-VolumesGetTest-2085089695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:29:10 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f2ca17f2-3c3d-4621-a873-503353ab8ad3 tempest-VolumesGetTest-2085089695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:29:10 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f2ca17f2-3c3d-4621-a873-503353ab8ad3 tempest-VolumesGetTest-2085089695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:29:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f2ca17f2-3c3d-4621-a873-503353ab8ad3 tempest-VolumesGetTest-2085089695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:29:10 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f2ca17f2-3c3d-4621-a873-503353ab8ad3 tempest-VolumesGetTest-2085089695 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:29:10 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-f2ca17f2-3c3d-4621-a873-503353ab8ad3 tempest-VolumesGetTest-2085089695 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:29:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f2ca17f2-3c3d-4621-a873-503353ab8ad3 tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-34b10954-dfdd-49bd-a248-d17c1a82aaf7 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:10 devstack sudo[98495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-34b10954-dfdd-49bd-a248-d17c1a82aaf7 1073741824 Nov 01 12:29:10 devstack sudo[98495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:11 devstack sudo[98495]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f2ca17f2-3c3d-4621-a873-503353ab8ad3 tempest-VolumesGetTest-2085089695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-34b10954-dfdd-49bd-a248-d17c1a82aaf7 1073741824" returned: 0 in 0.741s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f2ca17f2-3c3d-4621-a873-503353ab8ad3 tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-34b10954-dfdd-49bd-a248-d17c1a82aaf7 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:11 devstack sudo[98501]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-34b10954-dfdd-49bd-a248-d17c1a82aaf7 Nov 01 12:29:11 devstack sudo[98501]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:11 devstack sudo[98501]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f2ca17f2-3c3d-4621-a873-503353ab8ad3 tempest-VolumesGetTest-2085089695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-34b10954-dfdd-49bd-a248-d17c1a82aaf7" returned: 0 in 0.331s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:11 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f2ca17f2-3c3d-4621-a873-503353ab8ad3 tempest-VolumesGetTest-2085089695 None] <== create_volume: return (1171ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:29:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f2ca17f2-3c3d-4621-a873-503353ab8ad3 tempest-VolumesGetTest-2085089695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.181s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:29:11 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f2ca17f2-3c3d-4621-a873-503353ab8ad3 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7ba8a3c2-9467-4916-929d-0133ee176fae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-34b10954-dfdd-49bd-a248-d17c1a82aaf7', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:11 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f2ca17f2-3c3d-4621-a873-503353ab8ad3 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b767acef-320e-4e31-97b6-a69c5e4ffc94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:11 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-f2ca17f2-3c3d-4621-a873-503353ab8ad3 tempest-VolumesGetTest-2085089695 None] Volume volume-34b10954-dfdd-49bd-a248-d17c1a82aaf7 (34b10954-dfdd-49bd-a248-d17c1a82aaf7): created successfully Nov 01 12:29:11 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f2ca17f2-3c3d-4621-a873-503353ab8ad3 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b767acef-320e-4e31-97b6-a69c5e4ffc94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:11 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f2ca17f2-3c3d-4621-a873-503353ab8ad3 tempest-VolumesGetTest-2085089695 None] Flow 'volume_create_manager' (f5d5e09f-73e4-48b5-80ff-f4482df3ed81) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:29:11 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-f2ca17f2-3c3d-4621-a873-503353ab8ad3 tempest-VolumesGetTest-2085089695 None] Created volume successfully. Nov 01 12:29:12 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-fa127232-ea43-42ab-ad8f-a867ec0bbf26 tempest-VolumesGetTest-2085089695 None] Acquiring lock "cinder-34b10954-dfdd-49bd-a248-d17c1a82aaf7-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:29:12 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-fa127232-ea43-42ab-ad8f-a867ec0bbf26 tempest-VolumesGetTest-2085089695 None] Lock "cinder-34b10954-dfdd-49bd-a248-d17c1a82aaf7-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:29:12 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-fa127232-ea43-42ab-ad8f-a867ec0bbf26 tempest-VolumesGetTest-2085089695 None] Acquiring lock "cinder-quobyte-34b10954-dfdd-49bd-a248-d17c1a82aaf7" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:29:12 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-fa127232-ea43-42ab-ad8f-a867ec0bbf26 tempest-VolumesGetTest-2085089695 None] Lock "cinder-quobyte-34b10954-dfdd-49bd-a248-d17c1a82aaf7" acquired by "delete_volume" :: waited 0.021s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:29:12 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[a3898657-a753-4b69-a476-668cea668861]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:29:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-fa127232-ea43-42ab-ad8f-a867ec0bbf26 tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-34b10954-dfdd-49bd-a248-d17c1a82aaf7 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:12 devstack sudo[98506]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-34b10954-dfdd-49bd-a248-d17c1a82aaf7 Nov 01 12:29:12 devstack sudo[98506]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:13 devstack sudo[98506]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-fa127232-ea43-42ab-ad8f-a867ec0bbf26 tempest-VolumesGetTest-2085089695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-34b10954-dfdd-49bd-a248-d17c1a82aaf7" returned: 0 in 0.513s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-fa127232-ea43-42ab-ad8f-a867ec0bbf26 tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-34b10954-dfdd-49bd-a248-d17c1a82aaf7 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:13 devstack sudo[98511]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-34b10954-dfdd-49bd-a248-d17c1a82aaf7 Nov 01 12:29:13 devstack sudo[98511]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:13 devstack sudo[98511]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-fa127232-ea43-42ab-ad8f-a867ec0bbf26 tempest-VolumesGetTest-2085089695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-34b10954-dfdd-49bd-a248-d17c1a82aaf7" returned: 0 in 0.519s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:13 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-fa127232-ea43-42ab-ad8f-a867ec0bbf26 tempest-VolumesGetTest-2085089695 None] Lock "cinder-quobyte-34b10954-dfdd-49bd-a248-d17c1a82aaf7" released by "delete_volume" :: held 1.088s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:29:13 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-fa127232-ea43-42ab-ad8f-a867ec0bbf26 tempest-VolumesGetTest-2085089695 None] Created reservations ['7f3bc979-b531-43ae-9335-4db7eedb9cce', '751c832e-4979-42de-be7c-7cb7c04bb477', 'a8bce364-f19a-452c-b8e3-888261c1c4f8', '9d43a93c-a161-4dd0-b6a1-748be2657718'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:29:14 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-fa127232-ea43-42ab-ad8f-a867ec0bbf26 tempest-VolumesGetTest-2085089695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:29:14 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-fa127232-ea43-42ab-ad8f-a867ec0bbf26 tempest-VolumesGetTest-2085089695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:29:14 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-fa127232-ea43-42ab-ad8f-a867ec0bbf26 tempest-VolumesGetTest-2085089695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:29:14 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-fa127232-ea43-42ab-ad8f-a867ec0bbf26 tempest-VolumesGetTest-2085089695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:29:14 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-fa127232-ea43-42ab-ad8f-a867ec0bbf26 tempest-VolumesGetTest-2085089695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:29:14 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-fa127232-ea43-42ab-ad8f-a867ec0bbf26 tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:14 devstack sudo[98514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:29:14 devstack sudo[98514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:14 devstack sudo[98514]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:14 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-fa127232-ea43-42ab-ad8f-a867ec0bbf26 tempest-VolumesGetTest-2085089695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.328s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:14 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-fa127232-ea43-42ab-ad8f-a867ec0bbf26 tempest-VolumesGetTest-2085089695 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:29:14 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-fa127232-ea43-42ab-ad8f-a867ec0bbf26 tempest-VolumesGetTest-2085089695 None] Deleted volume successfully. Nov 01 12:29:14 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-fa127232-ea43-42ab-ad8f-a867ec0bbf26 tempest-VolumesGetTest-2085089695 None] Lock "cinder-34b10954-dfdd-49bd-a248-d17c1a82aaf7-delete_volume" released by "delete_volume" :: held 1.846s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:29:15 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-673a1d79-dcf3-4d50-b4e5-f73df251a0fe tempest-VolumesGetTest-2085089695 None] Acquiring lock "cinder-1fb7a6ef-0ce8-43cf-8b10-18adb773324d-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:29:15 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-673a1d79-dcf3-4d50-b4e5-f73df251a0fe tempest-VolumesGetTest-2085089695 None] Lock "cinder-1fb7a6ef-0ce8-43cf-8b10-18adb773324d-delete_volume" acquired by "delete_volume" :: waited 0.105s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:29:15 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-673a1d79-dcf3-4d50-b4e5-f73df251a0fe tempest-VolumesGetTest-2085089695 None] Acquiring lock "cinder-quobyte-1fb7a6ef-0ce8-43cf-8b10-18adb773324d" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:29:15 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-673a1d79-dcf3-4d50-b4e5-f73df251a0fe tempest-VolumesGetTest-2085089695 None] Lock "cinder-quobyte-1fb7a6ef-0ce8-43cf-8b10-18adb773324d" acquired by "delete_volume" :: waited 0.022s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:29:15 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[167b3eb3-59a2-41d5-ac0e-fa71301951bc]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:29:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-673a1d79-dcf3-4d50-b4e5-f73df251a0fe tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1fb7a6ef-0ce8-43cf-8b10-18adb773324d {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:15 devstack sudo[98518]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1fb7a6ef-0ce8-43cf-8b10-18adb773324d Nov 01 12:29:15 devstack sudo[98518]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:15 devstack sudo[98518]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-673a1d79-dcf3-4d50-b4e5-f73df251a0fe tempest-VolumesGetTest-2085089695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1fb7a6ef-0ce8-43cf-8b10-18adb773324d" returned: 0 in 0.486s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-673a1d79-dcf3-4d50-b4e5-f73df251a0fe tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1fb7a6ef-0ce8-43cf-8b10-18adb773324d {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:15 devstack sudo[98525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1fb7a6ef-0ce8-43cf-8b10-18adb773324d Nov 01 12:29:15 devstack sudo[98525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:16 devstack sudo[98525]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:16 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-673a1d79-dcf3-4d50-b4e5-f73df251a0fe tempest-VolumesGetTest-2085089695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1fb7a6ef-0ce8-43cf-8b10-18adb773324d" returned: 0 in 0.319s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:16 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-673a1d79-dcf3-4d50-b4e5-f73df251a0fe tempest-VolumesGetTest-2085089695 None] Lock "cinder-quobyte-1fb7a6ef-0ce8-43cf-8b10-18adb773324d" released by "delete_volume" :: held 0.880s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:29:16 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-673a1d79-dcf3-4d50-b4e5-f73df251a0fe tempest-VolumesGetTest-2085089695 None] Created reservations ['f3e87561-ea31-4e4c-b6ba-58083ac14ab0', 'ccb400dc-e55d-48c3-a49d-886780188594', '90925bd5-a833-4e85-b0df-0bb7f790781b', 'a33185ca-7f7b-4bd2-aa0c-6119f8f7ad2b'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:29:16 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-673a1d79-dcf3-4d50-b4e5-f73df251a0fe tempest-VolumesGetTest-2085089695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:29:16 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-673a1d79-dcf3-4d50-b4e5-f73df251a0fe tempest-VolumesGetTest-2085089695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:29:16 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-673a1d79-dcf3-4d50-b4e5-f73df251a0fe tempest-VolumesGetTest-2085089695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:29:16 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-673a1d79-dcf3-4d50-b4e5-f73df251a0fe tempest-VolumesGetTest-2085089695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:29:16 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-673a1d79-dcf3-4d50-b4e5-f73df251a0fe tempest-VolumesGetTest-2085089695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:29:16 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-673a1d79-dcf3-4d50-b4e5-f73df251a0fe tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:16 devstack sudo[98528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:29:16 devstack sudo[98528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:16 devstack sudo[98528]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:16 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-673a1d79-dcf3-4d50-b4e5-f73df251a0fe tempest-VolumesGetTest-2085089695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.326s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:16 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-673a1d79-dcf3-4d50-b4e5-f73df251a0fe tempest-VolumesGetTest-2085089695 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:29:16 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-673a1d79-dcf3-4d50-b4e5-f73df251a0fe tempest-VolumesGetTest-2085089695 None] Deleted volume successfully. Nov 01 12:29:16 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-673a1d79-dcf3-4d50-b4e5-f73df251a0fe tempest-VolumesGetTest-2085089695 None] Lock "cinder-1fb7a6ef-0ce8-43cf-8b10-18adb773324d-delete_volume" released by "delete_volume" :: held 1.526s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:29:18 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-df17284d-9673-407f-8e82-ff4b923ad3ec tempest-VolumesGetTest-2085089695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:29:18 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-df17284d-9673-407f-8e82-ff4b923ad3ec tempest-VolumesGetTest-2085089695 None] Flow 'volume_create_manager' (1725e10a-331b-4af6-af39-05d189478aad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:29:18 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-df17284d-9673-407f-8e82-ff4b923ad3ec tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c0395d1-e3c0-4562-ab77-10b67f4ef04a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:18 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-df17284d-9673-407f-8e82-ff4b923ad3ec tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2c0395d1-e3c0-4562-ab77-10b67f4ef04a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:29:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1756781480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be113ee8-03eb-40c1-9ab4-e7aa506560a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a63e120aaecb4ae28ad7cea68cca3834',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:29:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:29:18Z,use_quota=True,user_id='c7cc9459190a4f0d93d032c6c18de9ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:18 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-df17284d-9673-407f-8e82-ff4b923ad3ec tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67d44ab4-9e04-4d11-80e0-05005285d56c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:18 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-df17284d-9673-407f-8e82-ff4b923ad3ec tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (67d44ab4-9e04-4d11-80e0-05005285d56c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:18 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-df17284d-9673-407f-8e82-ff4b923ad3ec tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67910e46-a7f5-4915-ab44-e64e3530bf88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:18 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-df17284d-9673-407f-8e82-ff4b923ad3ec tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (67910e46-a7f5-4915-ab44-e64e3530bf88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'be113ee8-03eb-40c1-9ab4-e7aa506560a2', 'volume_name': 'volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:18 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-df17284d-9673-407f-8e82-ff4b923ad3ec tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5cd05f9-81a7-4ac7-a21f-4fc74468d6b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:18 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-df17284d-9673-407f-8e82-ff4b923ad3ec tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c5cd05f9-81a7-4ac7-a21f-4fc74468d6b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:18 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-df17284d-9673-407f-8e82-ff4b923ad3ec tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e3537e7-4514-4e3f-bd82-024566d99011) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:18 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-df17284d-9673-407f-8e82-ff4b923ad3ec tempest-VolumesGetTest-2085089695 None] Volume be113ee8-03eb-40c1-9ab4-e7aa506560a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2', 'volume_size': 1} Nov 01 12:29:18 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-df17284d-9673-407f-8e82-ff4b923ad3ec tempest-VolumesGetTest-2085089695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:29:18 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-df17284d-9673-407f-8e82-ff4b923ad3ec tempest-VolumesGetTest-2085089695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:29:18 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-df17284d-9673-407f-8e82-ff4b923ad3ec tempest-VolumesGetTest-2085089695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:29:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1756781480',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=be113ee8-03eb-40c1-9ab4-e7aa506560a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a63e120aaecb4ae28ad7cea68cca3834',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:29:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:29:18Z,use_quota=True,user_id='c7cc9459190a4f0d93d032c6c18de9ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:29:18 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-df17284d-9673-407f-8e82-ff4b923ad3ec tempest-VolumesGetTest-2085089695 None] Creating volume be113ee8-03eb-40c1-9ab4-e7aa506560a2 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:29:18 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-df17284d-9673-407f-8e82-ff4b923ad3ec tempest-VolumesGetTest-2085089695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:29:18 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-df17284d-9673-407f-8e82-ff4b923ad3ec tempest-VolumesGetTest-2085089695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:29:18 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-df17284d-9673-407f-8e82-ff4b923ad3ec tempest-VolumesGetTest-2085089695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:29:18 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-df17284d-9673-407f-8e82-ff4b923ad3ec tempest-VolumesGetTest-2085089695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:29:18 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-df17284d-9673-407f-8e82-ff4b923ad3ec tempest-VolumesGetTest-2085089695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:29:18 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-df17284d-9673-407f-8e82-ff4b923ad3ec tempest-VolumesGetTest-2085089695 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:29:18 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-df17284d-9673-407f-8e82-ff4b923ad3ec tempest-VolumesGetTest-2085089695 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:29:18 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-df17284d-9673-407f-8e82-ff4b923ad3ec tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:18 devstack sudo[98532]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2 1073741824 Nov 01 12:29:18 devstack sudo[98532]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:18 devstack sudo[98532]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:18 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-df17284d-9673-407f-8e82-ff4b923ad3ec tempest-VolumesGetTest-2085089695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2 1073741824" returned: 0 in 0.573s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:18 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-df17284d-9673-407f-8e82-ff4b923ad3ec tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:18 devstack sudo[98538]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2 Nov 01 12:29:18 devstack sudo[98538]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:19 devstack sudo[98538]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:19 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-df17284d-9673-407f-8e82-ff4b923ad3ec tempest-VolumesGetTest-2085089695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2" returned: 0 in 0.381s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:19 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-df17284d-9673-407f-8e82-ff4b923ad3ec tempest-VolumesGetTest-2085089695 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:29:19 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-df17284d-9673-407f-8e82-ff4b923ad3ec tempest-VolumesGetTest-2085089695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.019s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:29:19 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-df17284d-9673-407f-8e82-ff4b923ad3ec tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9e3537e7-4514-4e3f-bd82-024566d99011) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:19 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-df17284d-9673-407f-8e82-ff4b923ad3ec tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f159ad7-a285-47d5-b69e-2a5e8f4d0632) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:19 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-df17284d-9673-407f-8e82-ff4b923ad3ec tempest-VolumesGetTest-2085089695 None] Volume volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2 (be113ee8-03eb-40c1-9ab4-e7aa506560a2): created successfully Nov 01 12:29:19 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-df17284d-9673-407f-8e82-ff4b923ad3ec tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1f159ad7-a285-47d5-b69e-2a5e8f4d0632) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:19 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-df17284d-9673-407f-8e82-ff4b923ad3ec tempest-VolumesGetTest-2085089695 None] Flow 'volume_create_manager' (1725e10a-331b-4af6-af39-05d189478aad) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:29:19 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-df17284d-9673-407f-8e82-ff4b923ad3ec tempest-VolumesGetTest-2085089695 None] Created volume successfully. Nov 01 12:29:20 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:29:20 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Flow 'volume_create_manager' (4226b8ea-fcf7-4c3b-a63a-ef26c539d86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:29:20 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b08ed4d-9a7d-4d63-8acf-3b3ffd32664d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:20 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b08ed4d-9a7d-4d63-8acf-3b3ffd32664d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:29:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-1586569400',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f594b053-b3a7-4701-a3ea-4b83db10186b,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a63e120aaecb4ae28ad7cea68cca3834',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:29:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=be113ee8-03eb-40c1-9ab4-e7aa506560a2,status='creating',terminated_at=None,updated_at=2026-11-01T11:29:21Z,use_quota=True,user_id='c7cc9459190a4f0d93d032c6c18de9ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:20 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68596b79-c250-48c6-9138-e9b827cd3e86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:20 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (68596b79-c250-48c6-9138-e9b827cd3e86) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:20 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd8152fd-2b0c-4148-b6ae-684cdd0dee11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:20 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cd8152fd-2b0c-4148-b6ae-684cdd0dee11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'source_vol', 'volume_id': 'f594b053-b3a7-4701-a3ea-4b83db10186b', 'volume_name': 'volume-f594b053-b3a7-4701-a3ea-4b83db10186b', 'volume_size': 1, 'source_volid': 'be113ee8-03eb-40c1-9ab4-e7aa506560a2', 'source_volstatus': 'available'}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:20 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb1b01c0-eec9-4e91-aa28-1e6c4abbf7e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:20 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fb1b01c0-eec9-4e91-aa28-1e6c4abbf7e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:20 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (891d6466-d4d9-4ced-a043-5ffa1df7c430) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:20 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Volume f594b053-b3a7-4701-a3ea-4b83db10186b: being created as source_vol with specification: {'status': 'creating', 'volume_name': 'volume-f594b053-b3a7-4701-a3ea-4b83db10186b', 'volume_size': 1, 'source_volid': 'be113ee8-03eb-40c1-9ab4-e7aa506560a2', 'source_volstatus': 'available'} Nov 01 12:29:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:29:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:29:20 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Cloning volume be113ee8-03eb-40c1-9ab4-e7aa506560a2 to volume f594b053-b3a7-4701-a3ea-4b83db10186b Nov 01 12:29:20 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Creating offline snapshot e1ff770f-a97b-472b-b309-7daefa9c57c3 of volume be113ee8-03eb-40c1-9ab4-e7aa506560a2 {{(pid=86574) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:29:20 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[914a93c8-a16f-4246-ac35-5098eed89989]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:29:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:21 devstack sudo[98541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2 Nov 01 12:29:21 devstack sudo[98541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:21 devstack sudo[98541]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2" returned: 0 in 0.476s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2.e1ff770f-a97b-472b-b309-7daefa9c57c3 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:21 devstack sudo[98547]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2.e1ff770f-a97b-472b-b309-7daefa9c57c3 1G Nov 01 12:29:21 devstack sudo[98547]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:22 devstack sudo[98547]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2.e1ff770f-a97b-472b-b309-7daefa9c57c3 1G" returned: 0 in 0.626s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2.e1ff770f-a97b-472b-b309-7daefa9c57c3 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:22 devstack sudo[98577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2.e1ff770f-a97b-472b-b309-7daefa9c57c3 Nov 01 12:29:22 devstack sudo[98577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:22 devstack sudo[98577]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2.e1ff770f-a97b-472b-b309-7daefa9c57c3" returned: 0 in 0.433s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:22 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2.e1ff770f-a97b-472b-b309-7daefa9c57c3 is being set with open permissions: ugo+rw Nov 01 12:29:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2.e1ff770f-a97b-472b-b309-7daefa9c57c3 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:22 devstack sudo[98582]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2.e1ff770f-a97b-472b-b309-7daefa9c57c3 Nov 01 12:29:22 devstack sudo[98582]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:22 devstack sudo[98582]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2.e1ff770f-a97b-472b-b309-7daefa9c57c3" returned: 0 in 0.401s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:23 devstack sudo[98596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2.info Nov 01 12:29:23 devstack sudo[98596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:23 devstack sudo[98596]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2.info" returned: 0 in 0.314s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:23 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2.info is being set with open permissions: ugo+rw Nov 01 12:29:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:23 devstack sudo[98599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2.info Nov 01 12:29:23 devstack sudo[98599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:23 devstack sudo[98599]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2.info" returned: 0 in 0.423s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:23 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Acquiring lock "cinder-quobyte-f594b053-b3a7-4701-a3ea-4b83db10186b" by "_copy_volume_from_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:29:23 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Lock "cinder-quobyte-f594b053-b3a7-4701-a3ea-4b83db10186b" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:29:23 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] snapshot: e1ff770f-a97b-472b-b309-7daefa9c57c3, volume: f594b053-b3a7-4701-a3ea-4b83db10186b, {{(pid=86574) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 01 12:29:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:29:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:29:23 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:29:23 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:29:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:29:23 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7bc9450-aa40-47f1-b21d-b95813a8d8a0]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:29:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2.e1ff770f-a97b-472b-b309-7daefa9c57c3 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:23 devstack sudo[98602]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2.e1ff770f-a97b-472b-b309-7daefa9c57c3 Nov 01 12:29:23 devstack sudo[98602]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:23 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:29:23 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] Flow 'volume_create_manager' (202d1004-1314-4492-9bba-047e8d013e9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:29:24 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (805b92a6-4db8-4dd8-897b-e70dda5f3bf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:24 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (805b92a6-4db8-4dd8-897b-e70dda5f3bf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:29:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1058751698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eda2ec9b-fc62-42b6-9b3d-db2db074448a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb0e2777304642ee9cd6218387ebcec7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:29:24Z,use_quota=True,user_id='0c38627c80cf4f6198914f71dd83ce0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:24 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42cd1d76-67d7-4065-9caa-3af6d73a55c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:24 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (42cd1d76-67d7-4065-9caa-3af6d73a55c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:24 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ec7153e-bec0-4fb4-a85c-d5e488849180) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:24 devstack cinder-volume[86574]: DEBUG cinder.image.glance [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] Creating Keystone auth plugin from conf {{(pid=86574) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 01 12:29:24 devstack sudo[98602]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2.e1ff770f-a97b-472b-b309-7daefa9c57c3" returned: 0 in 0.442s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:24 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:29:24 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[1473830c-361f-40d7-a657-6ecba46ba173]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:29:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:24 devstack sudo[98607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2 Nov 01 12:29:24 devstack sudo[98607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:24 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8ec7153e-bec0-4fb4-a85c-d5e488849180) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'eda2ec9b-fc62-42b6-9b3d-db2db074448a', 'volume_name': 'volume-eda2ec9b-fc62-42b6-9b3d-db2db074448a', 'volume_size': 1, 'image_id': 'f937a0d6-76b6-4a84-a698-e474557181cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f937a0d6-76b6-4a84-a698-e474557181cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4892ea0f5a04c4d8b924ece0f60a2a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f937a0d6-76b6-4a84-a698-e474557181cd', 'created_at': datetime.datetime(2026, 11, 1, 11, 14, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 14, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f937a0d6-76b6-4a84-a698-e474557181cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:24 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05978367-9424-43d2-84b4-80b9c2acacdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:24 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (05978367-9424-43d2-84b4-80b9c2acacdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:24 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cf7a39a-2347-4be0-a837-5d8a6c9dda7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:24 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] Volume eda2ec9b-fc62-42b6-9b3d-db2db074448a: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-eda2ec9b-fc62-42b6-9b3d-db2db074448a', 'volume_size': 1, 'image_id': 'f937a0d6-76b6-4a84-a698-e474557181cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f937a0d6-76b6-4a84-a698-e474557181cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4892ea0f5a04c4d8b924ece0f60a2a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f937a0d6-76b6-4a84-a698-e474557181cd', 'created_at': datetime.datetime(2026, 11, 1, 11, 14, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 14, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f937a0d6-76b6-4a84-a698-e474557181cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 01 12:29:24 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] Trying to clone eda2ec9b-fc62-42b6-9b3d-db2db074448a from image f937a0d6-76b6-4a84-a698-e474557181cd at location (None, [{'url': 'file:///opt/stack/data/glance/images/f937a0d6-76b6-4a84-a698-e474557181cd', 'metadata': {}}]). {{(pid=86574) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 01 12:29:24 devstack sudo[98607]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2" returned: 0 in 0.437s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:24 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2 {{(pid=86574) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 01 12:29:24 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Creating direct copy from snapshot {{(pid=86574) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 01 12:29:24 devstack cinder-volume[86574]: DEBUG cinder.utils [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Path /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f594b053-b3a7-4701-a3ea-4b83db10186b not found in is_blk_device check {{(pid=86574) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 01 12:29:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f594b053-b3a7-4701-a3ea-4b83db10186b {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:24 devstack sudo[98612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f594b053-b3a7-4701-a3ea-4b83db10186b Nov 01 12:29:24 devstack sudo[98612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:24 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_2wj19tg4devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86574) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 01 12:29:24 devstack cinder-volume[86574]: INFO cinder.image.image_utils [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] Image download 20.69 MB at 20.69 MB/s Nov 01 12:29:24 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[4676b70c-74ee-4294-8898-5f709c81f002]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:29:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_2wj19tg4devstack@QuobyteHD {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:25 devstack sudo[98615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_2wj19tg4devstack@QuobyteHD Nov 01 12:29:25 devstack sudo[98615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:25 devstack sudo[98615]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_2wj19tg4devstack@QuobyteHD" returned: 0 in 0.378s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:25 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] Temporary image f937a0d6-76b6-4a84-a698-e474557181cd is fetched for user 0c38627c80cf4f6198914f71dd83ce0f. {{(pid=86574) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 01 12:29:25 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[890f96a2-d1cf-4c10-b8de-241017c8fbf8]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:29:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_2wj19tg4devstack@QuobyteHD {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:25 devstack sudo[98630]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_2wj19tg4devstack@QuobyteHD Nov 01 12:29:25 devstack sudo[98630]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:25 devstack sudo[98630]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_2wj19tg4devstack@QuobyteHD" returned: 0 in 0.464s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:29:32 devstack sudo[98612]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f594b053-b3a7-4701-a3ea-4b83db10186b" returned: 0 in 7.343s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:32 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Image conversion details: src /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2, size 1024.00 MB, duration 7.34 sec, destination /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f594b053-b3a7-4701-a3ea-4b83db10186b {{(pid=86574) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 12:29:32 devstack cinder-volume[86574]: INFO cinder.image.image_utils [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Converted 1024.00 MB image at 139.44 MB/s Nov 01 12:29:32 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f594b053-b3a7-4701-a3ea-4b83db10186b is being set with open permissions: ugo+rw Nov 01 12:29:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f594b053-b3a7-4701-a3ea-4b83db10186b {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:32 devstack sudo[98639]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f594b053-b3a7-4701-a3ea-4b83db10186b Nov 01 12:29:32 devstack sudo[98639]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:32 devstack sudo[98639]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f594b053-b3a7-4701-a3ea-4b83db10186b" returned: 0 in 0.306s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:32 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Lock "cinder-quobyte-f594b053-b3a7-4701-a3ea-4b83db10186b" released by "_copy_volume_from_snapshot" :: held 8.623s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:29:32 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Acquiring lock "cinder-quobyte-e1ff770f-a97b-472b-b309-7daefa9c57c3" by "_delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:29:32 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Lock "cinder-quobyte-e1ff770f-a97b-472b-b309-7daefa9c57c3" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:29:32 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Deleting offline snapshot e1ff770f-a97b-472b-b309-7daefa9c57c3 of volume be113ee8-03eb-40c1-9ab4-e7aa506560a2 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:29:32 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] snapshot_file for this snap is: volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2.e1ff770f-a97b-472b-b309-7daefa9c57c3 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:29:32 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[c00d5b5d-7ab4-49ef-a1ce-2472a140d4ff]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:29:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2.e1ff770f-a97b-472b-b309-7daefa9c57c3 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:32 devstack sudo[98642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2.e1ff770f-a97b-472b-b309-7daefa9c57c3 Nov 01 12:29:32 devstack sudo[98642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:32 devstack sudo[98642]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2.e1ff770f-a97b-472b-b309-7daefa9c57c3" returned: 0 in 0.402s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:32 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:29:32 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[a96d3b82-237a-4f55-829b-e10be56924cf]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:29:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:33 devstack sudo[98648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2 Nov 01 12:29:33 devstack sudo[98648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:33 devstack sudo[98648]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2" returned: 0 in 0.590s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2.e1ff770f-a97b-472b-b309-7daefa9c57c3 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:33 devstack sudo[98653]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2.e1ff770f-a97b-472b-b309-7daefa9c57c3 Nov 01 12:29:33 devstack sudo[98653]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:33 devstack sudo[98653]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2.e1ff770f-a97b-472b-b309-7daefa9c57c3" returned: 0 in 0.421s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2.e1ff770f-a97b-472b-b309-7daefa9c57c3 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:33 devstack sudo[98670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2.e1ff770f-a97b-472b-b309-7daefa9c57c3 Nov 01 12:29:33 devstack sudo[98670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:34 devstack sudo[98670]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2.e1ff770f-a97b-472b-b309-7daefa9c57c3" returned: 0 in 0.331s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:34 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Lock "cinder-quobyte-e1ff770f-a97b-472b-b309-7daefa9c57c3" released by "_delete_snapshot" :: held 1.876s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:29:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_cloned_volume" :: held 13.455s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:29:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 8.445s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:29:34 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:29:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1058751698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eda2ec9b-fc62-42b6-9b3d-db2db074448a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='cb0e2777304642ee9cd6218387ebcec7',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:29:24Z,use_quota=True,user_id='0c38627c80cf4f6198914f71dd83ce0f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:29:34 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] Creating volume eda2ec9b-fc62-42b6-9b3d-db2db074448a {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:29:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:29:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:29:34 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:29:34 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:29:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:29:34 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:29:34 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:29:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-eda2ec9b-fc62-42b6-9b3d-db2db074448a 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:34 devstack sudo[98677]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-eda2ec9b-fc62-42b6-9b3d-db2db074448a 1073741824 Nov 01 12:29:34 devstack sudo[98677]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:34 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (891d6466-d4d9-4ced-a043-5ffa1df7c430) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f594b053-b3a7-4701-a3ea-4b83db10186b', 'volume_size': 1, 'source_volid': 'be113ee8-03eb-40c1-9ab4-e7aa506560a2', 'source_volstatus': 'available'}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:34 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1064d41-3a1c-43b1-9f13-561875012f2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:34 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Volume volume-f594b053-b3a7-4701-a3ea-4b83db10186b (f594b053-b3a7-4701-a3ea-4b83db10186b): created successfully Nov 01 12:29:34 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1064d41-3a1c-43b1-9f13-561875012f2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:34 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Flow 'volume_create_manager' (4226b8ea-fcf7-4c3b-a63a-ef26c539d86d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:29:34 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-19833304-48f8-42ea-8840-ba3f40595d35 tempest-VolumesGetTest-2085089695 None] Created volume successfully. Nov 01 12:29:35 devstack sudo[98677]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-eda2ec9b-fc62-42b6-9b3d-db2db074448a 1073741824" returned: 0 in 0.714s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-eda2ec9b-fc62-42b6-9b3d-db2db074448a {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:35 devstack sudo[98684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-eda2ec9b-fc62-42b6-9b3d-db2db074448a Nov 01 12:29:35 devstack sudo[98684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:35 devstack sudo[98684]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-eda2ec9b-fc62-42b6-9b3d-db2db074448a" returned: 0 in 0.369s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:35 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] <== create_volume: return (1159ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:29:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:29:35 devstack cinder-volume[86574]: DEBUG cinder.volume.volume_utils [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] Attempting download of f937a0d6-76b6-4a84-a698-e474557181cd ((None, [{'url': 'file:///opt/stack/data/glance/images/f937a0d6-76b6-4a84-a698-e474557181cd', 'metadata': {}}])) to volume eda2ec9b-fc62-42b6-9b3d-db2db074448a. {{(pid=86574) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 01 12:29:35 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[54738678-bae9-4ac4-8f98-19e6445a1a9b]: (4, 'raw') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:29:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f937a0d6-76b6-4a84-a698-e474557181cd__h5lymj2 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:35 devstack sudo[98691]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f937a0d6-76b6-4a84-a698-e474557181cd__h5lymj2 Nov 01 12:29:35 devstack sudo[98691]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:36 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-9cb17c48-1055-4a77-b797-19cbed816c09 tempest-VolumesGetTest-2085089695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:29:36 devstack sudo[98691]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:36 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9cb17c48-1055-4a77-b797-19cbed816c09 tempest-VolumesGetTest-2085089695 None] Flow 'volume_create_manager' (3975c343-e136-4031-8650-b30475177f4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:29:36 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9cb17c48-1055-4a77-b797-19cbed816c09 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e0625dc-aaaf-4de1-b281-094a1eeb2826) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f937a0d6-76b6-4a84-a698-e474557181cd__h5lymj2" returned: 0 in 0.501s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f937a0d6-76b6-4a84-a698-e474557181cd__h5lymj2 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:36 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9cb17c48-1055-4a77-b797-19cbed816c09 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9e0625dc-aaaf-4de1-b281-094a1eeb2826) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:29:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1428258948',display_name='tempest-VolumesGetTest-Volume-324238010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c29cbf1f-a8e0-4be2-8156-25056b6d253a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a63e120aaecb4ae28ad7cea68cca3834',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:29:36Z,use_quota=True,user_id='c7cc9459190a4f0d93d032c6c18de9ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:36 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9cb17c48-1055-4a77-b797-19cbed816c09 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de8e71d2-6765-4dae-bdd3-96810e5de8a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:36 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9cb17c48-1055-4a77-b797-19cbed816c09 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de8e71d2-6765-4dae-bdd3-96810e5de8a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:36 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9cb17c48-1055-4a77-b797-19cbed816c09 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89a0e8f3-be45-49f1-9b4f-77ee80e1c746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:36 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9cb17c48-1055-4a77-b797-19cbed816c09 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (89a0e8f3-be45-49f1-9b4f-77ee80e1c746) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c29cbf1f-a8e0-4be2-8156-25056b6d253a', 'volume_name': 'volume-c29cbf1f-a8e0-4be2-8156-25056b6d253a', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:36 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9cb17c48-1055-4a77-b797-19cbed816c09 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faaed719-73cb-4e8f-9aaa-1e0c64ce6c68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:36 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9cb17c48-1055-4a77-b797-19cbed816c09 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (faaed719-73cb-4e8f-9aaa-1e0c64ce6c68) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:36 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9cb17c48-1055-4a77-b797-19cbed816c09 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3335dbd-9a35-4cf0-b098-d386a636d9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:36 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-9cb17c48-1055-4a77-b797-19cbed816c09 tempest-VolumesGetTest-2085089695 None] Volume c29cbf1f-a8e0-4be2-8156-25056b6d253a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c29cbf1f-a8e0-4be2-8156-25056b6d253a', 'volume_size': 1} Nov 01 12:29:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-9cb17c48-1055-4a77-b797-19cbed816c09 tempest-VolumesGetTest-2085089695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:29:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-9cb17c48-1055-4a77-b797-19cbed816c09 tempest-VolumesGetTest-2085089695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:29:36 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-9cb17c48-1055-4a77-b797-19cbed816c09 tempest-VolumesGetTest-2085089695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:29:36Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1428258948',display_name='tempest-VolumesGetTest-Volume-324238010',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c29cbf1f-a8e0-4be2-8156-25056b6d253a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a63e120aaecb4ae28ad7cea68cca3834',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:29:36Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:29:36Z,use_quota=True,user_id='c7cc9459190a4f0d93d032c6c18de9ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:29:36 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-9cb17c48-1055-4a77-b797-19cbed816c09 tempest-VolumesGetTest-2085089695 None] Creating volume c29cbf1f-a8e0-4be2-8156-25056b6d253a {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:29:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-9cb17c48-1055-4a77-b797-19cbed816c09 tempest-VolumesGetTest-2085089695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:29:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-9cb17c48-1055-4a77-b797-19cbed816c09 tempest-VolumesGetTest-2085089695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:29:36 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-9cb17c48-1055-4a77-b797-19cbed816c09 tempest-VolumesGetTest-2085089695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:29:36 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-9cb17c48-1055-4a77-b797-19cbed816c09 tempest-VolumesGetTest-2085089695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:29:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-9cb17c48-1055-4a77-b797-19cbed816c09 tempest-VolumesGetTest-2085089695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:29:36 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-9cb17c48-1055-4a77-b797-19cbed816c09 tempest-VolumesGetTest-2085089695 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:29:36 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-9cb17c48-1055-4a77-b797-19cbed816c09 tempest-VolumesGetTest-2085089695 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:29:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9cb17c48-1055-4a77-b797-19cbed816c09 tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c29cbf1f-a8e0-4be2-8156-25056b6d253a 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:36 devstack sudo[98696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c29cbf1f-a8e0-4be2-8156-25056b6d253a 1073741824 Nov 01 12:29:36 devstack sudo[98696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:36 devstack sudo[98695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f937a0d6-76b6-4a84-a698-e474557181cd__h5lymj2 Nov 01 12:29:36 devstack sudo[98695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:36 devstack sudo[98695]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f937a0d6-76b6-4a84-a698-e474557181cd__h5lymj2" returned: 1 in 0.384s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f937a0d6-76b6-4a84-a698-e474557181cd__h5lymj2' failed. Not Retrying. {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 12:29:36 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[35a5d4f9-5195-43fd-9d57-0af9f3c471ac]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:29:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_2wj19tg4devstack@QuobyteHD {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:36 devstack sudo[98704]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_2wj19tg4devstack@QuobyteHD Nov 01 12:29:36 devstack sudo[98704]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:36 devstack sudo[98696]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9cb17c48-1055-4a77-b797-19cbed816c09 tempest-VolumesGetTest-2085089695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c29cbf1f-a8e0-4be2-8156-25056b6d253a 1073741824" returned: 0 in 0.593s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9cb17c48-1055-4a77-b797-19cbed816c09 tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c29cbf1f-a8e0-4be2-8156-25056b6d253a {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:36 devstack sudo[98740]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c29cbf1f-a8e0-4be2-8156-25056b6d253a Nov 01 12:29:36 devstack sudo[98740]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:37 devstack sudo[98704]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_2wj19tg4devstack@QuobyteHD" returned: 0 in 0.575s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:37 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] f937a0d6-76b6-4a84-a698-e474557181cd was qcow2, converting to qcow2 {{(pid=86574) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 01 12:29:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_2wj19tg4devstack@QuobyteHD /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-eda2ec9b-fc62-42b6-9b3d-db2db074448a {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:37 devstack sudo[98746]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_2wj19tg4devstack@QuobyteHD /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-eda2ec9b-fc62-42b6-9b3d-db2db074448a Nov 01 12:29:37 devstack sudo[98746]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:37 devstack sudo[98740]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9cb17c48-1055-4a77-b797-19cbed816c09 tempest-VolumesGetTest-2085089695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c29cbf1f-a8e0-4be2-8156-25056b6d253a" returned: 0 in 0.441s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:37 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-9cb17c48-1055-4a77-b797-19cbed816c09 tempest-VolumesGetTest-2085089695 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:29:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-9cb17c48-1055-4a77-b797-19cbed816c09 tempest-VolumesGetTest-2085089695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.132s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:29:37 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9cb17c48-1055-4a77-b797-19cbed816c09 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c3335dbd-9a35-4cf0-b098-d386a636d9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c29cbf1f-a8e0-4be2-8156-25056b6d253a', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:37 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9cb17c48-1055-4a77-b797-19cbed816c09 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0507bf73-aee0-4260-bdf4-76397b9cd6c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:37 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-9cb17c48-1055-4a77-b797-19cbed816c09 tempest-VolumesGetTest-2085089695 None] Volume volume-c29cbf1f-a8e0-4be2-8156-25056b6d253a (c29cbf1f-a8e0-4be2-8156-25056b6d253a): created successfully Nov 01 12:29:37 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9cb17c48-1055-4a77-b797-19cbed816c09 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0507bf73-aee0-4260-bdf4-76397b9cd6c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:37 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9cb17c48-1055-4a77-b797-19cbed816c09 tempest-VolumesGetTest-2085089695 None] Flow 'volume_create_manager' (3975c343-e136-4031-8650-b30475177f4c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:29:37 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-9cb17c48-1055-4a77-b797-19cbed816c09 tempest-VolumesGetTest-2085089695 None] Created volume successfully. Nov 01 12:29:38 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-6d0948eb-8410-44da-8847-a16f5f4c5033 req-14d41ad4-6f22-4c68-a5b5-43e12b4ecfd3 tempest-TestShelveInstance-1384273023 None] Terminate volume connection completed successfully. Nov 01 12:29:38 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-6d0948eb-8410-44da-8847-a16f5f4c5033 req-14d41ad4-6f22-4c68-a5b5-43e12b4ecfd3 tempest-TestShelveInstance-1384273023 None] Deleting attachment bfdb6644-73f5-4d53-a535-f7b4dea5fb31. {{(pid=86574) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 12:29:38 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ffed6381-bfd7-4292-b9fc-bb99ce039fad tempest-VolumesGetTest-2085089695 None] Acquiring lock "cinder-c29cbf1f-a8e0-4be2-8156-25056b6d253a-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:29:38 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ffed6381-bfd7-4292-b9fc-bb99ce039fad tempest-VolumesGetTest-2085089695 None] Lock "cinder-c29cbf1f-a8e0-4be2-8156-25056b6d253a-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:29:38 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ffed6381-bfd7-4292-b9fc-bb99ce039fad tempest-VolumesGetTest-2085089695 None] Acquiring lock "cinder-quobyte-c29cbf1f-a8e0-4be2-8156-25056b6d253a" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:29:38 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ffed6381-bfd7-4292-b9fc-bb99ce039fad tempest-VolumesGetTest-2085089695 None] Lock "cinder-quobyte-c29cbf1f-a8e0-4be2-8156-25056b6d253a" acquired by "delete_volume" :: waited 0.016s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:29:38 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[22c43b17-0db2-4a86-bf81-9d5b6929d0d5]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:29:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ffed6381-bfd7-4292-b9fc-bb99ce039fad tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c29cbf1f-a8e0-4be2-8156-25056b6d253a {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:38 devstack sudo[98778]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c29cbf1f-a8e0-4be2-8156-25056b6d253a Nov 01 12:29:38 devstack sudo[98778]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:39 devstack sudo[98778]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ffed6381-bfd7-4292-b9fc-bb99ce039fad tempest-VolumesGetTest-2085089695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c29cbf1f-a8e0-4be2-8156-25056b6d253a" returned: 0 in 0.491s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ffed6381-bfd7-4292-b9fc-bb99ce039fad tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c29cbf1f-a8e0-4be2-8156-25056b6d253a {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:39 devstack sudo[98783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c29cbf1f-a8e0-4be2-8156-25056b6d253a Nov 01 12:29:39 devstack sudo[98783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:39 devstack sudo[98783]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ffed6381-bfd7-4292-b9fc-bb99ce039fad tempest-VolumesGetTest-2085089695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c29cbf1f-a8e0-4be2-8156-25056b6d253a" returned: 0 in 0.289s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:39 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ffed6381-bfd7-4292-b9fc-bb99ce039fad tempest-VolumesGetTest-2085089695 None] Lock "cinder-quobyte-c29cbf1f-a8e0-4be2-8156-25056b6d253a" released by "delete_volume" :: held 0.852s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:29:39 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-ffed6381-bfd7-4292-b9fc-bb99ce039fad tempest-VolumesGetTest-2085089695 None] Created reservations ['e23734ca-1dc0-40c1-a7a6-43c1a94fb683', 'd974b38e-263e-4cac-abb2-3ea3f64d7b3b', 'dd44f540-8823-437f-8411-d560bae6c63f', '5e88c99e-51e8-4be0-89f7-2a600420b129'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:29:39 devstack sudo[98746]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_2wj19tg4devstack@QuobyteHD /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-eda2ec9b-fc62-42b6-9b3d-db2db074448a" returned: 0 in 2.634s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:39 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_2wj19tg4devstack@QuobyteHD, size 112.00 MB, duration 2.63 sec, destination /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-eda2ec9b-fc62-42b6-9b3d-db2db074448a {{(pid=86574) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 12:29:39 devstack cinder-volume[86574]: INFO cinder.image.image_utils [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] Converted 112.00 MB image at 42.51 MB/s Nov 01 12:29:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-eda2ec9b-fc62-42b6-9b3d-db2db074448a 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:39 devstack sudo[98786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-eda2ec9b-fc62-42b6-9b3d-db2db074448a 1G Nov 01 12:29:39 devstack sudo[98786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ffed6381-bfd7-4292-b9fc-bb99ce039fad tempest-VolumesGetTest-2085089695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:29:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ffed6381-bfd7-4292-b9fc-bb99ce039fad tempest-VolumesGetTest-2085089695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:29:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ffed6381-bfd7-4292-b9fc-bb99ce039fad tempest-VolumesGetTest-2085089695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:29:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ffed6381-bfd7-4292-b9fc-bb99ce039fad tempest-VolumesGetTest-2085089695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:29:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ffed6381-bfd7-4292-b9fc-bb99ce039fad tempest-VolumesGetTest-2085089695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:29:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ffed6381-bfd7-4292-b9fc-bb99ce039fad tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:39 devstack sudo[98788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:29:39 devstack sudo[98788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:39 devstack cinder-volume[86574]: DEBUG oslo_service.periodic_task [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86574) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:29:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:29:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:29:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:29:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:29:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:29:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:39 devstack sudo[98793]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:29:39 devstack sudo[98793]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:40 devstack sudo[98788]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ffed6381-bfd7-4292-b9fc-bb99ce039fad tempest-VolumesGetTest-2085089695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.372s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:40 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-ffed6381-bfd7-4292-b9fc-bb99ce039fad tempest-VolumesGetTest-2085089695 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:29:40 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-ffed6381-bfd7-4292-b9fc-bb99ce039fad tempest-VolumesGetTest-2085089695 None] Deleted volume successfully. Nov 01 12:29:40 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ffed6381-bfd7-4292-b9fc-bb99ce039fad tempest-VolumesGetTest-2085089695 None] Lock "cinder-c29cbf1f-a8e0-4be2-8156-25056b6d253a-delete_volume" released by "delete_volume" :: held 1.589s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:29:40 devstack sudo[98786]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-eda2ec9b-fc62-42b6-9b3d-db2db074448a 1G" returned: 0 in 0.551s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:40 devstack cinder-volume[86574]: DEBUG cinder.volume.volume_utils [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] Downloaded image f937a0d6-76b6-4a84-a698-e474557181cd ((None, [{'url': 'file:///opt/stack/data/glance/images/f937a0d6-76b6-4a84-a698-e474557181cd', 'metadata': {}}])) to volume eda2ec9b-fc62-42b6-9b3d-db2db074448a successfully. {{(pid=86574) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 01 12:29:40 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] Temporary image f937a0d6-76b6-4a84-a698-e474557181cd for user 0c38627c80cf4f6198914f71dd83ce0f is deleted. {{(pid=86574) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 01 12:29:40 devstack cinder-volume[86574]: DEBUG cinder.volume.volume_utils [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] Marking volume eda2ec9b-fc62-42b6-9b3d-db2db074448a as bootable. {{(pid=86574) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 01 12:29:40 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] Copying metadata from image f937a0d6-76b6-4a84-a698-e474557181cd to eda2ec9b-fc62-42b6-9b3d-db2db074448a. {{(pid=86574) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 01 12:29:40 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] Creating volume glance metadata for volume eda2ec9b-fc62-42b6-9b3d-db2db074448a backed by image f937a0d6-76b6-4a84-a698-e474557181cd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f937a0d6-76b6-4a84-a698-e474557181cd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86574) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 01 12:29:40 devstack sudo[98793]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.541s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:40 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:29:40 devstack cinder-volume[86574]: DEBUG oslo_service.periodic_task [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running periodic task VolumeManager._thread_info {{(pid=86574) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:29:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] thread count: 28 {{(pid=86574) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 12:29:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] thread info: [<_MainThread(MainThread, started 131331184930944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86574) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 12:29:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1cf7a39a-2347-4be0-a837-5d8a6c9dda7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eda2ec9b-fc62-42b6-9b3d-db2db074448a', 'volume_size': 1, 'image_id': 'f937a0d6-76b6-4a84-a698-e474557181cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f937a0d6-76b6-4a84-a698-e474557181cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4892ea0f5a04c4d8b924ece0f60a2a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f937a0d6-76b6-4a84-a698-e474557181cd', 'created_at': datetime.datetime(2026, 11, 1, 11, 14, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 14, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f937a0d6-76b6-4a84-a698-e474557181cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a80ebc16-deea-46e2-9951-0b4d76bae49c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:40 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] Volume volume-eda2ec9b-fc62-42b6-9b3d-db2db074448a (eda2ec9b-fc62-42b6-9b3d-db2db074448a): created successfully Nov 01 12:29:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a80ebc16-deea-46e2-9951-0b4d76bae49c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] Flow 'volume_create_manager' (202d1004-1314-4492-9bba-047e8d013e9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:29:40 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-abe6fdcf-71db-41e8-89fa-70d6301240ae tempest-VolumesImageMetadata-1847676415 None] Created volume successfully. Nov 01 12:29:40 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-aa0b8f5d-a23e-4f27-8e02-535be5de7631 tempest-VolumesGetTest-2085089695 None] Acquiring lock "cinder-f594b053-b3a7-4701-a3ea-4b83db10186b-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:29:41 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-aa0b8f5d-a23e-4f27-8e02-535be5de7631 tempest-VolumesGetTest-2085089695 None] Lock "cinder-f594b053-b3a7-4701-a3ea-4b83db10186b-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:29:41 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-aa0b8f5d-a23e-4f27-8e02-535be5de7631 tempest-VolumesGetTest-2085089695 None] Acquiring lock "cinder-quobyte-f594b053-b3a7-4701-a3ea-4b83db10186b" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:29:41 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-aa0b8f5d-a23e-4f27-8e02-535be5de7631 tempest-VolumesGetTest-2085089695 None] Lock "cinder-quobyte-f594b053-b3a7-4701-a3ea-4b83db10186b" acquired by "delete_volume" :: waited 0.017s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:29:41 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[27e621ad-fa0c-43c7-8cba-a94f4319e1eb]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:29:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-aa0b8f5d-a23e-4f27-8e02-535be5de7631 tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f594b053-b3a7-4701-a3ea-4b83db10186b {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-639a5a45-2f93-4b12-a2ef-7a3bb238e7b6 req-f1696618-8794-4548-8f59-3227a5ec6c33 tempest-TestShelveInstance-1384273023 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:29:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-639a5a45-2f93-4b12-a2ef-7a3bb238e7b6 req-f1696618-8794-4548-8f59-3227a5ec6c33 tempest-TestShelveInstance-1384273023 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:29:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-639a5a45-2f93-4b12-a2ef-7a3bb238e7b6 req-f1696618-8794-4548-8f59-3227a5ec6c33 tempest-TestShelveInstance-1384273023 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.018s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:29:41 devstack sudo[98815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f594b053-b3a7-4701-a3ea-4b83db10186b Nov 01 12:29:41 devstack sudo[98815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-639a5a45-2f93-4b12-a2ef-7a3bb238e7b6 req-f1696618-8794-4548-8f59-3227a5ec6c33 tempest-TestShelveInstance-1384273023 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb', 'name': 'volume-2c5cde7f-8cb2-4c83-b07d-aecb28344fc8', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'bdd17a9b-541d-46db-b15f-b445bf3f38d8', 'enforce_multipath': True} {{(pid=86574) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 12:29:41 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-639a5a45-2f93-4b12-a2ef-7a3bb238e7b6 req-f1696618-8794-4548-8f59-3227a5ec6c33 tempest-TestShelveInstance-1384273023 None] attachment_update completed successfully. Nov 01 12:29:41 devstack sudo[98815]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-aa0b8f5d-a23e-4f27-8e02-535be5de7631 tempest-VolumesGetTest-2085089695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f594b053-b3a7-4701-a3ea-4b83db10186b" returned: 0 in 0.485s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-aa0b8f5d-a23e-4f27-8e02-535be5de7631 tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f594b053-b3a7-4701-a3ea-4b83db10186b {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:41 devstack sudo[98820]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f594b053-b3a7-4701-a3ea-4b83db10186b Nov 01 12:29:41 devstack sudo[98820]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:41 devstack sudo[98820]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-aa0b8f5d-a23e-4f27-8e02-535be5de7631 tempest-VolumesGetTest-2085089695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f594b053-b3a7-4701-a3ea-4b83db10186b" returned: 0 in 0.294s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:41 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-aa0b8f5d-a23e-4f27-8e02-535be5de7631 tempest-VolumesGetTest-2085089695 None] Lock "cinder-quobyte-f594b053-b3a7-4701-a3ea-4b83db10186b" released by "delete_volume" :: held 0.841s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:29:41 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:SELECT=104,cinder:UPDATE=105,cinder:INSERT=36,cinder:DELETE=11 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:29:41 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:SELECT=89,cinder:INSERT=35,cinder:UPDATE=106,cinder:DELETE=8 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:29:42 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-aa0b8f5d-a23e-4f27-8e02-535be5de7631 tempest-VolumesGetTest-2085089695 None] Created reservations ['7eb9b5a6-143d-4869-b20a-10347254351d', '7869ed56-690b-425d-8b9e-c1c43bd34882', '1df3e82c-4b54-4ffc-aecf-42e85ec17b00', '9841f68c-271a-46a7-8e3f-56a91b9770f5'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:29:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-aa0b8f5d-a23e-4f27-8e02-535be5de7631 tempest-VolumesGetTest-2085089695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:29:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-aa0b8f5d-a23e-4f27-8e02-535be5de7631 tempest-VolumesGetTest-2085089695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:29:42 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-aa0b8f5d-a23e-4f27-8e02-535be5de7631 tempest-VolumesGetTest-2085089695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:29:42 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-aa0b8f5d-a23e-4f27-8e02-535be5de7631 tempest-VolumesGetTest-2085089695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:29:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-aa0b8f5d-a23e-4f27-8e02-535be5de7631 tempest-VolumesGetTest-2085089695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:29:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-aa0b8f5d-a23e-4f27-8e02-535be5de7631 tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:42 devstack sudo[98823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:29:42 devstack sudo[98823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:42 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-49ca70d9-8030-4bb0-a52f-6c2b1db52cc9 tempest-VolumesGetTest-2085089695 None] Acquiring lock "cinder-be113ee8-03eb-40c1-9ab4-e7aa506560a2-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:29:42 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-49ca70d9-8030-4bb0-a52f-6c2b1db52cc9 tempest-VolumesGetTest-2085089695 None] Lock "cinder-be113ee8-03eb-40c1-9ab4-e7aa506560a2-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:29:42 devstack sudo[98823]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-aa0b8f5d-a23e-4f27-8e02-535be5de7631 tempest-VolumesGetTest-2085089695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.404s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:42 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-aa0b8f5d-a23e-4f27-8e02-535be5de7631 tempest-VolumesGetTest-2085089695 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:29:42 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-49ca70d9-8030-4bb0-a52f-6c2b1db52cc9 tempest-VolumesGetTest-2085089695 None] Acquiring lock "cinder-quobyte-be113ee8-03eb-40c1-9ab4-e7aa506560a2" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:29:42 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-aa0b8f5d-a23e-4f27-8e02-535be5de7631 tempest-VolumesGetTest-2085089695 None] Deleted volume successfully. Nov 01 12:29:42 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a99c451e-2f87-4847-ba62-7f18dbc2762b tempest-VolumesImageMetadata-1847676415 None] Acquiring lock "cinder-eda2ec9b-fc62-42b6-9b3d-db2db074448a-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:29:42 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-49ca70d9-8030-4bb0-a52f-6c2b1db52cc9 tempest-VolumesGetTest-2085089695 None] Lock "cinder-quobyte-be113ee8-03eb-40c1-9ab4-e7aa506560a2" acquired by "delete_volume" :: waited 0.048s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:29:42 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-aa0b8f5d-a23e-4f27-8e02-535be5de7631 tempest-VolumesGetTest-2085089695 None] Lock "cinder-f594b053-b3a7-4701-a3ea-4b83db10186b-delete_volume" released by "delete_volume" :: held 1.679s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:29:42 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a99c451e-2f87-4847-ba62-7f18dbc2762b tempest-VolumesImageMetadata-1847676415 None] Lock "cinder-eda2ec9b-fc62-42b6-9b3d-db2db074448a-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:29:42 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[256d1b64-0966-47aa-af82-b92165a011a6]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:29:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-49ca70d9-8030-4bb0-a52f-6c2b1db52cc9 tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:42 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a99c451e-2f87-4847-ba62-7f18dbc2762b tempest-VolumesImageMetadata-1847676415 None] Acquiring lock "cinder-quobyte-eda2ec9b-fc62-42b6-9b3d-db2db074448a" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:29:42 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a99c451e-2f87-4847-ba62-7f18dbc2762b tempest-VolumesImageMetadata-1847676415 None] Lock "cinder-quobyte-eda2ec9b-fc62-42b6-9b3d-db2db074448a" acquired by "delete_volume" :: waited 0.026s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:29:42 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[044282be-a58f-48ad-8509-591d6d4cd7b1]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:29:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a99c451e-2f87-4847-ba62-7f18dbc2762b tempest-VolumesImageMetadata-1847676415 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-eda2ec9b-fc62-42b6-9b3d-db2db074448a {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:42 devstack sudo[98826]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2 Nov 01 12:29:42 devstack sudo[98826]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:42 devstack sudo[98827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-eda2ec9b-fc62-42b6-9b3d-db2db074448a Nov 01 12:29:42 devstack sudo[98827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:43 devstack sudo[98826]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-49ca70d9-8030-4bb0-a52f-6c2b1db52cc9 tempest-VolumesGetTest-2085089695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2" returned: 0 in 0.492s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-49ca70d9-8030-4bb0-a52f-6c2b1db52cc9 tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:43 devstack sudo[98836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2 Nov 01 12:29:43 devstack sudo[98836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:43 devstack sudo[98827]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a99c451e-2f87-4847-ba62-7f18dbc2762b tempest-VolumesImageMetadata-1847676415 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-eda2ec9b-fc62-42b6-9b3d-db2db074448a" returned: 0 in 0.511s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a99c451e-2f87-4847-ba62-7f18dbc2762b tempest-VolumesImageMetadata-1847676415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-eda2ec9b-fc62-42b6-9b3d-db2db074448a {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:43 devstack sudo[98839]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-eda2ec9b-fc62-42b6-9b3d-db2db074448a Nov 01 12:29:43 devstack sudo[98839]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:43 devstack sudo[98836]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-49ca70d9-8030-4bb0-a52f-6c2b1db52cc9 tempest-VolumesGetTest-2085089695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-be113ee8-03eb-40c1-9ab4-e7aa506560a2" returned: 0 in 0.349s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:43 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-49ca70d9-8030-4bb0-a52f-6c2b1db52cc9 tempest-VolumesGetTest-2085089695 None] Lock "cinder-quobyte-be113ee8-03eb-40c1-9ab4-e7aa506560a2" released by "delete_volume" :: held 0.970s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:29:43 devstack sudo[98839]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a99c451e-2f87-4847-ba62-7f18dbc2762b tempest-VolumesImageMetadata-1847676415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-eda2ec9b-fc62-42b6-9b3d-db2db074448a" returned: 0 in 0.359s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:43 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-49ca70d9-8030-4bb0-a52f-6c2b1db52cc9 tempest-VolumesGetTest-2085089695 None] Created reservations ['0c6c4438-7d31-47b7-9135-e208454af478', '97c524dd-e7c0-4763-8814-4cc6eb1aa8a8', '5f397d0f-8f36-4797-bd6c-387e3ba9d4fd', '99aebdaa-f1a1-449f-89aa-b961e8ef8af7'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:29:43 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a99c451e-2f87-4847-ba62-7f18dbc2762b tempest-VolumesImageMetadata-1847676415 None] Lock "cinder-quobyte-eda2ec9b-fc62-42b6-9b3d-db2db074448a" released by "delete_volume" :: held 0.943s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:29:43 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-a99c451e-2f87-4847-ba62-7f18dbc2762b tempest-VolumesImageMetadata-1847676415 None] Created reservations ['6d4d6549-fb54-4e75-8d60-e4cb84d29626', '0d153177-d224-4d5d-99d3-b08d0acd80d3', 'abf4d361-c2ca-4d7f-b1a5-a0ee070bd4f4', 'fc6850cf-530f-488e-999b-3ca87daf3924'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:29:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-49ca70d9-8030-4bb0-a52f-6c2b1db52cc9 tempest-VolumesGetTest-2085089695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:29:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-49ca70d9-8030-4bb0-a52f-6c2b1db52cc9 tempest-VolumesGetTest-2085089695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:29:43 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-49ca70d9-8030-4bb0-a52f-6c2b1db52cc9 tempest-VolumesGetTest-2085089695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:29:43 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-49ca70d9-8030-4bb0-a52f-6c2b1db52cc9 tempest-VolumesGetTest-2085089695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:29:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-49ca70d9-8030-4bb0-a52f-6c2b1db52cc9 tempest-VolumesGetTest-2085089695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:29:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-49ca70d9-8030-4bb0-a52f-6c2b1db52cc9 tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:43 devstack sudo[98844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:29:43 devstack sudo[98844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a99c451e-2f87-4847-ba62-7f18dbc2762b tempest-VolumesImageMetadata-1847676415 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:29:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a99c451e-2f87-4847-ba62-7f18dbc2762b tempest-VolumesImageMetadata-1847676415 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:29:43 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a99c451e-2f87-4847-ba62-7f18dbc2762b tempest-VolumesImageMetadata-1847676415 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:29:43 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a99c451e-2f87-4847-ba62-7f18dbc2762b tempest-VolumesImageMetadata-1847676415 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:29:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a99c451e-2f87-4847-ba62-7f18dbc2762b tempest-VolumesImageMetadata-1847676415 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:29:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a99c451e-2f87-4847-ba62-7f18dbc2762b tempest-VolumesImageMetadata-1847676415 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:43 devstack sudo[98846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:29:43 devstack sudo[98846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:44 devstack sudo[98846]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a99c451e-2f87-4847-ba62-7f18dbc2762b tempest-VolumesImageMetadata-1847676415 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.290s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:44 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-a99c451e-2f87-4847-ba62-7f18dbc2762b tempest-VolumesImageMetadata-1847676415 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:29:44 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-a99c451e-2f87-4847-ba62-7f18dbc2762b tempest-VolumesImageMetadata-1847676415 None] Deleted volume successfully. Nov 01 12:29:44 devstack sudo[98844]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-49ca70d9-8030-4bb0-a52f-6c2b1db52cc9 tempest-VolumesGetTest-2085089695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.383s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:44 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-49ca70d9-8030-4bb0-a52f-6c2b1db52cc9 tempest-VolumesGetTest-2085089695 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:29:44 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-49ca70d9-8030-4bb0-a52f-6c2b1db52cc9 tempest-VolumesGetTest-2085089695 None] Deleted volume successfully. Nov 01 12:29:44 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-49ca70d9-8030-4bb0-a52f-6c2b1db52cc9 tempest-VolumesGetTest-2085089695 None] Lock "cinder-be113ee8-03eb-40c1-9ab4-e7aa506560a2-delete_volume" released by "delete_volume" :: held 1.798s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:29:44 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a99c451e-2f87-4847-ba62-7f18dbc2762b tempest-VolumesImageMetadata-1847676415 None] Lock "cinder-eda2ec9b-fc62-42b6-9b3d-db2db074448a-delete_volume" released by "delete_volume" :: held 1.591s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:29:46 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:29:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] Flow 'volume_create_manager' (fffcbcd9-d06c-4738-946e-979734cb64df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:29:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d9d5d85-a785-4a82-af4f-9e79d37af727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d9d5d85-a785-4a82-af4f-9e79d37af727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-349567681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bebbc64-8be4-4b10-8cca-a0d1864197de,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a63e120aaecb4ae28ad7cea68cca3834',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:29:46Z,use_quota=True,user_id='c7cc9459190a4f0d93d032c6c18de9ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18b6c584-9d77-4f67-88a1-839890381f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (18b6c584-9d77-4f67-88a1-839890381f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edf285d8-5366-4de1-a0cd-1e6a2099023d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:46 devstack cinder-volume[86574]: DEBUG cinder.image.glance [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] Creating Keystone auth plugin from conf {{(pid=86574) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 01 12:29:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (edf285d8-5366-4de1-a0cd-1e6a2099023d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '6bebbc64-8be4-4b10-8cca-a0d1864197de', 'volume_name': 'volume-6bebbc64-8be4-4b10-8cca-a0d1864197de', 'volume_size': 1, 'image_id': 'f937a0d6-76b6-4a84-a698-e474557181cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f937a0d6-76b6-4a84-a698-e474557181cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4892ea0f5a04c4d8b924ece0f60a2a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f937a0d6-76b6-4a84-a698-e474557181cd', 'created_at': datetime.datetime(2026, 11, 1, 11, 14, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 14, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f937a0d6-76b6-4a84-a698-e474557181cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2aef1b2-ef2f-489c-b400-fedcf2bd9387) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2aef1b2-ef2f-489c-b400-fedcf2bd9387) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90d64833-91c5-47a2-87c1-e39b5902c52d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:47 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] Volume 6bebbc64-8be4-4b10-8cca-a0d1864197de: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-6bebbc64-8be4-4b10-8cca-a0d1864197de', 'volume_size': 1, 'image_id': 'f937a0d6-76b6-4a84-a698-e474557181cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f937a0d6-76b6-4a84-a698-e474557181cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4892ea0f5a04c4d8b924ece0f60a2a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f937a0d6-76b6-4a84-a698-e474557181cd', 'created_at': datetime.datetime(2026, 11, 1, 11, 14, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 14, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f937a0d6-76b6-4a84-a698-e474557181cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': } Nov 01 12:29:47 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] Trying to clone 6bebbc64-8be4-4b10-8cca-a0d1864197de from image f937a0d6-76b6-4a84-a698-e474557181cd at location (None, [{'url': 'file:///opt/stack/data/glance/images/f937a0d6-76b6-4a84-a698-e474557181cd', 'metadata': {}}]). {{(pid=86574) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 01 12:29:47 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_gmvd6qz0devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=86574) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 01 12:29:47 devstack cinder-volume[86574]: INFO cinder.image.image_utils [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] Image download 20.69 MB at 20.69 MB/s Nov 01 12:29:47 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[83dee2df-0bd1-44be-ae02-4614f4fa36c2]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:29:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_gmvd6qz0devstack@QuobyteHD {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:47 devstack sudo[99331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_gmvd6qz0devstack@QuobyteHD Nov 01 12:29:47 devstack sudo[99331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:48 devstack sudo[99331]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_gmvd6qz0devstack@QuobyteHD" returned: 0 in 0.479s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:48 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] Temporary image f937a0d6-76b6-4a84-a698-e474557181cd is fetched for user c7cc9459190a4f0d93d032c6c18de9ed. {{(pid=86574) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 01 12:29:48 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[a082f151-8a6c-4ce6-a46c-d21d3f7971c3]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:29:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_gmvd6qz0devstack@QuobyteHD {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:48 devstack sudo[99338]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_gmvd6qz0devstack@QuobyteHD Nov 01 12:29:48 devstack sudo[99338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:48 devstack sudo[99338]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_gmvd6qz0devstack@QuobyteHD" returned: 0 in 0.478s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:29:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:29:48 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:29:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTest-Volume-349567681',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6bebbc64-8be4-4b10-8cca-a0d1864197de,launched_at=None,metadata={Type='Test'},migration_status=None,multiattach=False,previous_status=None,project_id='a63e120aaecb4ae28ad7cea68cca3834',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:29:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:29:46Z,use_quota=True,user_id='c7cc9459190a4f0d93d032c6c18de9ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:29:48 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] Creating volume 6bebbc64-8be4-4b10-8cca-a0d1864197de {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:29:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:29:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:29:48 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:29:48 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:29:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:29:48 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:29:48 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:29:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6bebbc64-8be4-4b10-8cca-a0d1864197de 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:48 devstack sudo[99344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6bebbc64-8be4-4b10-8cca-a0d1864197de 1073741824 Nov 01 12:29:48 devstack sudo[99344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:49 devstack sudo[99344]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6bebbc64-8be4-4b10-8cca-a0d1864197de 1073741824" returned: 0 in 0.769s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6bebbc64-8be4-4b10-8cca-a0d1864197de {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:49 devstack sudo[99350]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6bebbc64-8be4-4b10-8cca-a0d1864197de Nov 01 12:29:49 devstack sudo[99350]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:50 devstack sudo[99350]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6bebbc64-8be4-4b10-8cca-a0d1864197de" returned: 0 in 0.330s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:50 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] <== create_volume: return (1183ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:29:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.188s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:29:50 devstack cinder-volume[86574]: DEBUG cinder.volume.volume_utils [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] Attempting download of f937a0d6-76b6-4a84-a698-e474557181cd ((None, [{'url': 'file:///opt/stack/data/glance/images/f937a0d6-76b6-4a84-a698-e474557181cd', 'metadata': {}}])) to volume 6bebbc64-8be4-4b10-8cca-a0d1864197de. {{(pid=86574) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 01 12:29:50 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[871a22ed-c988-4baf-84e6-43830539ccfa]: (4, 'raw') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:29:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f937a0d6-76b6-4a84-a698-e474557181cd_17ar2v_5 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:50 devstack sudo[99353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f937a0d6-76b6-4a84-a698-e474557181cd_17ar2v_5 Nov 01 12:29:50 devstack sudo[99353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:50 devstack sudo[99353]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f937a0d6-76b6-4a84-a698-e474557181cd_17ar2v_5" returned: 0 in 0.554s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f937a0d6-76b6-4a84-a698-e474557181cd_17ar2v_5 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:50 devstack sudo[99357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f937a0d6-76b6-4a84-a698-e474557181cd_17ar2v_5 Nov 01 12:29:50 devstack sudo[99357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:51 devstack sudo[99357]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f937a0d6-76b6-4a84-a698-e474557181cd_17ar2v_5" returned: 1 in 0.404s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f937a0d6-76b6-4a84-a698-e474557181cd_17ar2v_5' failed. Not Retrying. {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 12:29:51 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b3d59b9-b91c-438c-81a2-f131e154f3ab]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:29:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_gmvd6qz0devstack@QuobyteHD {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:51 devstack sudo[99361]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_gmvd6qz0devstack@QuobyteHD Nov 01 12:29:51 devstack sudo[99361]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:51 devstack sudo[99361]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_gmvd6qz0devstack@QuobyteHD" returned: 0 in 0.484s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:51 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] f937a0d6-76b6-4a84-a698-e474557181cd was qcow2, converting to qcow2 {{(pid=86574) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 01 12:29:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_gmvd6qz0devstack@QuobyteHD /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6bebbc64-8be4-4b10-8cca-a0d1864197de {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:51 devstack sudo[99366]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_gmvd6qz0devstack@QuobyteHD /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6bebbc64-8be4-4b10-8cca-a0d1864197de Nov 01 12:29:51 devstack sudo[99366]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:51 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-0240c07e-0cb3-4e18-bb4d-34cf0c4a2e85 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:29:51 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0240c07e-0cb3-4e18-bb4d-34cf0c4a2e85 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Flow 'volume_create_manager' (1e31aff1-bf87-439e-8ee7-574ba4d64b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:29:51 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0240c07e-0cb3-4e18-bb4d-34cf0c4a2e85 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ffd6a36-df3d-44ad-8c71-13a756977c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0240c07e-0cb3-4e18-bb4d-34cf0c4a2e85 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4ffd6a36-df3d-44ad-8c71-13a756977c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-965161986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3af2d44-cff9-4ea0-98b0-325603eeacf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5ddd7f8ac664d418307085234a67f76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:29:52Z,use_quota=True,user_id='82e9f7aa9f8b45218be898f443e9b683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7f682b1-94ae-4c43-a938-898fa249e37f),volume_type_id=b7f682b1-94ae-4c43-a938-898fa249e37f)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0240c07e-0cb3-4e18-bb4d-34cf0c4a2e85 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6165bcd5-4b56-4e17-a105-6ce4ba50b792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0240c07e-0cb3-4e18-bb4d-34cf0c4a2e85 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6165bcd5-4b56-4e17-a105-6ce4ba50b792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0240c07e-0cb3-4e18-bb4d-34cf0c4a2e85 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c49a5d1-9a47-4604-9ab7-35ee9ed090b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0240c07e-0cb3-4e18-bb4d-34cf0c4a2e85 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0c49a5d1-9a47-4604-9ab7-35ee9ed090b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd3af2d44-cff9-4ea0-98b0-325603eeacf5', 'volume_name': 'volume-d3af2d44-cff9-4ea0-98b0-325603eeacf5', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0240c07e-0cb3-4e18-bb4d-34cf0c4a2e85 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce4415cd-6f37-417c-a2af-56ad4a7de06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0240c07e-0cb3-4e18-bb4d-34cf0c4a2e85 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ce4415cd-6f37-417c-a2af-56ad4a7de06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0240c07e-0cb3-4e18-bb4d-34cf0c4a2e85 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a006f182-ea7a-420c-9fb8-51c401a76cf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:52 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-0240c07e-0cb3-4e18-bb4d-34cf0c4a2e85 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Volume d3af2d44-cff9-4ea0-98b0-325603eeacf5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d3af2d44-cff9-4ea0-98b0-325603eeacf5', 'volume_size': 1} Nov 01 12:29:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0240c07e-0cb3-4e18-bb4d-34cf0c4a2e85 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:29:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0240c07e-0cb3-4e18-bb4d-34cf0c4a2e85 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:29:52 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-0240c07e-0cb3-4e18-bb4d-34cf0c4a2e85 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:29:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-965161986',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d3af2d44-cff9-4ea0-98b0-325603eeacf5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d5ddd7f8ac664d418307085234a67f76',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:29:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:29:52Z,use_quota=True,user_id='82e9f7aa9f8b45218be898f443e9b683',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b7f682b1-94ae-4c43-a938-898fa249e37f),volume_type_id=b7f682b1-94ae-4c43-a938-898fa249e37f)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:29:52 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-0240c07e-0cb3-4e18-bb4d-34cf0c4a2e85 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Creating volume d3af2d44-cff9-4ea0-98b0-325603eeacf5 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:29:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0240c07e-0cb3-4e18-bb4d-34cf0c4a2e85 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:29:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0240c07e-0cb3-4e18-bb4d-34cf0c4a2e85 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:29:52 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-0240c07e-0cb3-4e18-bb4d-34cf0c4a2e85 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:29:52 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-0240c07e-0cb3-4e18-bb4d-34cf0c4a2e85 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:29:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0240c07e-0cb3-4e18-bb4d-34cf0c4a2e85 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:29:52 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-0240c07e-0cb3-4e18-bb4d-34cf0c4a2e85 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:29:52 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-0240c07e-0cb3-4e18-bb4d-34cf0c4a2e85 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:29:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0240c07e-0cb3-4e18-bb4d-34cf0c4a2e85 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d3af2d44-cff9-4ea0-98b0-325603eeacf5 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:52 devstack sudo[99371]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d3af2d44-cff9-4ea0-98b0-325603eeacf5 1073741824 Nov 01 12:29:52 devstack sudo[99371]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:52 devstack sudo[99371]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0240c07e-0cb3-4e18-bb4d-34cf0c4a2e85 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d3af2d44-cff9-4ea0-98b0-325603eeacf5 1073741824" returned: 0 in 0.657s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0240c07e-0cb3-4e18-bb4d-34cf0c4a2e85 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d3af2d44-cff9-4ea0-98b0-325603eeacf5 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:52 devstack sudo[99384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d3af2d44-cff9-4ea0-98b0-325603eeacf5 Nov 01 12:29:52 devstack sudo[99384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:53 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-32df4bad-78ac-48a5-bb02-7f6d4111616c tempest-AbsoluteLimitsTests-418734707 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:29:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32df4bad-78ac-48a5-bb02-7f6d4111616c tempest-AbsoluteLimitsTests-418734707 None] Flow 'volume_create_manager' (5319c9fd-9913-4195-8e78-150ed7ede076) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:29:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32df4bad-78ac-48a5-bb02-7f6d4111616c tempest-AbsoluteLimitsTests-418734707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92322f85-fafb-42a5-a376-111eb57bc8a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32df4bad-78ac-48a5-bb02-7f6d4111616c tempest-AbsoluteLimitsTests-418734707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92322f85-fafb-42a5-a376-111eb57bc8a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-603392886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5541ac36-2370-4c5d-90e0-84a38cd0dd9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a971021f04a6458fb52e3ee62a8165e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:29:53Z,use_quota=True,user_id='ab46961d692446e5ace5a4beaf701d6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32df4bad-78ac-48a5-bb02-7f6d4111616c tempest-AbsoluteLimitsTests-418734707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ce11d76-a14f-4429-a423-0118c5772112) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32df4bad-78ac-48a5-bb02-7f6d4111616c tempest-AbsoluteLimitsTests-418734707 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7ce11d76-a14f-4429-a423-0118c5772112) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32df4bad-78ac-48a5-bb02-7f6d4111616c tempest-AbsoluteLimitsTests-418734707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46570b8d-7511-4454-aa5a-9b08ec65bb1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32df4bad-78ac-48a5-bb02-7f6d4111616c tempest-AbsoluteLimitsTests-418734707 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46570b8d-7511-4454-aa5a-9b08ec65bb1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5541ac36-2370-4c5d-90e0-84a38cd0dd9f', 'volume_name': 'volume-5541ac36-2370-4c5d-90e0-84a38cd0dd9f', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32df4bad-78ac-48a5-bb02-7f6d4111616c tempest-AbsoluteLimitsTests-418734707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebe31845-479e-432a-8ba6-cffb2266d0bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32df4bad-78ac-48a5-bb02-7f6d4111616c tempest-AbsoluteLimitsTests-418734707 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ebe31845-479e-432a-8ba6-cffb2266d0bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32df4bad-78ac-48a5-bb02-7f6d4111616c tempest-AbsoluteLimitsTests-418734707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ccc539d-7782-42df-b010-8d9b6c4f51fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:53 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-32df4bad-78ac-48a5-bb02-7f6d4111616c tempest-AbsoluteLimitsTests-418734707 None] Volume 5541ac36-2370-4c5d-90e0-84a38cd0dd9f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5541ac36-2370-4c5d-90e0-84a38cd0dd9f', 'volume_size': 1} Nov 01 12:29:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-32df4bad-78ac-48a5-bb02-7f6d4111616c tempest-AbsoluteLimitsTests-418734707 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:29:53 devstack sudo[99384]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0240c07e-0cb3-4e18-bb4d-34cf0c4a2e85 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d3af2d44-cff9-4ea0-98b0-325603eeacf5" returned: 0 in 0.433s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:53 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-0240c07e-0cb3-4e18-bb4d-34cf0c4a2e85 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] <== create_volume: return (1156ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:29:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0240c07e-0cb3-4e18-bb4d-34cf0c4a2e85 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.165s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:29:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-32df4bad-78ac-48a5-bb02-7f6d4111616c tempest-AbsoluteLimitsTests-418734707 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.082s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:29:53 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-32df4bad-78ac-48a5-bb02-7f6d4111616c tempest-AbsoluteLimitsTests-418734707 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:29:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-603392886',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5541ac36-2370-4c5d-90e0-84a38cd0dd9f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a971021f04a6458fb52e3ee62a8165e6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:29:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:29:53Z,use_quota=True,user_id='ab46961d692446e5ace5a4beaf701d6b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:29:53 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-32df4bad-78ac-48a5-bb02-7f6d4111616c tempest-AbsoluteLimitsTests-418734707 None] Creating volume 5541ac36-2370-4c5d-90e0-84a38cd0dd9f {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:29:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-32df4bad-78ac-48a5-bb02-7f6d4111616c tempest-AbsoluteLimitsTests-418734707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:29:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-32df4bad-78ac-48a5-bb02-7f6d4111616c tempest-AbsoluteLimitsTests-418734707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:29:53 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-32df4bad-78ac-48a5-bb02-7f6d4111616c tempest-AbsoluteLimitsTests-418734707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:29:53 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-32df4bad-78ac-48a5-bb02-7f6d4111616c tempest-AbsoluteLimitsTests-418734707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:29:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-32df4bad-78ac-48a5-bb02-7f6d4111616c tempest-AbsoluteLimitsTests-418734707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:29:53 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-32df4bad-78ac-48a5-bb02-7f6d4111616c tempest-AbsoluteLimitsTests-418734707 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:29:53 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-32df4bad-78ac-48a5-bb02-7f6d4111616c tempest-AbsoluteLimitsTests-418734707 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:29:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-32df4bad-78ac-48a5-bb02-7f6d4111616c tempest-AbsoluteLimitsTests-418734707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5541ac36-2370-4c5d-90e0-84a38cd0dd9f 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0240c07e-0cb3-4e18-bb4d-34cf0c4a2e85 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a006f182-ea7a-420c-9fb8-51c401a76cf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d3af2d44-cff9-4ea0-98b0-325603eeacf5', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0240c07e-0cb3-4e18-bb4d-34cf0c4a2e85 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bc88394-8df5-42e2-95d1-88fc9212cc3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:53 devstack sudo[99387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5541ac36-2370-4c5d-90e0-84a38cd0dd9f 1073741824 Nov 01 12:29:53 devstack sudo[99387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:53 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-0240c07e-0cb3-4e18-bb4d-34cf0c4a2e85 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Volume volume-d3af2d44-cff9-4ea0-98b0-325603eeacf5 (d3af2d44-cff9-4ea0-98b0-325603eeacf5): created successfully Nov 01 12:29:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0240c07e-0cb3-4e18-bb4d-34cf0c4a2e85 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5bc88394-8df5-42e2-95d1-88fc9212cc3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0240c07e-0cb3-4e18-bb4d-34cf0c4a2e85 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Flow 'volume_create_manager' (1e31aff1-bf87-439e-8ee7-574ba4d64b3f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:29:53 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-0240c07e-0cb3-4e18-bb4d-34cf0c4a2e85 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Created volume successfully. Nov 01 12:29:53 devstack sudo[99387]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-32df4bad-78ac-48a5-bb02-7f6d4111616c tempest-AbsoluteLimitsTests-418734707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5541ac36-2370-4c5d-90e0-84a38cd0dd9f 1073741824" returned: 0 in 0.550s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-32df4bad-78ac-48a5-bb02-7f6d4111616c tempest-AbsoluteLimitsTests-418734707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5541ac36-2370-4c5d-90e0-84a38cd0dd9f {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:53 devstack sudo[99393]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5541ac36-2370-4c5d-90e0-84a38cd0dd9f Nov 01 12:29:53 devstack sudo[99393]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:54 devstack sudo[99366]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_gmvd6qz0devstack@QuobyteHD /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6bebbc64-8be4-4b10-8cca-a0d1864197de" returned: 0 in 2.487s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:54 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f937a0d6-76b6-4a84-a698-e474557181cd_gmvd6qz0devstack@QuobyteHD, size 112.00 MB, duration 2.49 sec, destination /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6bebbc64-8be4-4b10-8cca-a0d1864197de {{(pid=86574) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 12:29:54 devstack cinder-volume[86574]: INFO cinder.image.image_utils [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] Converted 112.00 MB image at 45.01 MB/s Nov 01 12:29:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6bebbc64-8be4-4b10-8cca-a0d1864197de 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:54 devstack sudo[99393]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-32df4bad-78ac-48a5-bb02-7f6d4111616c tempest-AbsoluteLimitsTests-418734707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5541ac36-2370-4c5d-90e0-84a38cd0dd9f" returned: 0 in 0.341s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:54 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-32df4bad-78ac-48a5-bb02-7f6d4111616c tempest-AbsoluteLimitsTests-418734707 None] <== create_volume: return (947ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:29:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-32df4bad-78ac-48a5-bb02-7f6d4111616c tempest-AbsoluteLimitsTests-418734707 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:29:54 devstack sudo[99396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6bebbc64-8be4-4b10-8cca-a0d1864197de 1G Nov 01 12:29:54 devstack sudo[99396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:54 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32df4bad-78ac-48a5-bb02-7f6d4111616c tempest-AbsoluteLimitsTests-418734707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ccc539d-7782-42df-b010-8d9b6c4f51fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5541ac36-2370-4c5d-90e0-84a38cd0dd9f', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:54 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32df4bad-78ac-48a5-bb02-7f6d4111616c tempest-AbsoluteLimitsTests-418734707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (281ab6c0-5de3-4406-92a9-1cc3aabed48e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:54 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-32df4bad-78ac-48a5-bb02-7f6d4111616c tempest-AbsoluteLimitsTests-418734707 None] Volume volume-5541ac36-2370-4c5d-90e0-84a38cd0dd9f (5541ac36-2370-4c5d-90e0-84a38cd0dd9f): created successfully Nov 01 12:29:54 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32df4bad-78ac-48a5-bb02-7f6d4111616c tempest-AbsoluteLimitsTests-418734707 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (281ab6c0-5de3-4406-92a9-1cc3aabed48e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:54 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32df4bad-78ac-48a5-bb02-7f6d4111616c tempest-AbsoluteLimitsTests-418734707 None] Flow 'volume_create_manager' (5319c9fd-9913-4195-8e78-150ed7ede076) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:29:54 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-32df4bad-78ac-48a5-bb02-7f6d4111616c tempest-AbsoluteLimitsTests-418734707 None] Created volume successfully. Nov 01 12:29:54 devstack sudo[99396]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6bebbc64-8be4-4b10-8cca-a0d1864197de 1G" returned: 0 in 0.350s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:54 devstack cinder-volume[86574]: DEBUG cinder.volume.volume_utils [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] Downloaded image f937a0d6-76b6-4a84-a698-e474557181cd ((None, [{'url': 'file:///opt/stack/data/glance/images/f937a0d6-76b6-4a84-a698-e474557181cd', 'metadata': {}}])) to volume 6bebbc64-8be4-4b10-8cca-a0d1864197de successfully. {{(pid=86574) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 01 12:29:54 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] Temporary image f937a0d6-76b6-4a84-a698-e474557181cd for user c7cc9459190a4f0d93d032c6c18de9ed is deleted. {{(pid=86574) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 01 12:29:54 devstack cinder-volume[86574]: DEBUG cinder.volume.volume_utils [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] Marking volume 6bebbc64-8be4-4b10-8cca-a0d1864197de as bootable. {{(pid=86574) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 01 12:29:54 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] Copying metadata from image f937a0d6-76b6-4a84-a698-e474557181cd to 6bebbc64-8be4-4b10-8cca-a0d1864197de. {{(pid=86574) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 01 12:29:54 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] Creating volume glance metadata for volume 6bebbc64-8be4-4b10-8cca-a0d1864197de backed by image f937a0d6-76b6-4a84-a698-e474557181cd with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f937a0d6-76b6-4a84-a698-e474557181cd', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86574) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 01 12:29:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-550bfcd6-539a-48cb-b252-b76d1388d81f tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:29:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-550bfcd6-539a-48cb-b252-b76d1388d81f tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:29:54 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-550bfcd6-539a-48cb-b252-b76d1388d81f tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:29:54 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-550bfcd6-539a-48cb-b252-b76d1388d81f tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:29:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-550bfcd6-539a-48cb-b252-b76d1388d81f tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:29:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-550bfcd6-539a-48cb-b252-b76d1388d81f tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:54 devstack sudo[99401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:29:54 devstack sudo[99401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:54 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90d64833-91c5-47a2-87c1-e39b5902c52d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6bebbc64-8be4-4b10-8cca-a0d1864197de', 'volume_size': 1, 'image_id': 'f937a0d6-76b6-4a84-a698-e474557181cd', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f937a0d6-76b6-4a84-a698-e474557181cd', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': 'b4892ea0f5a04c4d8b924ece0f60a2a4', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f937a0d6-76b6-4a84-a698-e474557181cd', 'created_at': datetime.datetime(2026, 11, 1, 11, 14, 36, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 14, 38, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f937a0d6-76b6-4a84-a698-e474557181cd/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': }' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:54 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (186d7953-b30c-4c65-b558-cc2f1a755da3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:54 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] Volume volume-6bebbc64-8be4-4b10-8cca-a0d1864197de (6bebbc64-8be4-4b10-8cca-a0d1864197de): created successfully Nov 01 12:29:54 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (186d7953-b30c-4c65-b558-cc2f1a755da3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:54 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] Flow 'volume_create_manager' (fffcbcd9-d06c-4738-946e-979734cb64df) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:29:54 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-708a5714-8c5f-4feb-a0ce-d92f4cf48a07 tempest-VolumesGetTest-2085089695 None] Created volume successfully. Nov 01 12:29:54 devstack sudo[99401]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-550bfcd6-539a-48cb-b252-b76d1388d81f tempest-VolumeRetypeWithoutMigrationTest-851952791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.269s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:54 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-550bfcd6-539a-48cb-b252-b76d1388d81f tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:29:54 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-550bfcd6-539a-48cb-b252-b76d1388d81f tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Retype volume completed successfully. Nov 01 12:29:55 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-91b5d41d-5aeb-40be-96a4-67227a329249 tempest-AbsoluteLimitsTests-418734707 None] Acquiring lock "cinder-5541ac36-2370-4c5d-90e0-84a38cd0dd9f-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:29:55 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-91b5d41d-5aeb-40be-96a4-67227a329249 tempest-AbsoluteLimitsTests-418734707 None] Lock "cinder-5541ac36-2370-4c5d-90e0-84a38cd0dd9f-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:29:55 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-91b5d41d-5aeb-40be-96a4-67227a329249 tempest-AbsoluteLimitsTests-418734707 None] Acquiring lock "cinder-quobyte-5541ac36-2370-4c5d-90e0-84a38cd0dd9f" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:29:55 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-91b5d41d-5aeb-40be-96a4-67227a329249 tempest-AbsoluteLimitsTests-418734707 None] Lock "cinder-quobyte-5541ac36-2370-4c5d-90e0-84a38cd0dd9f" acquired by "delete_volume" :: waited 0.022s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:29:55 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[16fe9d9a-4488-481d-a9c2-f9e1e02d96c3]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:29:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-91b5d41d-5aeb-40be-96a4-67227a329249 tempest-AbsoluteLimitsTests-418734707 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5541ac36-2370-4c5d-90e0-84a38cd0dd9f {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:55 devstack sudo[99404]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5541ac36-2370-4c5d-90e0-84a38cd0dd9f Nov 01 12:29:55 devstack sudo[99404]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:55 devstack sudo[99404]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-91b5d41d-5aeb-40be-96a4-67227a329249 tempest-AbsoluteLimitsTests-418734707 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5541ac36-2370-4c5d-90e0-84a38cd0dd9f" returned: 0 in 0.452s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-91b5d41d-5aeb-40be-96a4-67227a329249 tempest-AbsoluteLimitsTests-418734707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5541ac36-2370-4c5d-90e0-84a38cd0dd9f {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:55 devstack sudo[99409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5541ac36-2370-4c5d-90e0-84a38cd0dd9f Nov 01 12:29:55 devstack sudo[99409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:56 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-76faf435-8b81-4996-a8b5-7063cd8c5e20 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Acquiring lock "cinder-d3af2d44-cff9-4ea0-98b0-325603eeacf5-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:29:56 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-76faf435-8b81-4996-a8b5-7063cd8c5e20 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Lock "cinder-d3af2d44-cff9-4ea0-98b0-325603eeacf5-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:29:56 devstack sudo[99409]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-91b5d41d-5aeb-40be-96a4-67227a329249 tempest-AbsoluteLimitsTests-418734707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5541ac36-2370-4c5d-90e0-84a38cd0dd9f" returned: 0 in 0.445s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:56 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-76faf435-8b81-4996-a8b5-7063cd8c5e20 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Acquiring lock "cinder-quobyte-d3af2d44-cff9-4ea0-98b0-325603eeacf5" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:29:56 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-06d503a4-f09c-4e6f-a841-a0fc232a2b1e tempest-VolumesGetTest-2085089695 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:29:56 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-06d503a4-f09c-4e6f-a841-a0fc232a2b1e tempest-VolumesGetTest-2085089695 None] Flow 'volume_create_manager' (9b73cda9-55aa-4acc-beef-f4c9f2039546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:29:56 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-06d503a4-f09c-4e6f-a841-a0fc232a2b1e tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ab86c86-bfdd-4fe7-adab-94e090400077) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:56 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-91b5d41d-5aeb-40be-96a4-67227a329249 tempest-AbsoluteLimitsTests-418734707 None] Lock "cinder-quobyte-5541ac36-2370-4c5d-90e0-84a38cd0dd9f" released by "delete_volume" :: held 0.990s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:29:56 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-76faf435-8b81-4996-a8b5-7063cd8c5e20 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Lock "cinder-quobyte-d3af2d44-cff9-4ea0-98b0-325603eeacf5" acquired by "delete_volume" :: waited 0.061s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:29:56 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-06d503a4-f09c-4e6f-a841-a0fc232a2b1e tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ab86c86-bfdd-4fe7-adab-94e090400077) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:29:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1780641986',display_name='tempest-VolumesGetTest-Volume-1879157202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7dc1fbf-4a25-470a-9cc5-9b0fc8a39c3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a63e120aaecb4ae28ad7cea68cca3834',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:29:56Z,use_quota=True,user_id='c7cc9459190a4f0d93d032c6c18de9ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:56 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-06d503a4-f09c-4e6f-a841-a0fc232a2b1e tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cde53b0-a333-40e0-8d6b-2b3a80598f1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:56 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-06d503a4-f09c-4e6f-a841-a0fc232a2b1e tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9cde53b0-a333-40e0-8d6b-2b3a80598f1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:56 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-06d503a4-f09c-4e6f-a841-a0fc232a2b1e tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dab888e-f325-4a57-8563-e43f3883e459) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:56 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-06d503a4-f09c-4e6f-a841-a0fc232a2b1e tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0dab888e-f325-4a57-8563-e43f3883e459) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a7dc1fbf-4a25-470a-9cc5-9b0fc8a39c3b', 'volume_name': 'volume-a7dc1fbf-4a25-470a-9cc5-9b0fc8a39c3b', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:56 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-06d503a4-f09c-4e6f-a841-a0fc232a2b1e tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85cb48ed-5efe-402b-b79b-642669ae53e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:56 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-06d503a4-f09c-4e6f-a841-a0fc232a2b1e tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (85cb48ed-5efe-402b-b79b-642669ae53e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:56 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-06d503a4-f09c-4e6f-a841-a0fc232a2b1e tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1adf7bed-7129-457f-943b-110dbee2186e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:56 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-06d503a4-f09c-4e6f-a841-a0fc232a2b1e tempest-VolumesGetTest-2085089695 None] Volume a7dc1fbf-4a25-470a-9cc5-9b0fc8a39c3b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a7dc1fbf-4a25-470a-9cc5-9b0fc8a39c3b', 'volume_size': 1} Nov 01 12:29:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-06d503a4-f09c-4e6f-a841-a0fc232a2b1e tempest-VolumesGetTest-2085089695 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:29:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-06d503a4-f09c-4e6f-a841-a0fc232a2b1e tempest-VolumesGetTest-2085089695 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:29:56 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-06d503a4-f09c-4e6f-a841-a0fc232a2b1e tempest-VolumesGetTest-2085089695 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:29:56Z,deleted=False,deleted_at=None,display_description='tempest-@#$%^* description-1780641986',display_name='tempest-VolumesGetTest-Volume-1879157202',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a7dc1fbf-4a25-470a-9cc5-9b0fc8a39c3b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a63e120aaecb4ae28ad7cea68cca3834',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:29:56Z,use_quota=True,user_id='c7cc9459190a4f0d93d032c6c18de9ed',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:29:56 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-06d503a4-f09c-4e6f-a841-a0fc232a2b1e tempest-VolumesGetTest-2085089695 None] Creating volume a7dc1fbf-4a25-470a-9cc5-9b0fc8a39c3b {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:29:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-06d503a4-f09c-4e6f-a841-a0fc232a2b1e tempest-VolumesGetTest-2085089695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:29:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-06d503a4-f09c-4e6f-a841-a0fc232a2b1e tempest-VolumesGetTest-2085089695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:29:56 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-06d503a4-f09c-4e6f-a841-a0fc232a2b1e tempest-VolumesGetTest-2085089695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:29:56 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-06d503a4-f09c-4e6f-a841-a0fc232a2b1e tempest-VolumesGetTest-2085089695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:29:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-06d503a4-f09c-4e6f-a841-a0fc232a2b1e tempest-VolumesGetTest-2085089695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:29:56 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-06d503a4-f09c-4e6f-a841-a0fc232a2b1e tempest-VolumesGetTest-2085089695 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:29:56 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-06d503a4-f09c-4e6f-a841-a0fc232a2b1e tempest-VolumesGetTest-2085089695 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:29:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-06d503a4-f09c-4e6f-a841-a0fc232a2b1e tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-a7dc1fbf-4a25-470a-9cc5-9b0fc8a39c3b 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:56 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[5145ba56-5076-4378-b52a-c1bbfcb7bec2]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:29:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-76faf435-8b81-4996-a8b5-7063cd8c5e20 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d3af2d44-cff9-4ea0-98b0-325603eeacf5 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:56 devstack sudo[99412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-a7dc1fbf-4a25-470a-9cc5-9b0fc8a39c3b 1073741824 Nov 01 12:29:56 devstack sudo[99412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:56 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-91b5d41d-5aeb-40be-96a4-67227a329249 tempest-AbsoluteLimitsTests-418734707 None] Created reservations ['899086a7-e398-4f22-a3e6-75c3919291ec', '1e451204-a035-46ea-8c60-587fc125afb6', '1f26ba50-4053-49c0-b06a-a2f8b5bc15f6', 'a7c83571-d590-448f-bdf3-c37c2ecc391b'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:29:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-91b5d41d-5aeb-40be-96a4-67227a329249 tempest-AbsoluteLimitsTests-418734707 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:29:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-91b5d41d-5aeb-40be-96a4-67227a329249 tempest-AbsoluteLimitsTests-418734707 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:29:56 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-91b5d41d-5aeb-40be-96a4-67227a329249 tempest-AbsoluteLimitsTests-418734707 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:29:56 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-91b5d41d-5aeb-40be-96a4-67227a329249 tempest-AbsoluteLimitsTests-418734707 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:29:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-91b5d41d-5aeb-40be-96a4-67227a329249 tempest-AbsoluteLimitsTests-418734707 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:29:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-91b5d41d-5aeb-40be-96a4-67227a329249 tempest-AbsoluteLimitsTests-418734707 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:56 devstack sudo[99413]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d3af2d44-cff9-4ea0-98b0-325603eeacf5 Nov 01 12:29:56 devstack sudo[99413]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:56 devstack sudo[99415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:29:56 devstack sudo[99415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:56 devstack sudo[99415]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:56 devstack sudo[99412]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-06d503a4-f09c-4e6f-a841-a0fc232a2b1e tempest-VolumesGetTest-2085089695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-a7dc1fbf-4a25-470a-9cc5-9b0fc8a39c3b 1073741824" returned: 0 in 0.480s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-91b5d41d-5aeb-40be-96a4-67227a329249 tempest-AbsoluteLimitsTests-418734707 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.321s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:56 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-91b5d41d-5aeb-40be-96a4-67227a329249 tempest-AbsoluteLimitsTests-418734707 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:29:56 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-91b5d41d-5aeb-40be-96a4-67227a329249 tempest-AbsoluteLimitsTests-418734707 None] Deleted volume successfully. Nov 01 12:29:56 devstack sudo[99413]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-76faf435-8b81-4996-a8b5-7063cd8c5e20 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d3af2d44-cff9-4ea0-98b0-325603eeacf5" returned: 0 in 0.501s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-76faf435-8b81-4996-a8b5-7063cd8c5e20 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d3af2d44-cff9-4ea0-98b0-325603eeacf5 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-06d503a4-f09c-4e6f-a841-a0fc232a2b1e tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-a7dc1fbf-4a25-470a-9cc5-9b0fc8a39c3b {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:56 devstack sudo[99427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d3af2d44-cff9-4ea0-98b0-325603eeacf5 Nov 01 12:29:56 devstack sudo[99427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:56 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-91b5d41d-5aeb-40be-96a4-67227a329249 tempest-AbsoluteLimitsTests-418734707 None] Lock "cinder-5541ac36-2370-4c5d-90e0-84a38cd0dd9f-delete_volume" released by "delete_volume" :: held 1.695s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:29:56 devstack sudo[99429]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-a7dc1fbf-4a25-470a-9cc5-9b0fc8a39c3b Nov 01 12:29:56 devstack sudo[99429]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:57 devstack sudo[99427]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-76faf435-8b81-4996-a8b5-7063cd8c5e20 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d3af2d44-cff9-4ea0-98b0-325603eeacf5" returned: 0 in 0.278s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:57 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-76faf435-8b81-4996-a8b5-7063cd8c5e20 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Lock "cinder-quobyte-d3af2d44-cff9-4ea0-98b0-325603eeacf5" released by "delete_volume" :: held 0.890s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:29:57 devstack sudo[99429]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-06d503a4-f09c-4e6f-a841-a0fc232a2b1e tempest-VolumesGetTest-2085089695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-a7dc1fbf-4a25-470a-9cc5-9b0fc8a39c3b" returned: 0 in 0.300s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:57 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-06d503a4-f09c-4e6f-a841-a0fc232a2b1e tempest-VolumesGetTest-2085089695 None] <== create_volume: return (855ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:29:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-06d503a4-f09c-4e6f-a841-a0fc232a2b1e tempest-VolumesGetTest-2085089695 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:29:57 devstack cinder-volume[86574]: WARNING cinder.quota [None req-76faf435-8b81-4996-a8b5-7063cd8c5e20 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:29:57 devstack cinder-volume[86574]: WARNING cinder.quota [None req-76faf435-8b81-4996-a8b5-7063cd8c5e20 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:29:57 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-06d503a4-f09c-4e6f-a841-a0fc232a2b1e tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1adf7bed-7129-457f-943b-110dbee2186e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a7dc1fbf-4a25-470a-9cc5-9b0fc8a39c3b', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:57 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-06d503a4-f09c-4e6f-a841-a0fc232a2b1e tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a39907e-8185-43f5-827f-8afbd8943ef4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:29:57 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-06d503a4-f09c-4e6f-a841-a0fc232a2b1e tempest-VolumesGetTest-2085089695 None] Volume volume-a7dc1fbf-4a25-470a-9cc5-9b0fc8a39c3b (a7dc1fbf-4a25-470a-9cc5-9b0fc8a39c3b): created successfully Nov 01 12:29:57 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-06d503a4-f09c-4e6f-a841-a0fc232a2b1e tempest-VolumesGetTest-2085089695 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a39907e-8185-43f5-827f-8afbd8943ef4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:29:57 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-06d503a4-f09c-4e6f-a841-a0fc232a2b1e tempest-VolumesGetTest-2085089695 None] Flow 'volume_create_manager' (9b73cda9-55aa-4acc-beef-f4c9f2039546) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:29:57 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-76faf435-8b81-4996-a8b5-7063cd8c5e20 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Created reservations ['70ab370c-1839-4497-b35c-fcc37baf6d93', '2f01125a-67d9-4a4e-8c6d-090f7d79c0fc', 'fcf81a49-be6e-4166-a173-24bde0ec9196', 'eeb5839b-aff9-4282-99ef-c0bdf38a5a54'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:29:57 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-06d503a4-f09c-4e6f-a841-a0fc232a2b1e tempest-VolumesGetTest-2085089695 None] Created volume successfully. Nov 01 12:29:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-76faf435-8b81-4996-a8b5-7063cd8c5e20 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:29:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-76faf435-8b81-4996-a8b5-7063cd8c5e20 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:29:57 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-76faf435-8b81-4996-a8b5-7063cd8c5e20 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:29:57 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-76faf435-8b81-4996-a8b5-7063cd8c5e20 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:29:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-76faf435-8b81-4996-a8b5-7063cd8c5e20 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:29:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-76faf435-8b81-4996-a8b5-7063cd8c5e20 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:57 devstack sudo[99433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:29:57 devstack sudo[99433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:57 devstack sudo[99433]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-76faf435-8b81-4996-a8b5-7063cd8c5e20 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.271s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:57 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-76faf435-8b81-4996-a8b5-7063cd8c5e20 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:29:57 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-76faf435-8b81-4996-a8b5-7063cd8c5e20 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Deleted volume successfully. Nov 01 12:29:57 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-76faf435-8b81-4996-a8b5-7063cd8c5e20 tempest-VolumeRetypeWithoutMigrationTest-851952791 None] Lock "cinder-d3af2d44-cff9-4ea0-98b0-325603eeacf5-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:29:58 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0e259bae-789f-4b56-afef-3431f8d48696 tempest-VolumesGetTest-2085089695 None] Acquiring lock "cinder-a7dc1fbf-4a25-470a-9cc5-9b0fc8a39c3b-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:29:58 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0e259bae-789f-4b56-afef-3431f8d48696 tempest-VolumesGetTest-2085089695 None] Lock "cinder-a7dc1fbf-4a25-470a-9cc5-9b0fc8a39c3b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:29:58 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0e259bae-789f-4b56-afef-3431f8d48696 tempest-VolumesGetTest-2085089695 None] Acquiring lock "cinder-quobyte-a7dc1fbf-4a25-470a-9cc5-9b0fc8a39c3b" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:29:58 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0e259bae-789f-4b56-afef-3431f8d48696 tempest-VolumesGetTest-2085089695 None] Lock "cinder-quobyte-a7dc1fbf-4a25-470a-9cc5-9b0fc8a39c3b" acquired by "delete_volume" :: waited 0.022s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:29:58 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[753c22d4-8bdf-4fe3-8af2-46a17cde3c66]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:29:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0e259bae-789f-4b56-afef-3431f8d48696 tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-a7dc1fbf-4a25-470a-9cc5-9b0fc8a39c3b {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:58 devstack sudo[99437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-a7dc1fbf-4a25-470a-9cc5-9b0fc8a39c3b Nov 01 12:29:58 devstack sudo[99437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:59 devstack sudo[99437]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0e259bae-789f-4b56-afef-3431f8d48696 tempest-VolumesGetTest-2085089695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-a7dc1fbf-4a25-470a-9cc5-9b0fc8a39c3b" returned: 0 in 0.568s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0e259bae-789f-4b56-afef-3431f8d48696 tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-a7dc1fbf-4a25-470a-9cc5-9b0fc8a39c3b {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:59 devstack sudo[99442]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-a7dc1fbf-4a25-470a-9cc5-9b0fc8a39c3b Nov 01 12:29:59 devstack sudo[99442]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:59 devstack sudo[99442]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0e259bae-789f-4b56-afef-3431f8d48696 tempest-VolumesGetTest-2085089695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-a7dc1fbf-4a25-470a-9cc5-9b0fc8a39c3b" returned: 0 in 0.296s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:59 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0e259bae-789f-4b56-afef-3431f8d48696 tempest-VolumesGetTest-2085089695 None] Lock "cinder-quobyte-a7dc1fbf-4a25-470a-9cc5-9b0fc8a39c3b" released by "delete_volume" :: held 0.936s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:29:59 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-0e259bae-789f-4b56-afef-3431f8d48696 tempest-VolumesGetTest-2085089695 None] Created reservations ['e2260697-5b06-412f-9610-29580e74ded4', '3ffe52be-a89c-4665-939a-593b469fb438', 'ab3d749f-5311-4c70-b880-4f8da3124146', 'd11721c2-befd-4bbc-9c14-9618ef59e3db'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:29:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0e259bae-789f-4b56-afef-3431f8d48696 tempest-VolumesGetTest-2085089695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:29:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0e259bae-789f-4b56-afef-3431f8d48696 tempest-VolumesGetTest-2085089695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:29:59 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-0e259bae-789f-4b56-afef-3431f8d48696 tempest-VolumesGetTest-2085089695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:29:59 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-0e259bae-789f-4b56-afef-3431f8d48696 tempest-VolumesGetTest-2085089695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:29:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0e259bae-789f-4b56-afef-3431f8d48696 tempest-VolumesGetTest-2085089695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:29:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0e259bae-789f-4b56-afef-3431f8d48696 tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:29:59 devstack sudo[99445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:29:59 devstack sudo[99445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:29:59 devstack sudo[99445]: pam_unix(sudo:session): session closed for user root Nov 01 12:29:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0e259bae-789f-4b56-afef-3431f8d48696 tempest-VolumesGetTest-2085089695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.276s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:29:59 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-0e259bae-789f-4b56-afef-3431f8d48696 tempest-VolumesGetTest-2085089695 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:29:59 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-0e259bae-789f-4b56-afef-3431f8d48696 tempest-VolumesGetTest-2085089695 None] Deleted volume successfully. Nov 01 12:30:00 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0e259bae-789f-4b56-afef-3431f8d48696 tempest-VolumesGetTest-2085089695 None] Lock "cinder-a7dc1fbf-4a25-470a-9cc5-9b0fc8a39c3b-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:30:00 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-2c73aa67-fea8-4ec9-8bd3-7d862bfa7dc5 tempest-VolumesGetTest-2085089695 None] Acquiring lock "cinder-6bebbc64-8be4-4b10-8cca-a0d1864197de-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:30:00 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-2c73aa67-fea8-4ec9-8bd3-7d862bfa7dc5 tempest-VolumesGetTest-2085089695 None] Lock "cinder-6bebbc64-8be4-4b10-8cca-a0d1864197de-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:30:00 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-2c73aa67-fea8-4ec9-8bd3-7d862bfa7dc5 tempest-VolumesGetTest-2085089695 None] Acquiring lock "cinder-quobyte-6bebbc64-8be4-4b10-8cca-a0d1864197de" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:30:00 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-2c73aa67-fea8-4ec9-8bd3-7d862bfa7dc5 tempest-VolumesGetTest-2085089695 None] Lock "cinder-quobyte-6bebbc64-8be4-4b10-8cca-a0d1864197de" acquired by "delete_volume" :: waited 0.020s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:30:01 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[64939977-d3bb-4794-af54-383a831f754b]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:30:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2c73aa67-fea8-4ec9-8bd3-7d862bfa7dc5 tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6bebbc64-8be4-4b10-8cca-a0d1864197de {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:01 devstack sudo[99451]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6bebbc64-8be4-4b10-8cca-a0d1864197de Nov 01 12:30:01 devstack sudo[99451]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:01 devstack sudo[99451]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2c73aa67-fea8-4ec9-8bd3-7d862bfa7dc5 tempest-VolumesGetTest-2085089695 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6bebbc64-8be4-4b10-8cca-a0d1864197de" returned: 0 in 0.592s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2c73aa67-fea8-4ec9-8bd3-7d862bfa7dc5 tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6bebbc64-8be4-4b10-8cca-a0d1864197de {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:01 devstack sudo[99458]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6bebbc64-8be4-4b10-8cca-a0d1864197de Nov 01 12:30:01 devstack sudo[99458]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:02 devstack sudo[99458]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2c73aa67-fea8-4ec9-8bd3-7d862bfa7dc5 tempest-VolumesGetTest-2085089695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6bebbc64-8be4-4b10-8cca-a0d1864197de" returned: 0 in 0.395s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:02 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-2c73aa67-fea8-4ec9-8bd3-7d862bfa7dc5 tempest-VolumesGetTest-2085089695 None] Lock "cinder-quobyte-6bebbc64-8be4-4b10-8cca-a0d1864197de" released by "delete_volume" :: held 1.082s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:30:02 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-2c73aa67-fea8-4ec9-8bd3-7d862bfa7dc5 tempest-VolumesGetTest-2085089695 None] Created reservations ['a3bfd4a9-7129-4321-8000-0e44bd994c98', '91954b66-6d07-4d96-a88f-b153079134fd', '69db575b-2528-46fe-b3fb-bcb7de415e07', '2705b91b-df40-488f-be1b-68dda22b1b3a'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:30:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-2c73aa67-fea8-4ec9-8bd3-7d862bfa7dc5 tempest-VolumesGetTest-2085089695 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:30:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-2c73aa67-fea8-4ec9-8bd3-7d862bfa7dc5 tempest-VolumesGetTest-2085089695 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:30:02 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-2c73aa67-fea8-4ec9-8bd3-7d862bfa7dc5 tempest-VolumesGetTest-2085089695 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:30:02 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-2c73aa67-fea8-4ec9-8bd3-7d862bfa7dc5 tempest-VolumesGetTest-2085089695 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:30:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-2c73aa67-fea8-4ec9-8bd3-7d862bfa7dc5 tempest-VolumesGetTest-2085089695 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:30:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2c73aa67-fea8-4ec9-8bd3-7d862bfa7dc5 tempest-VolumesGetTest-2085089695 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:02 devstack sudo[99461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:30:02 devstack sudo[99461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:02 devstack sudo[99461]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2c73aa67-fea8-4ec9-8bd3-7d862bfa7dc5 tempest-VolumesGetTest-2085089695 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.345s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:02 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-2c73aa67-fea8-4ec9-8bd3-7d862bfa7dc5 tempest-VolumesGetTest-2085089695 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:30:02 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-2c73aa67-fea8-4ec9-8bd3-7d862bfa7dc5 tempest-VolumesGetTest-2085089695 None] Deleted volume successfully. Nov 01 12:30:02 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-2c73aa67-fea8-4ec9-8bd3-7d862bfa7dc5 tempest-VolumesGetTest-2085089695 None] Lock "cinder-6bebbc64-8be4-4b10-8cca-a0d1864197de-delete_volume" released by "delete_volume" :: held 1.796s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:30:04 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-cb2239e9-62e3-4109-ac07-d927fb64a005 tempest-VolumesDeleteCascade-219134487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:30:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-cb2239e9-62e3-4109-ac07-d927fb64a005 tempest-VolumesDeleteCascade-219134487 None] Flow 'volume_create_manager' (f2bb88cd-1796-4c99-8f07-165fdae1c3e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:30:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-cb2239e9-62e3-4109-ac07-d927fb64a005 tempest-VolumesDeleteCascade-219134487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3321fd01-c02d-48fb-8477-2140d11605d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-cb2239e9-62e3-4109-ac07-d927fb64a005 tempest-VolumesDeleteCascade-219134487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3321fd01-c02d-48fb-8477-2140d11605d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1052960024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32cb84b6-d102-4463-ad9c-873e2ed3fdaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f5406dcef8e45c3b7423c5dc2309e2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:30:04Z,use_quota=True,user_id='e11a5b09fb944833a7074fcacc24dab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-cb2239e9-62e3-4109-ac07-d927fb64a005 tempest-VolumesDeleteCascade-219134487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a49a89a-c9c6-4485-b78a-0bf6cbb62487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-cb2239e9-62e3-4109-ac07-d927fb64a005 tempest-VolumesDeleteCascade-219134487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5a49a89a-c9c6-4485-b78a-0bf6cbb62487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-cb2239e9-62e3-4109-ac07-d927fb64a005 tempest-VolumesDeleteCascade-219134487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30e8f7dd-9632-41bb-8dbd-a5a494555ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-cb2239e9-62e3-4109-ac07-d927fb64a005 tempest-VolumesDeleteCascade-219134487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30e8f7dd-9632-41bb-8dbd-a5a494555ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '32cb84b6-d102-4463-ad9c-873e2ed3fdaf', 'volume_name': 'volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-cb2239e9-62e3-4109-ac07-d927fb64a005 tempest-VolumesDeleteCascade-219134487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94dd2cd5-982b-4ddd-a140-8d71bb9276f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-cb2239e9-62e3-4109-ac07-d927fb64a005 tempest-VolumesDeleteCascade-219134487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (94dd2cd5-982b-4ddd-a140-8d71bb9276f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-cb2239e9-62e3-4109-ac07-d927fb64a005 tempest-VolumesDeleteCascade-219134487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1240348f-c3c3-4342-a56e-b4f33a9dd8ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:04 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-cb2239e9-62e3-4109-ac07-d927fb64a005 tempest-VolumesDeleteCascade-219134487 None] Volume 32cb84b6-d102-4463-ad9c-873e2ed3fdaf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf', 'volume_size': 1} Nov 01 12:30:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-cb2239e9-62e3-4109-ac07-d927fb64a005 tempest-VolumesDeleteCascade-219134487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:30:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-cb2239e9-62e3-4109-ac07-d927fb64a005 tempest-VolumesDeleteCascade-219134487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:30:04 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-cb2239e9-62e3-4109-ac07-d927fb64a005 tempest-VolumesDeleteCascade-219134487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:30:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1052960024',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=32cb84b6-d102-4463-ad9c-873e2ed3fdaf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f5406dcef8e45c3b7423c5dc2309e2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:30:04Z,use_quota=True,user_id='e11a5b09fb944833a7074fcacc24dab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:30:04 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-cb2239e9-62e3-4109-ac07-d927fb64a005 tempest-VolumesDeleteCascade-219134487 None] Creating volume 32cb84b6-d102-4463-ad9c-873e2ed3fdaf {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:30:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-cb2239e9-62e3-4109-ac07-d927fb64a005 tempest-VolumesDeleteCascade-219134487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:30:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-cb2239e9-62e3-4109-ac07-d927fb64a005 tempest-VolumesDeleteCascade-219134487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:30:04 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-cb2239e9-62e3-4109-ac07-d927fb64a005 tempest-VolumesDeleteCascade-219134487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:30:04 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-cb2239e9-62e3-4109-ac07-d927fb64a005 tempest-VolumesDeleteCascade-219134487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:30:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-cb2239e9-62e3-4109-ac07-d927fb64a005 tempest-VolumesDeleteCascade-219134487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:30:04 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-cb2239e9-62e3-4109-ac07-d927fb64a005 tempest-VolumesDeleteCascade-219134487 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:30:04 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-cb2239e9-62e3-4109-ac07-d927fb64a005 tempest-VolumesDeleteCascade-219134487 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:30:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-cb2239e9-62e3-4109-ac07-d927fb64a005 tempest-VolumesDeleteCascade-219134487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:04 devstack sudo[99470]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf 1073741824 Nov 01 12:30:04 devstack sudo[99470]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:05 devstack sudo[99470]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-cb2239e9-62e3-4109-ac07-d927fb64a005 tempest-VolumesDeleteCascade-219134487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf 1073741824" returned: 0 in 0.588s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-cb2239e9-62e3-4109-ac07-d927fb64a005 tempest-VolumesDeleteCascade-219134487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:05 devstack sudo[99500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf Nov 01 12:30:05 devstack sudo[99500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:05 devstack sudo[99500]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-cb2239e9-62e3-4109-ac07-d927fb64a005 tempest-VolumesDeleteCascade-219134487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf" returned: 0 in 0.364s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:05 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-cb2239e9-62e3-4109-ac07-d927fb64a005 tempest-VolumesDeleteCascade-219134487 None] <== create_volume: return (999ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:30:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-cb2239e9-62e3-4109-ac07-d927fb64a005 tempest-VolumesDeleteCascade-219134487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.002s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:30:05 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-cb2239e9-62e3-4109-ac07-d927fb64a005 tempest-VolumesDeleteCascade-219134487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1240348f-c3c3-4342-a56e-b4f33a9dd8ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:05 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-cb2239e9-62e3-4109-ac07-d927fb64a005 tempest-VolumesDeleteCascade-219134487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c2a602a-500d-40fd-91a9-575bc6232790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:05 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-cb2239e9-62e3-4109-ac07-d927fb64a005 tempest-VolumesDeleteCascade-219134487 None] Volume volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf (32cb84b6-d102-4463-ad9c-873e2ed3fdaf): created successfully Nov 01 12:30:05 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-cb2239e9-62e3-4109-ac07-d927fb64a005 tempest-VolumesDeleteCascade-219134487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0c2a602a-500d-40fd-91a9-575bc6232790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:05 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-cb2239e9-62e3-4109-ac07-d927fb64a005 tempest-VolumesDeleteCascade-219134487 None] Flow 'volume_create_manager' (f2bb88cd-1796-4c99-8f07-165fdae1c3e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:30:05 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-cb2239e9-62e3-4109-ac07-d927fb64a005 tempest-VolumesDeleteCascade-219134487 None] Created volume successfully. Nov 01 12:30:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8edf8ea1-058f-4d29-ad09-cae428b1276b tempest-VolumesDeleteCascade-219134487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:30:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8edf8ea1-058f-4d29-ad09-cae428b1276b tempest-VolumesDeleteCascade-219134487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:30:06 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-8edf8ea1-058f-4d29-ad09-cae428b1276b tempest-VolumesDeleteCascade-219134487 None] Creating offline snapshot 597ee4df-137f-45b1-b990-31a36c76f403 of volume 32cb84b6-d102-4463-ad9c-873e2ed3fdaf {{(pid=86574) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:30:06 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[481de373-e5c4-49d9-85ba-83a7a068a5f5]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:30:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8edf8ea1-058f-4d29-ad09-cae428b1276b tempest-VolumesDeleteCascade-219134487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:06 devstack sudo[99505]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf Nov 01 12:30:06 devstack sudo[99505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:07 devstack sudo[99505]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8edf8ea1-058f-4d29-ad09-cae428b1276b tempest-VolumesDeleteCascade-219134487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf" returned: 0 in 0.451s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8edf8ea1-058f-4d29-ad09-cae428b1276b tempest-VolumesDeleteCascade-219134487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.597ee4df-137f-45b1-b990-31a36c76f403 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:07 devstack sudo[99510]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.597ee4df-137f-45b1-b990-31a36c76f403 1G Nov 01 12:30:07 devstack sudo[99510]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:07 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-07f606bc-0bd6-4e24-9f5a-4279dbd9b5a4 tempest-VolumesServicesTestJSON-1970793091 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:30:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-07f606bc-0bd6-4e24-9f5a-4279dbd9b5a4 tempest-VolumesServicesTestJSON-1970793091 None] Flow 'volume_create_manager' (8e887a60-d904-46d8-9789-edb89733b0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:30:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-07f606bc-0bd6-4e24-9f5a-4279dbd9b5a4 tempest-VolumesServicesTestJSON-1970793091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42111ac0-d63c-463c-bc26-f9bd9e3b415f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-07f606bc-0bd6-4e24-9f5a-4279dbd9b5a4 tempest-VolumesServicesTestJSON-1970793091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (42111ac0-d63c-463c-bc26-f9bd9e3b415f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1835007561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a5ab862-90a4-4cd8-91d9-c27cfa1542be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e4813fbbe534a0096980c6e06b4550e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:30:07Z,use_quota=True,user_id='58e6032ffd3f4014b6a1544e8ce0dd8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-07f606bc-0bd6-4e24-9f5a-4279dbd9b5a4 tempest-VolumesServicesTestJSON-1970793091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bb3be4c-6d82-4f84-a3e5-590d252ebc70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-07f606bc-0bd6-4e24-9f5a-4279dbd9b5a4 tempest-VolumesServicesTestJSON-1970793091 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9bb3be4c-6d82-4f84-a3e5-590d252ebc70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-07f606bc-0bd6-4e24-9f5a-4279dbd9b5a4 tempest-VolumesServicesTestJSON-1970793091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce4fa55d-442c-46bd-9c65-83c5ec020b02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-07f606bc-0bd6-4e24-9f5a-4279dbd9b5a4 tempest-VolumesServicesTestJSON-1970793091 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ce4fa55d-442c-46bd-9c65-83c5ec020b02) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a5ab862-90a4-4cd8-91d9-c27cfa1542be', 'volume_name': 'volume-3a5ab862-90a4-4cd8-91d9-c27cfa1542be', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-07f606bc-0bd6-4e24-9f5a-4279dbd9b5a4 tempest-VolumesServicesTestJSON-1970793091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ddd9018-7536-4578-9be2-4613a9698c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-07f606bc-0bd6-4e24-9f5a-4279dbd9b5a4 tempest-VolumesServicesTestJSON-1970793091 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ddd9018-7536-4578-9be2-4613a9698c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-07f606bc-0bd6-4e24-9f5a-4279dbd9b5a4 tempest-VolumesServicesTestJSON-1970793091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4940fe01-22c6-41ac-83b0-958e56c60899) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:07 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-07f606bc-0bd6-4e24-9f5a-4279dbd9b5a4 tempest-VolumesServicesTestJSON-1970793091 None] Volume 3a5ab862-90a4-4cd8-91d9-c27cfa1542be: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a5ab862-90a4-4cd8-91d9-c27cfa1542be', 'volume_size': 1} Nov 01 12:30:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-07f606bc-0bd6-4e24-9f5a-4279dbd9b5a4 tempest-VolumesServicesTestJSON-1970793091 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:30:07 devstack sudo[99510]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8edf8ea1-058f-4d29-ad09-cae428b1276b tempest-VolumesDeleteCascade-219134487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.597ee4df-137f-45b1-b990-31a36c76f403 1G" returned: 0 in 0.486s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8edf8ea1-058f-4d29-ad09-cae428b1276b tempest-VolumesDeleteCascade-219134487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.597ee4df-137f-45b1-b990-31a36c76f403 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:07 devstack sudo[99516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.597ee4df-137f-45b1-b990-31a36c76f403 Nov 01 12:30:07 devstack sudo[99516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:07 devstack sudo[99516]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8edf8ea1-058f-4d29-ad09-cae428b1276b tempest-VolumesDeleteCascade-219134487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.597ee4df-137f-45b1-b990-31a36c76f403" returned: 0 in 0.342s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:07 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-8edf8ea1-058f-4d29-ad09-cae428b1276b tempest-VolumesDeleteCascade-219134487 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.597ee4df-137f-45b1-b990-31a36c76f403 is being set with open permissions: ugo+rw Nov 01 12:30:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8edf8ea1-058f-4d29-ad09-cae428b1276b tempest-VolumesDeleteCascade-219134487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.597ee4df-137f-45b1-b990-31a36c76f403 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:08 devstack sudo[99522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.597ee4df-137f-45b1-b990-31a36c76f403 Nov 01 12:30:08 devstack sudo[99522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:08 devstack sudo[99522]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8edf8ea1-058f-4d29-ad09-cae428b1276b tempest-VolumesDeleteCascade-219134487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.597ee4df-137f-45b1-b990-31a36c76f403" returned: 0 in 0.289s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8edf8ea1-058f-4d29-ad09-cae428b1276b tempest-VolumesDeleteCascade-219134487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:08 devstack sudo[99525]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.info Nov 01 12:30:08 devstack sudo[99525]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:08 devstack sudo[99525]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8edf8ea1-058f-4d29-ad09-cae428b1276b tempest-VolumesDeleteCascade-219134487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.info" returned: 0 in 0.253s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:08 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-8edf8ea1-058f-4d29-ad09-cae428b1276b tempest-VolumesDeleteCascade-219134487 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.info is being set with open permissions: ugo+rw Nov 01 12:30:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8edf8ea1-058f-4d29-ad09-cae428b1276b tempest-VolumesDeleteCascade-219134487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:08 devstack sudo[99528]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.info Nov 01 12:30:08 devstack sudo[99528]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:08 devstack sudo[99528]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8edf8ea1-058f-4d29-ad09-cae428b1276b tempest-VolumesDeleteCascade-219134487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.info" returned: 0 in 0.267s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8edf8ea1-058f-4d29-ad09-cae428b1276b tempest-VolumesDeleteCascade-219134487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.193s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:30:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-07f606bc-0bd6-4e24-9f5a-4279dbd9b5a4 tempest-VolumesServicesTestJSON-1970793091 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.321s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:30:08 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-07f606bc-0bd6-4e24-9f5a-4279dbd9b5a4 tempest-VolumesServicesTestJSON-1970793091 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:30:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-1835007561',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a5ab862-90a4-4cd8-91d9-c27cfa1542be,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6e4813fbbe534a0096980c6e06b4550e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:30:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:30:07Z,use_quota=True,user_id='58e6032ffd3f4014b6a1544e8ce0dd8d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:30:08 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-07f606bc-0bd6-4e24-9f5a-4279dbd9b5a4 tempest-VolumesServicesTestJSON-1970793091 None] Creating volume 3a5ab862-90a4-4cd8-91d9-c27cfa1542be {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:30:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-07f606bc-0bd6-4e24-9f5a-4279dbd9b5a4 tempest-VolumesServicesTestJSON-1970793091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:30:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-07f606bc-0bd6-4e24-9f5a-4279dbd9b5a4 tempest-VolumesServicesTestJSON-1970793091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:30:08 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-07f606bc-0bd6-4e24-9f5a-4279dbd9b5a4 tempest-VolumesServicesTestJSON-1970793091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:30:08 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-07f606bc-0bd6-4e24-9f5a-4279dbd9b5a4 tempest-VolumesServicesTestJSON-1970793091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:30:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-07f606bc-0bd6-4e24-9f5a-4279dbd9b5a4 tempest-VolumesServicesTestJSON-1970793091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:30:08 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-07f606bc-0bd6-4e24-9f5a-4279dbd9b5a4 tempest-VolumesServicesTestJSON-1970793091 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:30:08 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-07f606bc-0bd6-4e24-9f5a-4279dbd9b5a4 tempest-VolumesServicesTestJSON-1970793091 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:30:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-07f606bc-0bd6-4e24-9f5a-4279dbd9b5a4 tempest-VolumesServicesTestJSON-1970793091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3a5ab862-90a4-4cd8-91d9-c27cfa1542be 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:08 devstack sudo[99531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3a5ab862-90a4-4cd8-91d9-c27cfa1542be 1073741824 Nov 01 12:30:08 devstack sudo[99531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:08 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-8edf8ea1-058f-4d29-ad09-cae428b1276b tempest-VolumesDeleteCascade-219134487 None] Create snapshot completed successfully Nov 01 12:30:09 devstack sudo[99531]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-07f606bc-0bd6-4e24-9f5a-4279dbd9b5a4 tempest-VolumesServicesTestJSON-1970793091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3a5ab862-90a4-4cd8-91d9-c27cfa1542be 1073741824" returned: 0 in 0.482s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-07f606bc-0bd6-4e24-9f5a-4279dbd9b5a4 tempest-VolumesServicesTestJSON-1970793091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3a5ab862-90a4-4cd8-91d9-c27cfa1542be {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:09 devstack sudo[99536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3a5ab862-90a4-4cd8-91d9-c27cfa1542be Nov 01 12:30:09 devstack sudo[99536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:09 devstack sudo[99536]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-07f606bc-0bd6-4e24-9f5a-4279dbd9b5a4 tempest-VolumesServicesTestJSON-1970793091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3a5ab862-90a4-4cd8-91d9-c27cfa1542be" returned: 0 in 0.257s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:09 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-07f606bc-0bd6-4e24-9f5a-4279dbd9b5a4 tempest-VolumesServicesTestJSON-1970793091 None] <== create_volume: return (780ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:30:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-07f606bc-0bd6-4e24-9f5a-4279dbd9b5a4 tempest-VolumesServicesTestJSON-1970793091 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:30:09 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-07f606bc-0bd6-4e24-9f5a-4279dbd9b5a4 tempest-VolumesServicesTestJSON-1970793091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4940fe01-22c6-41ac-83b0-958e56c60899) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a5ab862-90a4-4cd8-91d9-c27cfa1542be', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:09 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-07f606bc-0bd6-4e24-9f5a-4279dbd9b5a4 tempest-VolumesServicesTestJSON-1970793091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26cda1d9-0214-4aea-9f16-e3a1532658d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:09 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-07f606bc-0bd6-4e24-9f5a-4279dbd9b5a4 tempest-VolumesServicesTestJSON-1970793091 None] Volume volume-3a5ab862-90a4-4cd8-91d9-c27cfa1542be (3a5ab862-90a4-4cd8-91d9-c27cfa1542be): created successfully Nov 01 12:30:09 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-07f606bc-0bd6-4e24-9f5a-4279dbd9b5a4 tempest-VolumesServicesTestJSON-1970793091 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (26cda1d9-0214-4aea-9f16-e3a1532658d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:09 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-07f606bc-0bd6-4e24-9f5a-4279dbd9b5a4 tempest-VolumesServicesTestJSON-1970793091 None] Flow 'volume_create_manager' (8e887a60-d904-46d8-9789-edb89733b0f4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:30:09 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-07f606bc-0bd6-4e24-9f5a-4279dbd9b5a4 tempest-VolumesServicesTestJSON-1970793091 None] Created volume successfully. Nov 01 12:30:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-1428769b-9a14-4977-bdfd-112040c701c7 tempest-VolumesDeleteCascade-219134487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:30:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-1428769b-9a14-4977-bdfd-112040c701c7 tempest-VolumesDeleteCascade-219134487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:30:10 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-1428769b-9a14-4977-bdfd-112040c701c7 tempest-VolumesDeleteCascade-219134487 None] Creating offline snapshot d84d7b2d-e83e-4435-8f2f-db1a9631da09 of volume 32cb84b6-d102-4463-ad9c-873e2ed3fdaf {{(pid=86574) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:30:10 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ec1cd2c-5906-44aa-a9ac-66c3218052f4]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:30:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1428769b-9a14-4977-bdfd-112040c701c7 tempest-VolumesDeleteCascade-219134487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.597ee4df-137f-45b1-b990-31a36c76f403 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:10 devstack sudo[99540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.597ee4df-137f-45b1-b990-31a36c76f403 Nov 01 12:30:10 devstack sudo[99540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:10 devstack sudo[99540]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1428769b-9a14-4977-bdfd-112040c701c7 tempest-VolumesDeleteCascade-219134487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.597ee4df-137f-45b1-b990-31a36c76f403" returned: 0 in 0.522s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:10 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-1428769b-9a14-4977-bdfd-112040c701c7 tempest-VolumesDeleteCascade-219134487 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:30:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1428769b-9a14-4977-bdfd-112040c701c7 tempest-VolumesDeleteCascade-219134487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.597ee4df-137f-45b1-b990-31a36c76f403,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.d84d7b2d-e83e-4435-8f2f-db1a9631da09 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:10 devstack sudo[99546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.597ee4df-137f-45b1-b990-31a36c76f403,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.d84d7b2d-e83e-4435-8f2f-db1a9631da09 1G Nov 01 12:30:10 devstack sudo[99546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:10 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f5f6d961-2db6-4b80-bc0f-b2d36bf088e7 tempest-VolumesServicesTestJSON-1970793091 None] Acquiring lock "cinder-3a5ab862-90a4-4cd8-91d9-c27cfa1542be-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:30:10 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f5f6d961-2db6-4b80-bc0f-b2d36bf088e7 tempest-VolumesServicesTestJSON-1970793091 None] Lock "cinder-3a5ab862-90a4-4cd8-91d9-c27cfa1542be-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:30:10 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f5f6d961-2db6-4b80-bc0f-b2d36bf088e7 tempest-VolumesServicesTestJSON-1970793091 None] Acquiring lock "cinder-quobyte-3a5ab862-90a4-4cd8-91d9-c27cfa1542be" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:30:11 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f5f6d961-2db6-4b80-bc0f-b2d36bf088e7 tempest-VolumesServicesTestJSON-1970793091 None] Lock "cinder-quobyte-3a5ab862-90a4-4cd8-91d9-c27cfa1542be" acquired by "delete_volume" :: waited 0.045s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:30:11 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[88670cb9-b11f-439d-9da2-079ffcd4d80a]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:30:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f5f6d961-2db6-4b80-bc0f-b2d36bf088e7 tempest-VolumesServicesTestJSON-1970793091 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3a5ab862-90a4-4cd8-91d9-c27cfa1542be {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:11 devstack sudo[99551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3a5ab862-90a4-4cd8-91d9-c27cfa1542be Nov 01 12:30:11 devstack sudo[99551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:11 devstack sudo[99546]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1428769b-9a14-4977-bdfd-112040c701c7 tempest-VolumesDeleteCascade-219134487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.597ee4df-137f-45b1-b990-31a36c76f403,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.d84d7b2d-e83e-4435-8f2f-db1a9631da09 1G" returned: 0 in 0.715s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1428769b-9a14-4977-bdfd-112040c701c7 tempest-VolumesDeleteCascade-219134487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.597ee4df-137f-45b1-b990-31a36c76f403 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.d84d7b2d-e83e-4435-8f2f-db1a9631da09 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:11 devstack sudo[99554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.597ee4df-137f-45b1-b990-31a36c76f403 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.d84d7b2d-e83e-4435-8f2f-db1a9631da09 Nov 01 12:30:11 devstack sudo[99554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:11 devstack sudo[99551]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f5f6d961-2db6-4b80-bc0f-b2d36bf088e7 tempest-VolumesServicesTestJSON-1970793091 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3a5ab862-90a4-4cd8-91d9-c27cfa1542be" returned: 0 in 0.547s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f5f6d961-2db6-4b80-bc0f-b2d36bf088e7 tempest-VolumesServicesTestJSON-1970793091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3a5ab862-90a4-4cd8-91d9-c27cfa1542be {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:11 devstack sudo[99559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3a5ab862-90a4-4cd8-91d9-c27cfa1542be Nov 01 12:30:11 devstack sudo[99559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:11 devstack sudo[99554]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1428769b-9a14-4977-bdfd-112040c701c7 tempest-VolumesDeleteCascade-219134487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.597ee4df-137f-45b1-b990-31a36c76f403 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.d84d7b2d-e83e-4435-8f2f-db1a9631da09" returned: 0 in 0.364s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:11 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-1428769b-9a14-4977-bdfd-112040c701c7 tempest-VolumesDeleteCascade-219134487 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.d84d7b2d-e83e-4435-8f2f-db1a9631da09 is being set with open permissions: ugo+rw Nov 01 12:30:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1428769b-9a14-4977-bdfd-112040c701c7 tempest-VolumesDeleteCascade-219134487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.d84d7b2d-e83e-4435-8f2f-db1a9631da09 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:11 devstack sudo[99564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.d84d7b2d-e83e-4435-8f2f-db1a9631da09 Nov 01 12:30:11 devstack sudo[99564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:11 devstack sudo[99559]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f5f6d961-2db6-4b80-bc0f-b2d36bf088e7 tempest-VolumesServicesTestJSON-1970793091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3a5ab862-90a4-4cd8-91d9-c27cfa1542be" returned: 0 in 0.319s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:11 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f5f6d961-2db6-4b80-bc0f-b2d36bf088e7 tempest-VolumesServicesTestJSON-1970793091 None] Lock "cinder-quobyte-3a5ab862-90a4-4cd8-91d9-c27cfa1542be" released by "delete_volume" :: held 0.943s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:30:12 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-f5f6d961-2db6-4b80-bc0f-b2d36bf088e7 tempest-VolumesServicesTestJSON-1970793091 None] Created reservations ['ff0ac9aa-952f-4107-885c-a8f47e6c948c', '114a0255-424c-446e-bf7f-dc67d7cdc1d0', 'e2312cdd-7725-4402-9a06-11af27580450', '1c401364-318f-4b7a-b031-21b3c94bb338'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:30:12 devstack sudo[99564]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1428769b-9a14-4977-bdfd-112040c701c7 tempest-VolumesDeleteCascade-219134487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.d84d7b2d-e83e-4435-8f2f-db1a9631da09" returned: 0 in 0.364s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-1428769b-9a14-4977-bdfd-112040c701c7 tempest-VolumesDeleteCascade-219134487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.160s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:30:12 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-1428769b-9a14-4977-bdfd-112040c701c7 tempest-VolumesDeleteCascade-219134487 None] Create snapshot completed successfully Nov 01 12:30:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f5f6d961-2db6-4b80-bc0f-b2d36bf088e7 tempest-VolumesServicesTestJSON-1970793091 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:30:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f5f6d961-2db6-4b80-bc0f-b2d36bf088e7 tempest-VolumesServicesTestJSON-1970793091 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:30:12 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f5f6d961-2db6-4b80-bc0f-b2d36bf088e7 tempest-VolumesServicesTestJSON-1970793091 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:30:12 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f5f6d961-2db6-4b80-bc0f-b2d36bf088e7 tempest-VolumesServicesTestJSON-1970793091 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:30:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f5f6d961-2db6-4b80-bc0f-b2d36bf088e7 tempest-VolumesServicesTestJSON-1970793091 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:30:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f5f6d961-2db6-4b80-bc0f-b2d36bf088e7 tempest-VolumesServicesTestJSON-1970793091 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:12 devstack sudo[99568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:30:12 devstack sudo[99568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:12 devstack sudo[99568]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f5f6d961-2db6-4b80-bc0f-b2d36bf088e7 tempest-VolumesServicesTestJSON-1970793091 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.251s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:12 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-f5f6d961-2db6-4b80-bc0f-b2d36bf088e7 tempest-VolumesServicesTestJSON-1970793091 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:30:12 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-f5f6d961-2db6-4b80-bc0f-b2d36bf088e7 tempest-VolumesServicesTestJSON-1970793091 None] Deleted volume successfully. Nov 01 12:30:12 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f5f6d961-2db6-4b80-bc0f-b2d36bf088e7 tempest-VolumesServicesTestJSON-1970793091 None] Lock "cinder-3a5ab862-90a4-4cd8-91d9-c27cfa1542be-delete_volume" released by "delete_volume" :: held 1.625s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:30:13 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Acquiring lock "cinder-32cb84b6-d102-4463-ad9c-873e2ed3fdaf-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:30:13 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Lock "cinder-32cb84b6-d102-4463-ad9c-873e2ed3fdaf-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:30:13 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Performing cascade delete. {{(pid=86574) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 01 12:30:13 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Acquiring lock "cinder-597ee4df-137f-45b1-b990-31a36c76f403-delete_snapshot" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:30:13 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Lock "cinder-597ee4df-137f-45b1-b990-31a36c76f403-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:30:13 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Acquiring lock "cinder-quobyte-32cb84b6-d102-4463-ad9c-873e2ed3fdaf" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:30:13 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Lock "cinder-quobyte-32cb84b6-d102-4463-ad9c-873e2ed3fdaf" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:30:13 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Acquiring lock "cinder-quobyte-597ee4df-137f-45b1-b990-31a36c76f403" by "_delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:30:13 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Lock "cinder-quobyte-597ee4df-137f-45b1-b990-31a36c76f403" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:30:13 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Deleting offline snapshot 597ee4df-137f-45b1-b990-31a36c76f403 of volume 32cb84b6-d102-4463-ad9c-873e2ed3fdaf {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:30:13 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] snapshot_file for this snap is: volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.597ee4df-137f-45b1-b990-31a36c76f403 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:30:13 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[98be3964-05e1-49cd-ae8c-866e8aae71cf]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:30:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.597ee4df-137f-45b1-b990-31a36c76f403 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:13 devstack sudo[99571]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.597ee4df-137f-45b1-b990-31a36c76f403 Nov 01 12:30:13 devstack sudo[99571]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:14 devstack sudo[99571]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:14 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.597ee4df-137f-45b1-b990-31a36c76f403" returned: 0 in 0.508s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:14 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:30:14 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3fdbe82-ed9c-47ab-9d64-6f5d0106a3d0]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:30:14 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:14 devstack sudo[99577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf Nov 01 12:30:14 devstack sudo[99577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:14 devstack sudo[99577]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:14 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf" returned: 0 in 0.470s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:14 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[44e17ef6-5216-419d-abfb-3166e9b05d1e]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:30:14 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.d84d7b2d-e83e-4435-8f2f-db1a9631da09 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:14 devstack sudo[99583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.d84d7b2d-e83e-4435-8f2f-db1a9631da09 Nov 01 12:30:14 devstack sudo[99583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:15 devstack sudo[99583]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.d84d7b2d-e83e-4435-8f2f-db1a9631da09" returned: 0 in 0.493s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:15 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:30:15 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[c91db5a9-309f-499a-b38d-e9cbef9c6145]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:30:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.597ee4df-137f-45b1-b990-31a36c76f403 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:15 devstack sudo[99588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.597ee4df-137f-45b1-b990-31a36c76f403 Nov 01 12:30:15 devstack sudo[99588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:15 devstack sudo[99588]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.597ee4df-137f-45b1-b990-31a36c76f403" returned: 0 in 0.455s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:15 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:30:15 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a92c71d-0961-4224-94f7-67dc572ba02f]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:30:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:15 devstack sudo[99593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf Nov 01 12:30:15 devstack sudo[99593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:16 devstack sudo[99593]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:16 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf" returned: 0 in 0.471s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:16 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.597ee4df-137f-45b1-b990-31a36c76f403 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:16 devstack sudo[99598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.597ee4df-137f-45b1-b990-31a36c76f403 Nov 01 12:30:16 devstack sudo[99598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:16 devstack sudo[99598]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:16 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.597ee4df-137f-45b1-b990-31a36c76f403" returned: 0 in 0.454s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:16 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.597ee4df-137f-45b1-b990-31a36c76f403 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:16 devstack sudo[99604]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.597ee4df-137f-45b1-b990-31a36c76f403 Nov 01 12:30:16 devstack sudo[99604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:16 devstack sudo[99604]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:16 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.597ee4df-137f-45b1-b990-31a36c76f403" returned: 0 in 0.368s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:16 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.d84d7b2d-e83e-4435-8f2f-db1a9631da09 -F qcow2 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:16 devstack sudo[99607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.d84d7b2d-e83e-4435-8f2f-db1a9631da09 -F qcow2 Nov 01 12:30:16 devstack sudo[99607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:17 devstack sudo[99607]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:17 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.d84d7b2d-e83e-4435-8f2f-db1a9631da09 -F qcow2" returned: 0 in 0.361s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:17 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Lock "cinder-quobyte-597ee4df-137f-45b1-b990-31a36c76f403" released by "_delete_snapshot" :: held 3.868s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:30:17 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Lock "cinder-quobyte-32cb84b6-d102-4463-ad9c-873e2ed3fdaf" released by "delete_snapshot" :: held 3.896s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:30:17 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Created reservations ['47931c49-956a-4e2c-b012-50744023de0a', '065596f5-617e-4e87-bcfb-abc67e7e72fb', '7828eef4-eacf-47cf-b942-b27abbfcfbf4', '56a3cdae-a665-425f-b772-e0c7a4af409e'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:30:17 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Delete snapshot completed successfully. Nov 01 12:30:17 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Lock "cinder-597ee4df-137f-45b1-b990-31a36c76f403-delete_snapshot" released by "delete_snapshot" :: held 4.070s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:30:17 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Acquiring lock "cinder-d84d7b2d-e83e-4435-8f2f-db1a9631da09-delete_snapshot" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:30:17 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Lock "cinder-d84d7b2d-e83e-4435-8f2f-db1a9631da09-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:30:17 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Acquiring lock "cinder-quobyte-32cb84b6-d102-4463-ad9c-873e2ed3fdaf" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:30:17 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Lock "cinder-quobyte-32cb84b6-d102-4463-ad9c-873e2ed3fdaf" acquired by "delete_snapshot" :: waited 0.033s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:30:17 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Acquiring lock "cinder-quobyte-d84d7b2d-e83e-4435-8f2f-db1a9631da09" by "_delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:30:17 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Lock "cinder-quobyte-d84d7b2d-e83e-4435-8f2f-db1a9631da09" acquired by "_delete_snapshot" :: waited 0.022s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:30:17 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Deleting offline snapshot d84d7b2d-e83e-4435-8f2f-db1a9631da09 of volume 32cb84b6-d102-4463-ad9c-873e2ed3fdaf {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:30:17 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] snapshot_file for this snap is: volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.d84d7b2d-e83e-4435-8f2f-db1a9631da09 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:30:17 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[08e5539b-c7af-40d6-bff2-e9b25270a2cc]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:30:17 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.d84d7b2d-e83e-4435-8f2f-db1a9631da09 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:17 devstack sudo[99613]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.d84d7b2d-e83e-4435-8f2f-db1a9631da09 Nov 01 12:30:17 devstack sudo[99613]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:18 devstack sudo[99613]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:18 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.d84d7b2d-e83e-4435-8f2f-db1a9631da09" returned: 0 in 0.459s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:18 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:30:18 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[02fa136f-8e25-48a4-bcb8-9e21b95b51b6]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:30:18 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:18 devstack sudo[99619]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf Nov 01 12:30:18 devstack sudo[99619]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:18 devstack sudo[99619]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:18 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf" returned: 0 in 0.488s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:18 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.d84d7b2d-e83e-4435-8f2f-db1a9631da09 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:18 devstack sudo[99624]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.d84d7b2d-e83e-4435-8f2f-db1a9631da09 Nov 01 12:30:18 devstack sudo[99624]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:19 devstack sudo[99624]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:19 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.d84d7b2d-e83e-4435-8f2f-db1a9631da09" returned: 0 in 0.459s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:19 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.d84d7b2d-e83e-4435-8f2f-db1a9631da09 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:19 devstack sudo[99629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.d84d7b2d-e83e-4435-8f2f-db1a9631da09 Nov 01 12:30:19 devstack sudo[99629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:19 devstack sudo[99629]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:19 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf.d84d7b2d-e83e-4435-8f2f-db1a9631da09" returned: 0 in 0.311s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:19 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Lock "cinder-quobyte-d84d7b2d-e83e-4435-8f2f-db1a9631da09" released by "_delete_snapshot" :: held 1.880s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:30:19 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Lock "cinder-quobyte-32cb84b6-d102-4463-ad9c-873e2ed3fdaf" released by "delete_snapshot" :: held 1.911s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:30:19 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Created reservations ['3b58402c-f3f0-4226-9e98-754015cae83e', '47e90c9f-4344-4258-9769-493a8acca7af', '7c223dce-b308-4e64-86f6-ecc818abe09c', '7b5430d9-96f9-49ad-9478-54c4b8c75322'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:30:19 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Delete snapshot completed successfully. Nov 01 12:30:19 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Lock "cinder-d84d7b2d-e83e-4435-8f2f-db1a9631da09-delete_snapshot" released by "delete_snapshot" :: held 2.110s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:30:19 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Snapshots deleted, issuing volume delete {{(pid=86574) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 01 12:30:19 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Acquiring lock "cinder-quobyte-32cb84b6-d102-4463-ad9c-873e2ed3fdaf" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:30:19 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Lock "cinder-quobyte-32cb84b6-d102-4463-ad9c-873e2ed3fdaf" acquired by "delete_volume" :: waited 0.013s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:30:19 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[f55df048-7b6a-4c56-bf1b-ddaf4ad08e77]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:30:19 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:19 devstack sudo[99632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf Nov 01 12:30:19 devstack sudo[99632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:20 devstack sudo[99632]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf" returned: 0 in 0.447s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:20 devstack sudo[99637]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf Nov 01 12:30:20 devstack sudo[99637]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:20 devstack sudo[99637]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-32cb84b6-d102-4463-ad9c-873e2ed3fdaf" returned: 0 in 0.276s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:20 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Lock "cinder-quobyte-32cb84b6-d102-4463-ad9c-873e2ed3fdaf" released by "delete_volume" :: held 0.809s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:30:20 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Created reservations ['300b7612-245d-4521-8318-cd71ed7a5a70', '22c49841-6d24-47cc-9d45-5578ff5a9400', '118fcf4d-1166-4945-b35c-9af6e9eb66ef', 'fb7888e1-6329-41aa-8707-a734e34ee8dc'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:30:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:30:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:30:20 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:30:20 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:30:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:30:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:20 devstack sudo[99640]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:30:20 devstack sudo[99640]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:20 devstack sudo[99640]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.249s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:20 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:30:20 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Deleted volume successfully. Nov 01 12:30:20 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0eeb170c-0ad4-4789-8591-76b301675014 tempest-VolumesDeleteCascade-219134487 None] Lock "cinder-32cb84b6-d102-4463-ad9c-873e2ed3fdaf-delete_volume" released by "delete_volume" :: held 7.540s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:30:21 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8233acc-a709-4695-b9ac-4a67a9e2cbe3 tempest-VolumesDeleteCascade-219134487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:30:21 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a8233acc-a709-4695-b9ac-4a67a9e2cbe3 tempest-VolumesDeleteCascade-219134487 None] Flow 'volume_create_manager' (23f42aef-6e4b-405d-a097-6e9c37f19427) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:30:21 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a8233acc-a709-4695-b9ac-4a67a9e2cbe3 tempest-VolumesDeleteCascade-219134487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2537afc3-4b1b-4f14-bf5f-711a34accfc3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:21 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a8233acc-a709-4695-b9ac-4a67a9e2cbe3 tempest-VolumesDeleteCascade-219134487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2537afc3-4b1b-4f14-bf5f-711a34accfc3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1184386463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45b1a9de-8d7f-4de2-9794-0479b1b7d4bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f5406dcef8e45c3b7423c5dc2309e2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:30:22Z,use_quota=True,user_id='e11a5b09fb944833a7074fcacc24dab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:21 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a8233acc-a709-4695-b9ac-4a67a9e2cbe3 tempest-VolumesDeleteCascade-219134487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cea8a9b-c436-4378-ac5d-8f069167d0c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:21 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a8233acc-a709-4695-b9ac-4a67a9e2cbe3 tempest-VolumesDeleteCascade-219134487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0cea8a9b-c436-4378-ac5d-8f069167d0c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:21 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a8233acc-a709-4695-b9ac-4a67a9e2cbe3 tempest-VolumesDeleteCascade-219134487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (806698f1-4be3-4dc6-b880-bbe51e88c7b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:21 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a8233acc-a709-4695-b9ac-4a67a9e2cbe3 tempest-VolumesDeleteCascade-219134487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (806698f1-4be3-4dc6-b880-bbe51e88c7b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45b1a9de-8d7f-4de2-9794-0479b1b7d4bf', 'volume_name': 'volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:22 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a8233acc-a709-4695-b9ac-4a67a9e2cbe3 tempest-VolumesDeleteCascade-219134487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a77ec1a4-c52a-49af-9ac1-c6b6d72611e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:22 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a8233acc-a709-4695-b9ac-4a67a9e2cbe3 tempest-VolumesDeleteCascade-219134487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a77ec1a4-c52a-49af-9ac1-c6b6d72611e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:22 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a8233acc-a709-4695-b9ac-4a67a9e2cbe3 tempest-VolumesDeleteCascade-219134487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f2e44a1-3788-4f55-bcde-6f8421aa2a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:22 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-a8233acc-a709-4695-b9ac-4a67a9e2cbe3 tempest-VolumesDeleteCascade-219134487 None] Volume 45b1a9de-8d7f-4de2-9794-0479b1b7d4bf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf', 'volume_size': 1} Nov 01 12:30:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a8233acc-a709-4695-b9ac-4a67a9e2cbe3 tempest-VolumesDeleteCascade-219134487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:30:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a8233acc-a709-4695-b9ac-4a67a9e2cbe3 tempest-VolumesDeleteCascade-219134487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:30:22 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a8233acc-a709-4695-b9ac-4a67a9e2cbe3 tempest-VolumesDeleteCascade-219134487 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:30:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1184386463',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45b1a9de-8d7f-4de2-9794-0479b1b7d4bf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f5406dcef8e45c3b7423c5dc2309e2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:30:22Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:30:22Z,use_quota=True,user_id='e11a5b09fb944833a7074fcacc24dab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:30:22 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-a8233acc-a709-4695-b9ac-4a67a9e2cbe3 tempest-VolumesDeleteCascade-219134487 None] Creating volume 45b1a9de-8d7f-4de2-9794-0479b1b7d4bf {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:30:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a8233acc-a709-4695-b9ac-4a67a9e2cbe3 tempest-VolumesDeleteCascade-219134487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:30:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a8233acc-a709-4695-b9ac-4a67a9e2cbe3 tempest-VolumesDeleteCascade-219134487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:30:22 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a8233acc-a709-4695-b9ac-4a67a9e2cbe3 tempest-VolumesDeleteCascade-219134487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:30:22 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a8233acc-a709-4695-b9ac-4a67a9e2cbe3 tempest-VolumesDeleteCascade-219134487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:30:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a8233acc-a709-4695-b9ac-4a67a9e2cbe3 tempest-VolumesDeleteCascade-219134487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:30:22 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a8233acc-a709-4695-b9ac-4a67a9e2cbe3 tempest-VolumesDeleteCascade-219134487 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:30:22 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-a8233acc-a709-4695-b9ac-4a67a9e2cbe3 tempest-VolumesDeleteCascade-219134487 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:30:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a8233acc-a709-4695-b9ac-4a67a9e2cbe3 tempest-VolumesDeleteCascade-219134487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:22 devstack sudo[99643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf 1073741824 Nov 01 12:30:22 devstack sudo[99643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:22 devstack sudo[99643]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a8233acc-a709-4695-b9ac-4a67a9e2cbe3 tempest-VolumesDeleteCascade-219134487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf 1073741824" returned: 0 in 0.538s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a8233acc-a709-4695-b9ac-4a67a9e2cbe3 tempest-VolumesDeleteCascade-219134487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:22 devstack sudo[99649]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf Nov 01 12:30:22 devstack sudo[99649]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:22 devstack sudo[99649]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a8233acc-a709-4695-b9ac-4a67a9e2cbe3 tempest-VolumesDeleteCascade-219134487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf" returned: 0 in 0.287s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:22 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a8233acc-a709-4695-b9ac-4a67a9e2cbe3 tempest-VolumesDeleteCascade-219134487 None] <== create_volume: return (883ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:30:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a8233acc-a709-4695-b9ac-4a67a9e2cbe3 tempest-VolumesDeleteCascade-219134487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.885s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:30:22 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a8233acc-a709-4695-b9ac-4a67a9e2cbe3 tempest-VolumesDeleteCascade-219134487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3f2e44a1-3788-4f55-bcde-6f8421aa2a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:22 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a8233acc-a709-4695-b9ac-4a67a9e2cbe3 tempest-VolumesDeleteCascade-219134487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9f3dd86-019f-4b3d-9666-feb29abce7dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:22 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-a8233acc-a709-4695-b9ac-4a67a9e2cbe3 tempest-VolumesDeleteCascade-219134487 None] Volume volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf (45b1a9de-8d7f-4de2-9794-0479b1b7d4bf): created successfully Nov 01 12:30:22 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a8233acc-a709-4695-b9ac-4a67a9e2cbe3 tempest-VolumesDeleteCascade-219134487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9f3dd86-019f-4b3d-9666-feb29abce7dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:22 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a8233acc-a709-4695-b9ac-4a67a9e2cbe3 tempest-VolumesDeleteCascade-219134487 None] Flow 'volume_create_manager' (23f42aef-6e4b-405d-a097-6e9c37f19427) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:30:22 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-a8233acc-a709-4695-b9ac-4a67a9e2cbe3 tempest-VolumesDeleteCascade-219134487 None] Created volume successfully. Nov 01 12:30:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a967f2e1-4b26-4cec-aefa-d8c7fbc0807f tempest-VolumesDeleteCascade-219134487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:30:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a967f2e1-4b26-4cec-aefa-d8c7fbc0807f tempest-VolumesDeleteCascade-219134487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:30:24 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-a967f2e1-4b26-4cec-aefa-d8c7fbc0807f tempest-VolumesDeleteCascade-219134487 None] Creating offline snapshot 94694ae2-3cac-442e-a56c-8c4548782a2a of volume 45b1a9de-8d7f-4de2-9794-0479b1b7d4bf {{(pid=86574) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:30:24 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2194ac2-efdc-4cb0-a822-2e4e87be812e]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:30:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a967f2e1-4b26-4cec-aefa-d8c7fbc0807f tempest-VolumesDeleteCascade-219134487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:24 devstack sudo[99652]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf Nov 01 12:30:24 devstack sudo[99652]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:24 devstack sudo[99652]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a967f2e1-4b26-4cec-aefa-d8c7fbc0807f tempest-VolumesDeleteCascade-219134487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf" returned: 0 in 0.437s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a967f2e1-4b26-4cec-aefa-d8c7fbc0807f tempest-VolumesDeleteCascade-219134487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf.94694ae2-3cac-442e-a56c-8c4548782a2a 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:24 devstack sudo[99657]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf.94694ae2-3cac-442e-a56c-8c4548782a2a 1G Nov 01 12:30:24 devstack sudo[99657]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:25 devstack sudo[99657]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a967f2e1-4b26-4cec-aefa-d8c7fbc0807f tempest-VolumesDeleteCascade-219134487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf.94694ae2-3cac-442e-a56c-8c4548782a2a 1G" returned: 0 in 0.571s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a967f2e1-4b26-4cec-aefa-d8c7fbc0807f tempest-VolumesDeleteCascade-219134487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf.94694ae2-3cac-442e-a56c-8c4548782a2a {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:25 devstack sudo[99667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf.94694ae2-3cac-442e-a56c-8c4548782a2a Nov 01 12:30:25 devstack sudo[99667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:25 devstack sudo[99667]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a967f2e1-4b26-4cec-aefa-d8c7fbc0807f tempest-VolumesDeleteCascade-219134487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf.94694ae2-3cac-442e-a56c-8c4548782a2a" returned: 0 in 0.333s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:25 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-a967f2e1-4b26-4cec-aefa-d8c7fbc0807f tempest-VolumesDeleteCascade-219134487 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf.94694ae2-3cac-442e-a56c-8c4548782a2a is being set with open permissions: ugo+rw Nov 01 12:30:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a967f2e1-4b26-4cec-aefa-d8c7fbc0807f tempest-VolumesDeleteCascade-219134487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf.94694ae2-3cac-442e-a56c-8c4548782a2a {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:25 devstack sudo[99673]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf.94694ae2-3cac-442e-a56c-8c4548782a2a Nov 01 12:30:25 devstack sudo[99673]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:25 devstack sudo[99673]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a967f2e1-4b26-4cec-aefa-d8c7fbc0807f tempest-VolumesDeleteCascade-219134487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf.94694ae2-3cac-442e-a56c-8c4548782a2a" returned: 0 in 0.265s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a967f2e1-4b26-4cec-aefa-d8c7fbc0807f tempest-VolumesDeleteCascade-219134487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:26 devstack sudo[99676]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf.info Nov 01 12:30:26 devstack sudo[99676]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:26 devstack sudo[99676]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a967f2e1-4b26-4cec-aefa-d8c7fbc0807f tempest-VolumesDeleteCascade-219134487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf.info" returned: 0 in 0.295s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:26 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-a967f2e1-4b26-4cec-aefa-d8c7fbc0807f tempest-VolumesDeleteCascade-219134487 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf.info is being set with open permissions: ugo+rw Nov 01 12:30:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a967f2e1-4b26-4cec-aefa-d8c7fbc0807f tempest-VolumesDeleteCascade-219134487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:26 devstack sudo[99679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf.info Nov 01 12:30:26 devstack sudo[99679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:26 devstack sudo[99679]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a967f2e1-4b26-4cec-aefa-d8c7fbc0807f tempest-VolumesDeleteCascade-219134487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf.info" returned: 0 in 0.299s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a967f2e1-4b26-4cec-aefa-d8c7fbc0807f tempest-VolumesDeleteCascade-219134487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.341s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:30:26 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-a967f2e1-4b26-4cec-aefa-d8c7fbc0807f tempest-VolumesDeleteCascade-219134487 None] Create snapshot completed successfully Nov 01 12:30:28 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:30:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] Flow 'volume_create_manager' (985047ef-3756-47b1-b7e8-72050a9a4b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:30:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c58b5f5-fed8-4c94-ad67-5bf3d851320b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c58b5f5-fed8-4c94-ad67-5bf3d851320b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:30:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1825205994',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3b8bac30-08c3-4f87-a330-4eefc8b5a127,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='9f5406dcef8e45c3b7423c5dc2309e2f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:30:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=94694ae2-3cac-442e-a56c-8c4548782a2a,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:30:28Z,use_quota=True,user_id='e11a5b09fb944833a7074fcacc24dab7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ad31856-e981-4d85-8a42-168adecc3b42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5ad31856-e981-4d85-8a42-168adecc3b42) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dfe22ee-591c-4c50-94e7-e587a51f3895) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9dfe22ee-591c-4c50-94e7-e587a51f3895) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '3b8bac30-08c3-4f87-a330-4eefc8b5a127', 'volume_name': 'volume-3b8bac30-08c3-4f87-a330-4eefc8b5a127', 'volume_size': 1, 'snapshot_id': '94694ae2-3cac-442e-a56c-8c4548782a2a'}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (617808cb-47de-406a-b2e3-99dea0573b49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (617808cb-47de-406a-b2e3-99dea0573b49) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (500217db-e3a2-4ae8-a83b-76fb90af7f6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:28 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] Volume 3b8bac30-08c3-4f87-a330-4eefc8b5a127: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-3b8bac30-08c3-4f87-a330-4eefc8b5a127', 'volume_size': 1, 'snapshot_id': '94694ae2-3cac-442e-a56c-8c4548782a2a'} Nov 01 12:30:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:30:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:30:28 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] Acquiring lock "cinder-quobyte-94694ae2-3cac-442e-a56c-8c4548782a2a-3b8bac30-08c3-4f87-a330-4eefc8b5a127" by "_create_volume_from_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:30:28 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] Lock "cinder-quobyte-94694ae2-3cac-442e-a56c-8c4548782a2a-3b8bac30-08c3-4f87-a330-4eefc8b5a127" acquired by "_create_volume_from_snapshot" :: waited 0.027s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:30:28 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] Creating volume 3b8bac30-08c3-4f87-a330-4eefc8b5a127 from snapshot 94694ae2-3cac-442e-a56c-8c4548782a2a {{(pid=86574) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 01 12:30:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:30:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:30:28 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:30:28 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:30:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:30:28 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:30:28 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] Acquiring lock "cinder-quobyte-3b8bac30-08c3-4f87-a330-4eefc8b5a127" by "_copy_volume_from_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:30:28 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] Lock "cinder-quobyte-3b8bac30-08c3-4f87-a330-4eefc8b5a127" acquired by "_copy_volume_from_snapshot" :: waited 0.023s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:30:28 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] snapshot: 94694ae2-3cac-442e-a56c-8c4548782a2a, volume: 3b8bac30-08c3-4f87-a330-4eefc8b5a127, {{(pid=86574) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 01 12:30:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:30:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:30:28 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:30:28 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:30:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:30:28 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[5a120f59-929d-457a-9fcc-0784ed681157]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:30:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf.94694ae2-3cac-442e-a56c-8c4548782a2a {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:29 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3bba5e5-a2e9-4fce-948c-9dbb33ee6d05 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:30:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f3bba5e5-a2e9-4fce-948c-9dbb33ee6d05 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Flow 'volume_create_manager' (12c9f503-2605-46a4-bb8b-fff5d135e12c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:30:29 devstack sudo[99705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf.94694ae2-3cac-442e-a56c-8c4548782a2a Nov 01 12:30:29 devstack sudo[99705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f3bba5e5-a2e9-4fce-948c-9dbb33ee6d05 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a836da6-cb43-4f8a-bf21-2bfcc2c3aaed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f3bba5e5-a2e9-4fce-948c-9dbb33ee6d05 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a836da6-cb43-4f8a-bf21-2bfcc2c3aaed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:30:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1246486937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c81d01b-a52f-4b7f-a181-88a1d3ddaa71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7915928adaa4b0b852b821609b4a6f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:30:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:30:29Z,use_quota=True,user_id='8c9cb786f4b3467fb2b6fdf14d6214ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f3bba5e5-a2e9-4fce-948c-9dbb33ee6d05 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5744aac9-2b81-494d-b743-a51fb4e5a68d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f3bba5e5-a2e9-4fce-948c-9dbb33ee6d05 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5744aac9-2b81-494d-b743-a51fb4e5a68d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f3bba5e5-a2e9-4fce-948c-9dbb33ee6d05 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46f18685-fc2d-4e1a-bb4d-1e6dabf97594) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f3bba5e5-a2e9-4fce-948c-9dbb33ee6d05 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (46f18685-fc2d-4e1a-bb4d-1e6dabf97594) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c81d01b-a52f-4b7f-a181-88a1d3ddaa71', 'volume_name': 'volume-8c81d01b-a52f-4b7f-a181-88a1d3ddaa71', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f3bba5e5-a2e9-4fce-948c-9dbb33ee6d05 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f85b9012-ece8-4375-b643-ec9c6688f0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f3bba5e5-a2e9-4fce-948c-9dbb33ee6d05 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f85b9012-ece8-4375-b643-ec9c6688f0cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f3bba5e5-a2e9-4fce-948c-9dbb33ee6d05 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24dd605f-2a09-40e4-9f36-16cfdd30762d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:29 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-f3bba5e5-a2e9-4fce-948c-9dbb33ee6d05 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Volume 8c81d01b-a52f-4b7f-a181-88a1d3ddaa71: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c81d01b-a52f-4b7f-a181-88a1d3ddaa71', 'volume_size': 1} Nov 01 12:30:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f3bba5e5-a2e9-4fce-948c-9dbb33ee6d05 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:30:29 devstack sudo[99705]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf.94694ae2-3cac-442e-a56c-8c4548782a2a" returned: 0 in 0.765s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:29 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:30:29 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[8b7a7cbd-3572-4adf-ad7d-195c995f6253]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:30:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:29 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-8030a88f-cd0f-4ca3-b0f4-98d3928b91f4 req-3b65efd9-89f9-49a8-b21a-c0482cd31151 tempest-TestShelveInstance-1384273023 None] Terminate volume connection completed successfully. Nov 01 12:30:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-8030a88f-cd0f-4ca3-b0f4-98d3928b91f4 req-3b65efd9-89f9-49a8-b21a-c0482cd31151 tempest-TestShelveInstance-1384273023 None] Deleting attachment bdd17a9b-541d-46db-b15f-b445bf3f38d8. {{(pid=86574) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 12:30:29 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ae1a814-1e94-4aa1-b736-33d86ebfd028 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:30:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-7ae1a814-1e94-4aa1-b736-33d86ebfd028 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Flow 'volume_create_manager' (748dd546-3080-4393-b378-ebdcca0d15bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:30:29 devstack sudo[99712]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf Nov 01 12:30:29 devstack sudo[99712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-7ae1a814-1e94-4aa1-b736-33d86ebfd028 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aec6ff38-b6af-4066-aaff-df2f0802267b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-7ae1a814-1e94-4aa1-b736-33d86ebfd028 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (aec6ff38-b6af-4066-aaff-df2f0802267b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:30:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-527271115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3459e0e-5fcc-4dd3-938b-ae96e2c8d426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7915928adaa4b0b852b821609b4a6f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:30:30Z,use_quota=True,user_id='8c9cb786f4b3467fb2b6fdf14d6214ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-7ae1a814-1e94-4aa1-b736-33d86ebfd028 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8af265e5-277f-40c2-bc08-0dd8fd22db8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-7ae1a814-1e94-4aa1-b736-33d86ebfd028 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8af265e5-277f-40c2-bc08-0dd8fd22db8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-7ae1a814-1e94-4aa1-b736-33d86ebfd028 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5abae73-d83a-480b-bda8-b157b2e74c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-7ae1a814-1e94-4aa1-b736-33d86ebfd028 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5abae73-d83a-480b-bda8-b157b2e74c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f3459e0e-5fcc-4dd3-938b-ae96e2c8d426', 'volume_name': 'volume-f3459e0e-5fcc-4dd3-938b-ae96e2c8d426', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-7ae1a814-1e94-4aa1-b736-33d86ebfd028 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cae999b-cfa1-4e2b-8d7b-facf42fd9482) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:30 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-7ae1a814-1e94-4aa1-b736-33d86ebfd028 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5cae999b-cfa1-4e2b-8d7b-facf42fd9482) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:30 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-7ae1a814-1e94-4aa1-b736-33d86ebfd028 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a0a43a7-ca42-4307-becc-ebf8414dfab3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:30 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-7ae1a814-1e94-4aa1-b736-33d86ebfd028 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Volume f3459e0e-5fcc-4dd3-938b-ae96e2c8d426: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f3459e0e-5fcc-4dd3-938b-ae96e2c8d426', 'volume_size': 1} Nov 01 12:30:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-7ae1a814-1e94-4aa1-b736-33d86ebfd028 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:30:30 devstack cinder-volume[86574]: DEBUG cinder.coordination [req-8030a88f-cd0f-4ca3-b0f4-98d3928b91f4 req-170b5e8b-dc25-4ba4-ad99-bcc53c31cedb tempest-TestShelveInstance-1384273023 None] Acquiring lock "cinder-2c5cde7f-8cb2-4c83-b07d-aecb28344fc8-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:30:30 devstack cinder-volume[86574]: DEBUG cinder.coordination [req-8030a88f-cd0f-4ca3-b0f4-98d3928b91f4 req-170b5e8b-dc25-4ba4-ad99-bcc53c31cedb tempest-TestShelveInstance-1384273023 None] Lock "cinder-2c5cde7f-8cb2-4c83-b07d-aecb28344fc8-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:30:30 devstack cinder-volume[86574]: DEBUG cinder.coordination [req-8030a88f-cd0f-4ca3-b0f4-98d3928b91f4 req-170b5e8b-dc25-4ba4-ad99-bcc53c31cedb tempest-TestShelveInstance-1384273023 None] Acquiring lock "cinder-quobyte-2c5cde7f-8cb2-4c83-b07d-aecb28344fc8" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:30:30 devstack cinder-volume[86574]: DEBUG cinder.coordination [req-8030a88f-cd0f-4ca3-b0f4-98d3928b91f4 req-170b5e8b-dc25-4ba4-ad99-bcc53c31cedb tempest-TestShelveInstance-1384273023 None] Lock "cinder-quobyte-2c5cde7f-8cb2-4c83-b07d-aecb28344fc8" acquired by "delete_volume" :: waited 0.031s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:30:30 devstack sudo[99712]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf" returned: 0 in 0.664s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:30 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf {{(pid=86574) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 01 12:30:30 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] Creating direct copy from snapshot {{(pid=86574) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 01 12:30:30 devstack cinder-volume[86574]: DEBUG cinder.utils [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] Path /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3b8bac30-08c3-4f87-a330-4eefc8b5a127 not found in is_blk_device check {{(pid=86574) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 01 12:30:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3b8bac30-08c3-4f87-a330-4eefc8b5a127 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:30 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d9b8070-2c6f-4a64-91b2-ac7daa2dcda2]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:30:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [req-8030a88f-cd0f-4ca3-b0f4-98d3928b91f4 req-170b5e8b-dc25-4ba4-ad99-bcc53c31cedb tempest-TestShelveInstance-1384273023 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-2c5cde7f-8cb2-4c83-b07d-aecb28344fc8 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:30 devstack sudo[99717]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3b8bac30-08c3-4f87-a330-4eefc8b5a127 Nov 01 12:30:30 devstack sudo[99717]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:30 devstack sudo[99718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-2c5cde7f-8cb2-4c83-b07d-aecb28344fc8 Nov 01 12:30:30 devstack sudo[99718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:31 devstack sudo[99718]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [req-8030a88f-cd0f-4ca3-b0f4-98d3928b91f4 req-170b5e8b-dc25-4ba4-ad99-bcc53c31cedb tempest-TestShelveInstance-1384273023 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-2c5cde7f-8cb2-4c83-b07d-aecb28344fc8" returned: 0 in 0.814s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [req-8030a88f-cd0f-4ca3-b0f4-98d3928b91f4 req-170b5e8b-dc25-4ba4-ad99-bcc53c31cedb tempest-TestShelveInstance-1384273023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-2c5cde7f-8cb2-4c83-b07d-aecb28344fc8 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:31 devstack sudo[99731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-2c5cde7f-8cb2-4c83-b07d-aecb28344fc8 Nov 01 12:30:31 devstack sudo[99731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:31 devstack sudo[99731]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [req-8030a88f-cd0f-4ca3-b0f4-98d3928b91f4 req-170b5e8b-dc25-4ba4-ad99-bcc53c31cedb tempest-TestShelveInstance-1384273023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-2c5cde7f-8cb2-4c83-b07d-aecb28344fc8" returned: 0 in 0.650s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:31 devstack cinder-volume[86574]: DEBUG cinder.coordination [req-8030a88f-cd0f-4ca3-b0f4-98d3928b91f4 req-170b5e8b-dc25-4ba4-ad99-bcc53c31cedb tempest-TestShelveInstance-1384273023 None] Lock "cinder-quobyte-2c5cde7f-8cb2-4c83-b07d-aecb28344fc8" released by "delete_volume" :: held 1.559s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:30:32 devstack cinder-volume[86574]: DEBUG cinder.quota [req-8030a88f-cd0f-4ca3-b0f4-98d3928b91f4 req-170b5e8b-dc25-4ba4-ad99-bcc53c31cedb tempest-TestShelveInstance-1384273023 None] Created reservations ['143aceb9-42ff-4cae-8d91-1053662115e4', '5b30a0e1-b24d-4dd3-a890-1d4fdefc067d', 'bacb2cee-1917-4862-a98d-abf1c6f856d7', '45f429fa-c33b-4835-8723-99521de3ea49'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:30:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-8030a88f-cd0f-4ca3-b0f4-98d3928b91f4 req-170b5e8b-dc25-4ba4-ad99-bcc53c31cedb tempest-TestShelveInstance-1384273023 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:30:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-8030a88f-cd0f-4ca3-b0f4-98d3928b91f4 req-170b5e8b-dc25-4ba4-ad99-bcc53c31cedb tempest-TestShelveInstance-1384273023 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:30:32 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [req-8030a88f-cd0f-4ca3-b0f4-98d3928b91f4 req-170b5e8b-dc25-4ba4-ad99-bcc53c31cedb tempest-TestShelveInstance-1384273023 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:30:32 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [req-8030a88f-cd0f-4ca3-b0f4-98d3928b91f4 req-170b5e8b-dc25-4ba4-ad99-bcc53c31cedb tempest-TestShelveInstance-1384273023 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:30:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-8030a88f-cd0f-4ca3-b0f4-98d3928b91f4 req-170b5e8b-dc25-4ba4-ad99-bcc53c31cedb tempest-TestShelveInstance-1384273023 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:30:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [req-8030a88f-cd0f-4ca3-b0f4-98d3928b91f4 req-170b5e8b-dc25-4ba4-ad99-bcc53c31cedb tempest-TestShelveInstance-1384273023 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:32 devstack sudo[99739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:30:32 devstack sudo[99739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:33 devstack sudo[99739]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [req-8030a88f-cd0f-4ca3-b0f4-98d3928b91f4 req-170b5e8b-dc25-4ba4-ad99-bcc53c31cedb tempest-TestShelveInstance-1384273023 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.995s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:33 devstack cinder-volume[86574]: DEBUG cinder.manager [req-8030a88f-cd0f-4ca3-b0f4-98d3928b91f4 req-170b5e8b-dc25-4ba4-ad99-bcc53c31cedb tempest-TestShelveInstance-1384273023 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:30:33 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-8030a88f-cd0f-4ca3-b0f4-98d3928b91f4 req-170b5e8b-dc25-4ba4-ad99-bcc53c31cedb tempest-TestShelveInstance-1384273023 None] Deleted volume successfully. Nov 01 12:30:33 devstack cinder-volume[86574]: DEBUG cinder.coordination [req-8030a88f-cd0f-4ca3-b0f4-98d3928b91f4 req-170b5e8b-dc25-4ba4-ad99-bcc53c31cedb tempest-TestShelveInstance-1384273023 None] Lock "cinder-2c5cde7f-8cb2-4c83-b07d-aecb28344fc8-delete_volume" released by "delete_volume" :: held 3.097s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:30:38 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccfaa3b3-ac66-4591-b698-dfb450e3e1a4 tempest-VolumesTransfersTest-2040814939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:30:39 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ccfaa3b3-ac66-4591-b698-dfb450e3e1a4 tempest-VolumesTransfersTest-2040814939 None] Flow 'volume_create_manager' (ce1366e1-cf9d-4c2c-a01e-119457030a48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:30:39 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ccfaa3b3-ac66-4591-b698-dfb450e3e1a4 tempest-VolumesTransfersTest-2040814939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77b3a50e-6462-4370-a9be-88a9d1a86c76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:39 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ccfaa3b3-ac66-4591-b698-dfb450e3e1a4 tempest-VolumesTransfersTest-2040814939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77b3a50e-6462-4370-a9be-88a9d1a86c76) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-434769471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d4fddee-0814-493d-b1ac-42c36f48ed25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b674aaf8ef9e4d179112d92a2dac5e57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:30:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:30:39Z,use_quota=True,user_id='696e73540ae1401ba039841739473fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:39 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ccfaa3b3-ac66-4591-b698-dfb450e3e1a4 tempest-VolumesTransfersTest-2040814939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db16b4ed-2bc6-4af4-bf09-4039ae97b43a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:39 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ccfaa3b3-ac66-4591-b698-dfb450e3e1a4 tempest-VolumesTransfersTest-2040814939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db16b4ed-2bc6-4af4-bf09-4039ae97b43a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:39 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ccfaa3b3-ac66-4591-b698-dfb450e3e1a4 tempest-VolumesTransfersTest-2040814939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c481b310-45ee-487a-a10a-89355d812cd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:39 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ccfaa3b3-ac66-4591-b698-dfb450e3e1a4 tempest-VolumesTransfersTest-2040814939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c481b310-45ee-487a-a10a-89355d812cd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7d4fddee-0814-493d-b1ac-42c36f48ed25', 'volume_name': 'volume-7d4fddee-0814-493d-b1ac-42c36f48ed25', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:39 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ccfaa3b3-ac66-4591-b698-dfb450e3e1a4 tempest-VolumesTransfersTest-2040814939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caae0c81-27b8-423c-9ce8-b4a9e3cd4d66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:39 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ccfaa3b3-ac66-4591-b698-dfb450e3e1a4 tempest-VolumesTransfersTest-2040814939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (caae0c81-27b8-423c-9ce8-b4a9e3cd4d66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:39 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ccfaa3b3-ac66-4591-b698-dfb450e3e1a4 tempest-VolumesTransfersTest-2040814939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d078549-895a-4965-ab93-9e2cf28899d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:39 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-ccfaa3b3-ac66-4591-b698-dfb450e3e1a4 tempest-VolumesTransfersTest-2040814939 None] Volume 7d4fddee-0814-493d-b1ac-42c36f48ed25: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7d4fddee-0814-493d-b1ac-42c36f48ed25', 'volume_size': 1} Nov 01 12:30:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ccfaa3b3-ac66-4591-b698-dfb450e3e1a4 tempest-VolumesTransfersTest-2040814939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:30:39 devstack cinder-volume[86574]: DEBUG oslo_service.periodic_task [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86574) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:30:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:30:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:30:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:30:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:30:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:30:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:39 devstack sudo[99784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:30:39 devstack sudo[99784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:39 devstack sudo[99717]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3b8bac30-08c3-4f87-a330-4eefc8b5a127" returned: 0 in 9.564s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:39 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] Image conversion details: src /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf, size 1024.00 MB, duration 9.57 sec, destination /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3b8bac30-08c3-4f87-a330-4eefc8b5a127 {{(pid=86574) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 12:30:39 devstack cinder-volume[86574]: INFO cinder.image.image_utils [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] Converted 1024.00 MB image at 107.05 MB/s Nov 01 12:30:39 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3b8bac30-08c3-4f87-a330-4eefc8b5a127 is being set with open permissions: ugo+rw Nov 01 12:30:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3b8bac30-08c3-4f87-a330-4eefc8b5a127 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:39 devstack sudo[99786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3b8bac30-08c3-4f87-a330-4eefc8b5a127 Nov 01 12:30:39 devstack sudo[99786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:40 devstack sudo[99786]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3b8bac30-08c3-4f87-a330-4eefc8b5a127" returned: 0 in 0.421s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:40 devstack sudo[99784]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:40 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] Lock "cinder-quobyte-3b8bac30-08c3-4f87-a330-4eefc8b5a127" released by "_copy_volume_from_snapshot" :: held 11.588s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:30:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.507s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:40 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:30:40 devstack cinder-volume[86574]: DEBUG oslo_service.periodic_task [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running periodic task VolumeManager._thread_info {{(pid=86574) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:30:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] thread count: 28 {{(pid=86574) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 12:30:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] thread info: [<_MainThread(MainThread, started 131331184930944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86574) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 12:30:40 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] Lock "cinder-quobyte-94694ae2-3cac-442e-a56c-8c4548782a2a-3b8bac30-08c3-4f87-a330-4eefc8b5a127" released by "_create_volume_from_snapshot" :: held 11.676s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:30:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.705s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:30:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f3bba5e5-a2e9-4fce-948c-9dbb33ee6d05 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.248s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:30:40 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f3bba5e5-a2e9-4fce-948c-9dbb33ee6d05 tempest-TestServerVolumeAttachmentScenario-1426975797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:30:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1246486937',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c81d01b-a52f-4b7f-a181-88a1d3ddaa71,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7915928adaa4b0b852b821609b4a6f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:30:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:30:29Z,use_quota=True,user_id='8c9cb786f4b3467fb2b6fdf14d6214ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:30:40 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-f3bba5e5-a2e9-4fce-948c-9dbb33ee6d05 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Creating volume 8c81d01b-a52f-4b7f-a181-88a1d3ddaa71 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:30:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f3bba5e5-a2e9-4fce-948c-9dbb33ee6d05 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:30:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f3bba5e5-a2e9-4fce-948c-9dbb33ee6d05 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:30:40 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f3bba5e5-a2e9-4fce-948c-9dbb33ee6d05 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:30:40 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f3bba5e5-a2e9-4fce-948c-9dbb33ee6d05 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:30:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f3bba5e5-a2e9-4fce-948c-9dbb33ee6d05 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:30:40 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f3bba5e5-a2e9-4fce-948c-9dbb33ee6d05 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:30:40 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-f3bba5e5-a2e9-4fce-948c-9dbb33ee6d05 tempest-TestServerVolumeAttachmentScenario-1426975797 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:30:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f3bba5e5-a2e9-4fce-948c-9dbb33ee6d05 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c81d01b-a52f-4b7f-a181-88a1d3ddaa71 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:40 devstack sudo[99796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c81d01b-a52f-4b7f-a181-88a1d3ddaa71 1073741824 Nov 01 12:30:40 devstack sudo[99796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (500217db-e3a2-4ae8-a83b-76fb90af7f6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3b8bac30-08c3-4f87-a330-4eefc8b5a127', 'volume_size': 1, 'snapshot_id': '94694ae2-3cac-442e-a56c-8c4548782a2a'}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee0dcb50-6af1-4faf-8cba-080a18ce3885) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:40 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] Volume volume-3b8bac30-08c3-4f87-a330-4eefc8b5a127 (3b8bac30-08c3-4f87-a330-4eefc8b5a127): created successfully Nov 01 12:30:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ee0dcb50-6af1-4faf-8cba-080a18ce3885) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] Flow 'volume_create_manager' (985047ef-3756-47b1-b7e8-72050a9a4b1b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:30:40 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-231352c8-aaa7-4298-9a9b-5893f12107a7 tempest-VolumesDeleteCascade-219134487 None] Created volume successfully. Nov 01 12:30:41 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-87c5357a-bdfd-4220-9b3f-9ac5d1338475 tempest-VolumesDeleteCascade-219134487 None] Acquiring lock "cinder-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:30:41 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-87c5357a-bdfd-4220-9b3f-9ac5d1338475 tempest-VolumesDeleteCascade-219134487 None] Lock "cinder-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:30:41 devstack sudo[99796]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f3bba5e5-a2e9-4fce-948c-9dbb33ee6d05 tempest-TestServerVolumeAttachmentScenario-1426975797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c81d01b-a52f-4b7f-a181-88a1d3ddaa71 1073741824" returned: 0 in 0.791s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-87c5357a-bdfd-4220-9b3f-9ac5d1338475 tempest-VolumesDeleteCascade-219134487 None] Performing cascade delete. {{(pid=86574) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}} Nov 01 12:30:41 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-87c5357a-bdfd-4220-9b3f-9ac5d1338475 tempest-VolumesDeleteCascade-219134487 None] Acquiring lock "cinder-94694ae2-3cac-442e-a56c-8c4548782a2a-delete_snapshot" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:30:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f3bba5e5-a2e9-4fce-948c-9dbb33ee6d05 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c81d01b-a52f-4b7f-a181-88a1d3ddaa71 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:41 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-87c5357a-bdfd-4220-9b3f-9ac5d1338475 tempest-VolumesDeleteCascade-219134487 None] Lock "cinder-94694ae2-3cac-442e-a56c-8c4548782a2a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.063s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:30:41 devstack sudo[99812]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c81d01b-a52f-4b7f-a181-88a1d3ddaa71 Nov 01 12:30:41 devstack sudo[99812]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:41 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-87c5357a-bdfd-4220-9b3f-9ac5d1338475 tempest-VolumesDeleteCascade-219134487 None] Acquiring lock "cinder-quobyte-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:30:41 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-87c5357a-bdfd-4220-9b3f-9ac5d1338475 tempest-VolumesDeleteCascade-219134487 None] Lock "cinder-quobyte-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:30:41 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-87c5357a-bdfd-4220-9b3f-9ac5d1338475 tempest-VolumesDeleteCascade-219134487 None] Acquiring lock "cinder-quobyte-94694ae2-3cac-442e-a56c-8c4548782a2a" by "_delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:30:41 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-87c5357a-bdfd-4220-9b3f-9ac5d1338475 tempest-VolumesDeleteCascade-219134487 None] Lock "cinder-quobyte-94694ae2-3cac-442e-a56c-8c4548782a2a" acquired by "_delete_snapshot" :: waited 0.038s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:30:41 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-87c5357a-bdfd-4220-9b3f-9ac5d1338475 tempest-VolumesDeleteCascade-219134487 None] Deleting offline snapshot 94694ae2-3cac-442e-a56c-8c4548782a2a of volume 45b1a9de-8d7f-4de2-9794-0479b1b7d4bf {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:30:41 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-87c5357a-bdfd-4220-9b3f-9ac5d1338475 tempest-VolumesDeleteCascade-219134487 None] snapshot_file for this snap is: volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf.94694ae2-3cac-442e-a56c-8c4548782a2a {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:30:41 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d82b0ae-5ebb-4983-857a-e85533eb0225]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:30:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-87c5357a-bdfd-4220-9b3f-9ac5d1338475 tempest-VolumesDeleteCascade-219134487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf.94694ae2-3cac-442e-a56c-8c4548782a2a {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:41 devstack sudo[99817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf.94694ae2-3cac-442e-a56c-8c4548782a2a Nov 01 12:30:41 devstack sudo[99817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:41 devstack sudo[99812]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f3bba5e5-a2e9-4fce-948c-9dbb33ee6d05 tempest-TestServerVolumeAttachmentScenario-1426975797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c81d01b-a52f-4b7f-a181-88a1d3ddaa71" returned: 0 in 0.451s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:41 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f3bba5e5-a2e9-4fce-948c-9dbb33ee6d05 tempest-TestServerVolumeAttachmentScenario-1426975797 None] <== create_volume: return (1334ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:30:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f3bba5e5-a2e9-4fce-948c-9dbb33ee6d05 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.336s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:30:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-7ae1a814-1e94-4aa1-b736-33d86ebfd028 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 11.781s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:30:41 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-7ae1a814-1e94-4aa1-b736-33d86ebfd028 tempest-TestServerVolumeAttachmentScenario-1426975797 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:30:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-527271115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f3459e0e-5fcc-4dd3-938b-ae96e2c8d426,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a7915928adaa4b0b852b821609b4a6f0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:30:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:30:30Z,use_quota=True,user_id='8c9cb786f4b3467fb2b6fdf14d6214ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:30:41 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-7ae1a814-1e94-4aa1-b736-33d86ebfd028 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Creating volume f3459e0e-5fcc-4dd3-938b-ae96e2c8d426 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:30:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-7ae1a814-1e94-4aa1-b736-33d86ebfd028 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:30:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-7ae1a814-1e94-4aa1-b736-33d86ebfd028 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:30:41 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-7ae1a814-1e94-4aa1-b736-33d86ebfd028 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:30:41 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-7ae1a814-1e94-4aa1-b736-33d86ebfd028 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:30:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-7ae1a814-1e94-4aa1-b736-33d86ebfd028 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:30:41 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-7ae1a814-1e94-4aa1-b736-33d86ebfd028 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:30:41 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-7ae1a814-1e94-4aa1-b736-33d86ebfd028 tempest-TestServerVolumeAttachmentScenario-1426975797 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:30:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7ae1a814-1e94-4aa1-b736-33d86ebfd028 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f3459e0e-5fcc-4dd3-938b-ae96e2c8d426 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:41 devstack sudo[99823]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f3459e0e-5fcc-4dd3-938b-ae96e2c8d426 1073741824 Nov 01 12:30:41 devstack sudo[99823]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f3bba5e5-a2e9-4fce-948c-9dbb33ee6d05 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (24dd605f-2a09-40e4-9f36-16cfdd30762d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c81d01b-a52f-4b7f-a181-88a1d3ddaa71', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f3bba5e5-a2e9-4fce-948c-9dbb33ee6d05 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a90ef04c-10fa-4d05-bbf5-ff09e8dee4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:41 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-f3bba5e5-a2e9-4fce-948c-9dbb33ee6d05 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Volume volume-8c81d01b-a52f-4b7f-a181-88a1d3ddaa71 (8c81d01b-a52f-4b7f-a181-88a1d3ddaa71): created successfully Nov 01 12:30:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f3bba5e5-a2e9-4fce-948c-9dbb33ee6d05 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a90ef04c-10fa-4d05-bbf5-ff09e8dee4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f3bba5e5-a2e9-4fce-948c-9dbb33ee6d05 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Flow 'volume_create_manager' (12c9f503-2605-46a4-bb8b-fff5d135e12c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:30:41 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-f3bba5e5-a2e9-4fce-948c-9dbb33ee6d05 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Created volume successfully. Nov 01 12:30:42 devstack sudo[99817]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-87c5357a-bdfd-4220-9b3f-9ac5d1338475 tempest-VolumesDeleteCascade-219134487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf.94694ae2-3cac-442e-a56c-8c4548782a2a" returned: 0 in 0.548s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:42 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-87c5357a-bdfd-4220-9b3f-9ac5d1338475 tempest-VolumesDeleteCascade-219134487 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:30:42 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a92f8fb-0aa2-43d8-b42b-1b7c8fb27de3]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:30:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-87c5357a-bdfd-4220-9b3f-9ac5d1338475 tempest-VolumesDeleteCascade-219134487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:42 devstack sudo[99831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf Nov 01 12:30:42 devstack sudo[99831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:42 devstack sudo[99823]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7ae1a814-1e94-4aa1-b736-33d86ebfd028 tempest-TestServerVolumeAttachmentScenario-1426975797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f3459e0e-5fcc-4dd3-938b-ae96e2c8d426 1073741824" returned: 0 in 0.624s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:42 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:SELECT=110,cinder:INSERT=40,cinder:UPDATE=125,cinder:DELETE=12 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:30:42 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:INSERT=32,cinder:UPDATE=134,cinder:SELECT=105,cinder:DELETE=10 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:30:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7ae1a814-1e94-4aa1-b736-33d86ebfd028 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f3459e0e-5fcc-4dd3-938b-ae96e2c8d426 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:42 devstack sudo[99837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f3459e0e-5fcc-4dd3-938b-ae96e2c8d426 Nov 01 12:30:42 devstack sudo[99837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:42 devstack sudo[99837]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7ae1a814-1e94-4aa1-b736-33d86ebfd028 tempest-TestServerVolumeAttachmentScenario-1426975797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f3459e0e-5fcc-4dd3-938b-ae96e2c8d426" returned: 0 in 0.332s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:42 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-7ae1a814-1e94-4aa1-b736-33d86ebfd028 tempest-TestServerVolumeAttachmentScenario-1426975797 None] <== create_volume: return (1039ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:30:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-7ae1a814-1e94-4aa1-b736-33d86ebfd028 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.043s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:30:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ccfaa3b3-ac66-4591-b698-dfb450e3e1a4 tempest-VolumesTransfersTest-2040814939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.616s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:30:42 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ccfaa3b3-ac66-4591-b698-dfb450e3e1a4 tempest-VolumesTransfersTest-2040814939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:30:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-434769471',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7d4fddee-0814-493d-b1ac-42c36f48ed25,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b674aaf8ef9e4d179112d92a2dac5e57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:30:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:30:39Z,use_quota=True,user_id='696e73540ae1401ba039841739473fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:30:42 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-ccfaa3b3-ac66-4591-b698-dfb450e3e1a4 tempest-VolumesTransfersTest-2040814939 None] Creating volume 7d4fddee-0814-493d-b1ac-42c36f48ed25 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:30:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ccfaa3b3-ac66-4591-b698-dfb450e3e1a4 tempest-VolumesTransfersTest-2040814939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:30:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ccfaa3b3-ac66-4591-b698-dfb450e3e1a4 tempest-VolumesTransfersTest-2040814939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:30:42 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ccfaa3b3-ac66-4591-b698-dfb450e3e1a4 tempest-VolumesTransfersTest-2040814939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:30:42 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ccfaa3b3-ac66-4591-b698-dfb450e3e1a4 tempest-VolumesTransfersTest-2040814939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:30:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ccfaa3b3-ac66-4591-b698-dfb450e3e1a4 tempest-VolumesTransfersTest-2040814939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:30:42 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ccfaa3b3-ac66-4591-b698-dfb450e3e1a4 tempest-VolumesTransfersTest-2040814939 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:30:42 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-ccfaa3b3-ac66-4591-b698-dfb450e3e1a4 tempest-VolumesTransfersTest-2040814939 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:30:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ccfaa3b3-ac66-4591-b698-dfb450e3e1a4 tempest-VolumesTransfersTest-2040814939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7d4fddee-0814-493d-b1ac-42c36f48ed25 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:42 devstack sudo[99831]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-87c5357a-bdfd-4220-9b3f-9ac5d1338475 tempest-VolumesDeleteCascade-219134487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf" returned: 0 in 0.693s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-87c5357a-bdfd-4220-9b3f-9ac5d1338475 tempest-VolumesDeleteCascade-219134487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf.94694ae2-3cac-442e-a56c-8c4548782a2a {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:42 devstack sudo[99843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7d4fddee-0814-493d-b1ac-42c36f48ed25 1073741824 Nov 01 12:30:42 devstack sudo[99843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:42 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-7ae1a814-1e94-4aa1-b736-33d86ebfd028 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3a0a43a7-ca42-4307-becc-ebf8414dfab3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f3459e0e-5fcc-4dd3-938b-ae96e2c8d426', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:42 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-7ae1a814-1e94-4aa1-b736-33d86ebfd028 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20f79af8-72c2-4d4e-a1ed-d8a372759bbf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:42 devstack sudo[99845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf.94694ae2-3cac-442e-a56c-8c4548782a2a Nov 01 12:30:42 devstack sudo[99845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:42 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-7ae1a814-1e94-4aa1-b736-33d86ebfd028 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Volume volume-f3459e0e-5fcc-4dd3-938b-ae96e2c8d426 (f3459e0e-5fcc-4dd3-938b-ae96e2c8d426): created successfully Nov 01 12:30:42 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-7ae1a814-1e94-4aa1-b736-33d86ebfd028 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20f79af8-72c2-4d4e-a1ed-d8a372759bbf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:42 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-7ae1a814-1e94-4aa1-b736-33d86ebfd028 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Flow 'volume_create_manager' (748dd546-3080-4393-b378-ebdcca0d15bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:30:42 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-7ae1a814-1e94-4aa1-b736-33d86ebfd028 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Created volume successfully. Nov 01 12:30:43 devstack sudo[99845]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-87c5357a-bdfd-4220-9b3f-9ac5d1338475 tempest-VolumesDeleteCascade-219134487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf.94694ae2-3cac-442e-a56c-8c4548782a2a" returned: 0 in 0.487s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-87c5357a-bdfd-4220-9b3f-9ac5d1338475 tempest-VolumesDeleteCascade-219134487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf.94694ae2-3cac-442e-a56c-8c4548782a2a {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:43 devstack sudo[99856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf.94694ae2-3cac-442e-a56c-8c4548782a2a Nov 01 12:30:43 devstack sudo[99856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:43 devstack sudo[99843]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ccfaa3b3-ac66-4591-b698-dfb450e3e1a4 tempest-VolumesTransfersTest-2040814939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7d4fddee-0814-493d-b1ac-42c36f48ed25 1073741824" returned: 0 in 0.605s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ccfaa3b3-ac66-4591-b698-dfb450e3e1a4 tempest-VolumesTransfersTest-2040814939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7d4fddee-0814-493d-b1ac-42c36f48ed25 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:43 devstack sudo[99858]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7d4fddee-0814-493d-b1ac-42c36f48ed25 Nov 01 12:30:43 devstack sudo[99858]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:43 devstack sudo[99856]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-87c5357a-bdfd-4220-9b3f-9ac5d1338475 tempest-VolumesDeleteCascade-219134487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf.94694ae2-3cac-442e-a56c-8c4548782a2a" returned: 0 in 0.322s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:43 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-87c5357a-bdfd-4220-9b3f-9ac5d1338475 tempest-VolumesDeleteCascade-219134487 None] Lock "cinder-quobyte-94694ae2-3cac-442e-a56c-8c4548782a2a" released by "_delete_snapshot" :: held 2.249s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:30:43 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-87c5357a-bdfd-4220-9b3f-9ac5d1338475 tempest-VolumesDeleteCascade-219134487 None] Lock "cinder-quobyte-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf" released by "delete_snapshot" :: held 2.298s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:30:43 devstack sudo[99858]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ccfaa3b3-ac66-4591-b698-dfb450e3e1a4 tempest-VolumesTransfersTest-2040814939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7d4fddee-0814-493d-b1ac-42c36f48ed25" returned: 0 in 0.280s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:43 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ccfaa3b3-ac66-4591-b698-dfb450e3e1a4 tempest-VolumesTransfersTest-2040814939 None] <== create_volume: return (957ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:30:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ccfaa3b3-ac66-4591-b698-dfb450e3e1a4 tempest-VolumesTransfersTest-2040814939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.960s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:30:43 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ccfaa3b3-ac66-4591-b698-dfb450e3e1a4 tempest-VolumesTransfersTest-2040814939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d078549-895a-4965-ab93-9e2cf28899d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7d4fddee-0814-493d-b1ac-42c36f48ed25', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:43 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ccfaa3b3-ac66-4591-b698-dfb450e3e1a4 tempest-VolumesTransfersTest-2040814939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b085497e-256e-49ed-ae46-f1df8753d0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:43 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-87c5357a-bdfd-4220-9b3f-9ac5d1338475 tempest-VolumesDeleteCascade-219134487 None] Created reservations ['600dd7f6-99f8-4af6-9f76-a6b94f7c358d', 'da6837c3-7c0e-46da-b79c-e87b0ef9a366', 'b6da89bd-d152-4c91-a283-a56a3aa801e8', 'f361cc5e-76ed-47a9-a8bb-4f18441af20d'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:30:43 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-ccfaa3b3-ac66-4591-b698-dfb450e3e1a4 tempest-VolumesTransfersTest-2040814939 None] Volume volume-7d4fddee-0814-493d-b1ac-42c36f48ed25 (7d4fddee-0814-493d-b1ac-42c36f48ed25): created successfully Nov 01 12:30:43 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ccfaa3b3-ac66-4591-b698-dfb450e3e1a4 tempest-VolumesTransfersTest-2040814939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b085497e-256e-49ed-ae46-f1df8753d0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:43 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ccfaa3b3-ac66-4591-b698-dfb450e3e1a4 tempest-VolumesTransfersTest-2040814939 None] Flow 'volume_create_manager' (ce1366e1-cf9d-4c2c-a01e-119457030a48) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:30:43 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-ccfaa3b3-ac66-4591-b698-dfb450e3e1a4 tempest-VolumesTransfersTest-2040814939 None] Created volume successfully. Nov 01 12:30:43 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-87c5357a-bdfd-4220-9b3f-9ac5d1338475 tempest-VolumesDeleteCascade-219134487 None] Delete snapshot completed successfully. Nov 01 12:30:43 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-87c5357a-bdfd-4220-9b3f-9ac5d1338475 tempest-VolumesDeleteCascade-219134487 None] Lock "cinder-94694ae2-3cac-442e-a56c-8c4548782a2a-delete_snapshot" released by "delete_snapshot" :: held 2.564s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:30:43 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-87c5357a-bdfd-4220-9b3f-9ac5d1338475 tempest-VolumesDeleteCascade-219134487 None] Snapshots deleted, issuing volume delete {{(pid=86574) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}} Nov 01 12:30:43 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-87c5357a-bdfd-4220-9b3f-9ac5d1338475 tempest-VolumesDeleteCascade-219134487 None] Acquiring lock "cinder-quobyte-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:30:43 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-87c5357a-bdfd-4220-9b3f-9ac5d1338475 tempest-VolumesDeleteCascade-219134487 None] Lock "cinder-quobyte-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf" acquired by "delete_volume" :: waited 0.021s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:30:44 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ab73b17-e7eb-4601-b382-527f28f0d661]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:30:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-87c5357a-bdfd-4220-9b3f-9ac5d1338475 tempest-VolumesDeleteCascade-219134487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:44 devstack sudo[99874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf Nov 01 12:30:44 devstack sudo[99874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:44 devstack sudo[99874]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-87c5357a-bdfd-4220-9b3f-9ac5d1338475 tempest-VolumesDeleteCascade-219134487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf" returned: 0 in 0.856s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-87c5357a-bdfd-4220-9b3f-9ac5d1338475 tempest-VolumesDeleteCascade-219134487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:45 devstack sudo[99928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf Nov 01 12:30:45 devstack sudo[99928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:45 devstack sudo[99928]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-87c5357a-bdfd-4220-9b3f-9ac5d1338475 tempest-VolumesDeleteCascade-219134487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf" returned: 0 in 0.518s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:45 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-87c5357a-bdfd-4220-9b3f-9ac5d1338475 tempest-VolumesDeleteCascade-219134487 None] Lock "cinder-quobyte-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf" released by "delete_volume" :: held 1.564s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:30:45 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-87c5357a-bdfd-4220-9b3f-9ac5d1338475 tempest-VolumesDeleteCascade-219134487 None] Created reservations ['3a7c6982-fe1a-4afa-872a-38ef24d49ea1', 'cadf872f-f65e-4f5b-99ed-5c472c006c1a', 'f5fefd8a-2eb2-4c31-ace2-726257f00d10', '7b8cf79a-bc6c-4ecf-8a91-ec09ae3d9a9e'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:30:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-87c5357a-bdfd-4220-9b3f-9ac5d1338475 tempest-VolumesDeleteCascade-219134487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:30:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-87c5357a-bdfd-4220-9b3f-9ac5d1338475 tempest-VolumesDeleteCascade-219134487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:30:45 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-87c5357a-bdfd-4220-9b3f-9ac5d1338475 tempest-VolumesDeleteCascade-219134487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:30:45 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-87c5357a-bdfd-4220-9b3f-9ac5d1338475 tempest-VolumesDeleteCascade-219134487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:30:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-87c5357a-bdfd-4220-9b3f-9ac5d1338475 tempest-VolumesDeleteCascade-219134487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:30:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-87c5357a-bdfd-4220-9b3f-9ac5d1338475 tempest-VolumesDeleteCascade-219134487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:45 devstack sudo[99938]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:30:45 devstack sudo[99938]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:45 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-883a7bd3-0270-4215-b1be-2c846a67fca8 tempest-VolumesTransfersTest-57575955 None] Transfer volume completed successfully. Nov 01 12:30:46 devstack sudo[99938]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-87c5357a-bdfd-4220-9b3f-9ac5d1338475 tempest-VolumesDeleteCascade-219134487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.497s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:46 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-87c5357a-bdfd-4220-9b3f-9ac5d1338475 tempest-VolumesDeleteCascade-219134487 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:30:46 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-87c5357a-bdfd-4220-9b3f-9ac5d1338475 tempest-VolumesDeleteCascade-219134487 None] Deleted volume successfully. Nov 01 12:30:46 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-87c5357a-bdfd-4220-9b3f-9ac5d1338475 tempest-VolumesDeleteCascade-219134487 None] Lock "cinder-45b1a9de-8d7f-4de2-9794-0479b1b7d4bf-delete_volume" released by "delete_volume" :: held 5.123s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:30:46 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-4c226ae5-347f-4d8a-adec-7f8668c508d1 tempest-VolumesTransfersTest-1205687450 None] Acquiring lock "cinder-7d4fddee-0814-493d-b1ac-42c36f48ed25-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:30:47 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-4c226ae5-347f-4d8a-adec-7f8668c508d1 tempest-VolumesTransfersTest-1205687450 None] Lock "cinder-7d4fddee-0814-493d-b1ac-42c36f48ed25-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:30:47 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-4c226ae5-347f-4d8a-adec-7f8668c508d1 tempest-VolumesTransfersTest-1205687450 None] Acquiring lock "cinder-quobyte-7d4fddee-0814-493d-b1ac-42c36f48ed25" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:30:47 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-4c226ae5-347f-4d8a-adec-7f8668c508d1 tempest-VolumesTransfersTest-1205687450 None] Lock "cinder-quobyte-7d4fddee-0814-493d-b1ac-42c36f48ed25" acquired by "delete_volume" :: waited 0.039s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:30:47 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f1caa026-6a55-4f01-976b-3a562d3b86cb tempest-VolumesDeleteCascade-219134487 None] Acquiring lock "cinder-3b8bac30-08c3-4f87-a330-4eefc8b5a127-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:30:47 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[82062ef9-ea4f-48c1-9840-ae60e6364f93]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:30:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4c226ae5-347f-4d8a-adec-7f8668c508d1 tempest-VolumesTransfersTest-1205687450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7d4fddee-0814-493d-b1ac-42c36f48ed25 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:47 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f1caa026-6a55-4f01-976b-3a562d3b86cb tempest-VolumesDeleteCascade-219134487 None] Lock "cinder-3b8bac30-08c3-4f87-a330-4eefc8b5a127-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:30:47 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f1caa026-6a55-4f01-976b-3a562d3b86cb tempest-VolumesDeleteCascade-219134487 None] Acquiring lock "cinder-quobyte-3b8bac30-08c3-4f87-a330-4eefc8b5a127" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:30:47 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f1caa026-6a55-4f01-976b-3a562d3b86cb tempest-VolumesDeleteCascade-219134487 None] Lock "cinder-quobyte-3b8bac30-08c3-4f87-a330-4eefc8b5a127" acquired by "delete_volume" :: waited 0.025s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:30:47 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[94bf7851-ddb7-43f2-92b1-0fe2da0ec98a]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:30:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f1caa026-6a55-4f01-976b-3a562d3b86cb tempest-VolumesDeleteCascade-219134487 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3b8bac30-08c3-4f87-a330-4eefc8b5a127 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:47 devstack sudo[99944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7d4fddee-0814-493d-b1ac-42c36f48ed25 Nov 01 12:30:47 devstack sudo[99944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:47 devstack sudo[99945]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3b8bac30-08c3-4f87-a330-4eefc8b5a127 Nov 01 12:30:47 devstack sudo[99945]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:47 devstack sudo[99944]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4c226ae5-347f-4d8a-adec-7f8668c508d1 tempest-VolumesTransfersTest-1205687450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7d4fddee-0814-493d-b1ac-42c36f48ed25" returned: 0 in 0.554s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4c226ae5-347f-4d8a-adec-7f8668c508d1 tempest-VolumesTransfersTest-1205687450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7d4fddee-0814-493d-b1ac-42c36f48ed25 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:47 devstack sudo[99952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7d4fddee-0814-493d-b1ac-42c36f48ed25 Nov 01 12:30:47 devstack sudo[99952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:47 devstack sudo[99945]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f1caa026-6a55-4f01-976b-3a562d3b86cb tempest-VolumesDeleteCascade-219134487 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3b8bac30-08c3-4f87-a330-4eefc8b5a127" returned: 0 in 0.608s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f1caa026-6a55-4f01-976b-3a562d3b86cb tempest-VolumesDeleteCascade-219134487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3b8bac30-08c3-4f87-a330-4eefc8b5a127 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:48 devstack sudo[99957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3b8bac30-08c3-4f87-a330-4eefc8b5a127 Nov 01 12:30:48 devstack sudo[99957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:48 devstack sudo[99952]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4c226ae5-347f-4d8a-adec-7f8668c508d1 tempest-VolumesTransfersTest-1205687450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7d4fddee-0814-493d-b1ac-42c36f48ed25" returned: 0 in 0.328s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:48 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-4c226ae5-347f-4d8a-adec-7f8668c508d1 tempest-VolumesTransfersTest-1205687450 None] Lock "cinder-quobyte-7d4fddee-0814-493d-b1ac-42c36f48ed25" released by "delete_volume" :: held 0.980s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:30:48 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-4c226ae5-347f-4d8a-adec-7f8668c508d1 tempest-VolumesTransfersTest-1205687450 None] Created reservations ['d73c24b7-eccd-4344-9b1b-70f362a5c540', 'd00ebb03-7c0a-4eff-88fc-eb9f82637f2e', '94c78bb4-3e2e-439a-a6c9-6ce16852b39e', '38fbdcbd-87c3-426e-8595-c4535d363550'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:30:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4c226ae5-347f-4d8a-adec-7f8668c508d1 tempest-VolumesTransfersTest-1205687450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:30:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4c226ae5-347f-4d8a-adec-7f8668c508d1 tempest-VolumesTransfersTest-1205687450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:30:48 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-4c226ae5-347f-4d8a-adec-7f8668c508d1 tempest-VolumesTransfersTest-1205687450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:30:48 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-4c226ae5-347f-4d8a-adec-7f8668c508d1 tempest-VolumesTransfersTest-1205687450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:30:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4c226ae5-347f-4d8a-adec-7f8668c508d1 tempest-VolumesTransfersTest-1205687450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:30:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4c226ae5-347f-4d8a-adec-7f8668c508d1 tempest-VolumesTransfersTest-1205687450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:48 devstack sudo[99963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:30:48 devstack sudo[99963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:48 devstack sudo[99957]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f1caa026-6a55-4f01-976b-3a562d3b86cb tempest-VolumesDeleteCascade-219134487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3b8bac30-08c3-4f87-a330-4eefc8b5a127" returned: 0 in 0.533s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:48 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f1caa026-6a55-4f01-976b-3a562d3b86cb tempest-VolumesDeleteCascade-219134487 None] Lock "cinder-quobyte-3b8bac30-08c3-4f87-a330-4eefc8b5a127" released by "delete_volume" :: held 1.231s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:30:48 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-f1caa026-6a55-4f01-976b-3a562d3b86cb tempest-VolumesDeleteCascade-219134487 None] Created reservations ['7aea794c-a953-411f-aabe-550e06d3ad8b', 'a5352c45-34b3-409c-8e47-952c02880e1e', '331d43f3-e59e-4c66-b979-9ca77aa0bef5', 'efa64f79-b0f9-45cc-8a9f-a4cbf7fc65d2'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:30:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f1caa026-6a55-4f01-976b-3a562d3b86cb tempest-VolumesDeleteCascade-219134487 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:30:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f1caa026-6a55-4f01-976b-3a562d3b86cb tempest-VolumesDeleteCascade-219134487 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:30:48 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f1caa026-6a55-4f01-976b-3a562d3b86cb tempest-VolumesDeleteCascade-219134487 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:30:48 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f1caa026-6a55-4f01-976b-3a562d3b86cb tempest-VolumesDeleteCascade-219134487 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:30:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f1caa026-6a55-4f01-976b-3a562d3b86cb tempest-VolumesDeleteCascade-219134487 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:30:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f1caa026-6a55-4f01-976b-3a562d3b86cb tempest-VolumesDeleteCascade-219134487 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:48 devstack sudo[99965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:30:48 devstack sudo[99965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:48 devstack sudo[99963]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4c226ae5-347f-4d8a-adec-7f8668c508d1 tempest-VolumesTransfersTest-1205687450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.559s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:48 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-4c226ae5-347f-4d8a-adec-7f8668c508d1 tempest-VolumesTransfersTest-1205687450 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:30:49 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-4c226ae5-347f-4d8a-adec-7f8668c508d1 tempest-VolumesTransfersTest-1205687450 None] Deleted volume successfully. Nov 01 12:30:49 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-4c226ae5-347f-4d8a-adec-7f8668c508d1 tempest-VolumesTransfersTest-1205687450 None] Lock "cinder-7d4fddee-0814-493d-b1ac-42c36f48ed25-delete_volume" released by "delete_volume" :: held 2.043s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:30:49 devstack sudo[99965]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f1caa026-6a55-4f01-976b-3a562d3b86cb tempest-VolumesDeleteCascade-219134487 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.394s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:49 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-f1caa026-6a55-4f01-976b-3a562d3b86cb tempest-VolumesDeleteCascade-219134487 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:30:49 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-f1caa026-6a55-4f01-976b-3a562d3b86cb tempest-VolumesDeleteCascade-219134487 None] Deleted volume successfully. Nov 01 12:30:49 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f1caa026-6a55-4f01-976b-3a562d3b86cb tempest-VolumesDeleteCascade-219134487 None] Lock "cinder-3b8bac30-08c3-4f87-a330-4eefc8b5a127-delete_volume" released by "delete_volume" :: held 1.910s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:30:50 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ad1e602-4075-490a-9da8-27102f6b5e16 tempest-VolumesTransfersTest-2040814939 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:30:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2ad1e602-4075-490a-9da8-27102f6b5e16 tempest-VolumesTransfersTest-2040814939 None] Flow 'volume_create_manager' (885bc32a-6649-4ff7-a269-7e54a2812043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:30:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2ad1e602-4075-490a-9da8-27102f6b5e16 tempest-VolumesTransfersTest-2040814939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae794939-1275-4f35-9601-3a5f12167a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2ad1e602-4075-490a-9da8-27102f6b5e16 tempest-VolumesTransfersTest-2040814939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ae794939-1275-4f35-9601-3a5f12167a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-684758170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c7cac3d-adf2-4578-9aaf-edbc2d06f57d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b674aaf8ef9e4d179112d92a2dac5e57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:30:50Z,use_quota=True,user_id='696e73540ae1401ba039841739473fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2ad1e602-4075-490a-9da8-27102f6b5e16 tempest-VolumesTransfersTest-2040814939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31b80a4c-8630-41e5-a052-5f469373238c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2ad1e602-4075-490a-9da8-27102f6b5e16 tempest-VolumesTransfersTest-2040814939 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (31b80a4c-8630-41e5-a052-5f469373238c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2ad1e602-4075-490a-9da8-27102f6b5e16 tempest-VolumesTransfersTest-2040814939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08ae35aa-5a7a-4743-b68c-cc2dd849a7ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2ad1e602-4075-490a-9da8-27102f6b5e16 tempest-VolumesTransfersTest-2040814939 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08ae35aa-5a7a-4743-b68c-cc2dd849a7ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3c7cac3d-adf2-4578-9aaf-edbc2d06f57d', 'volume_name': 'volume-3c7cac3d-adf2-4578-9aaf-edbc2d06f57d', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2ad1e602-4075-490a-9da8-27102f6b5e16 tempest-VolumesTransfersTest-2040814939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3eb40d6-cb88-4515-9048-af8f97e8d118) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2ad1e602-4075-490a-9da8-27102f6b5e16 tempest-VolumesTransfersTest-2040814939 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3eb40d6-cb88-4515-9048-af8f97e8d118) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2ad1e602-4075-490a-9da8-27102f6b5e16 tempest-VolumesTransfersTest-2040814939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b517e991-622e-45a5-a066-3a129c62c7ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:50 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-2ad1e602-4075-490a-9da8-27102f6b5e16 tempest-VolumesTransfersTest-2040814939 None] Volume 3c7cac3d-adf2-4578-9aaf-edbc2d06f57d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3c7cac3d-adf2-4578-9aaf-edbc2d06f57d', 'volume_size': 1} Nov 01 12:30:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-2ad1e602-4075-490a-9da8-27102f6b5e16 tempest-VolumesTransfersTest-2040814939 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:30:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-2ad1e602-4075-490a-9da8-27102f6b5e16 tempest-VolumesTransfersTest-2040814939 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:30:50 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-2ad1e602-4075-490a-9da8-27102f6b5e16 tempest-VolumesTransfersTest-2040814939 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:30:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-684758170',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3c7cac3d-adf2-4578-9aaf-edbc2d06f57d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b674aaf8ef9e4d179112d92a2dac5e57',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:30:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:30:50Z,use_quota=True,user_id='696e73540ae1401ba039841739473fcc',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:30:50 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-2ad1e602-4075-490a-9da8-27102f6b5e16 tempest-VolumesTransfersTest-2040814939 None] Creating volume 3c7cac3d-adf2-4578-9aaf-edbc2d06f57d {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:30:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-2ad1e602-4075-490a-9da8-27102f6b5e16 tempest-VolumesTransfersTest-2040814939 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:30:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-2ad1e602-4075-490a-9da8-27102f6b5e16 tempest-VolumesTransfersTest-2040814939 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:30:50 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-2ad1e602-4075-490a-9da8-27102f6b5e16 tempest-VolumesTransfersTest-2040814939 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:30:50 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-2ad1e602-4075-490a-9da8-27102f6b5e16 tempest-VolumesTransfersTest-2040814939 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:30:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-2ad1e602-4075-490a-9da8-27102f6b5e16 tempest-VolumesTransfersTest-2040814939 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:30:50 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-2ad1e602-4075-490a-9da8-27102f6b5e16 tempest-VolumesTransfersTest-2040814939 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:30:50 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-2ad1e602-4075-490a-9da8-27102f6b5e16 tempest-VolumesTransfersTest-2040814939 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:30:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2ad1e602-4075-490a-9da8-27102f6b5e16 tempest-VolumesTransfersTest-2040814939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3c7cac3d-adf2-4578-9aaf-edbc2d06f57d 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:50 devstack sudo[99972]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3c7cac3d-adf2-4578-9aaf-edbc2d06f57d 1073741824 Nov 01 12:30:50 devstack sudo[99972]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:50 devstack sudo[99972]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2ad1e602-4075-490a-9da8-27102f6b5e16 tempest-VolumesTransfersTest-2040814939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3c7cac3d-adf2-4578-9aaf-edbc2d06f57d 1073741824" returned: 0 in 0.649s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2ad1e602-4075-490a-9da8-27102f6b5e16 tempest-VolumesTransfersTest-2040814939 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3c7cac3d-adf2-4578-9aaf-edbc2d06f57d {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:51 devstack sudo[99977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3c7cac3d-adf2-4578-9aaf-edbc2d06f57d Nov 01 12:30:51 devstack sudo[99977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:51 devstack sudo[99977]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2ad1e602-4075-490a-9da8-27102f6b5e16 tempest-VolumesTransfersTest-2040814939 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3c7cac3d-adf2-4578-9aaf-edbc2d06f57d" returned: 0 in 0.392s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:51 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-2ad1e602-4075-490a-9da8-27102f6b5e16 tempest-VolumesTransfersTest-2040814939 None] <== create_volume: return (1129ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:30:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-2ad1e602-4075-490a-9da8-27102f6b5e16 tempest-VolumesTransfersTest-2040814939 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.133s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:30:51 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2ad1e602-4075-490a-9da8-27102f6b5e16 tempest-VolumesTransfersTest-2040814939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b517e991-622e-45a5-a066-3a129c62c7ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3c7cac3d-adf2-4578-9aaf-edbc2d06f57d', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:51 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2ad1e602-4075-490a-9da8-27102f6b5e16 tempest-VolumesTransfersTest-2040814939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b53cec5-9382-4b2d-954b-dbb080b6ab1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:30:51 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-2ad1e602-4075-490a-9da8-27102f6b5e16 tempest-VolumesTransfersTest-2040814939 None] Volume volume-3c7cac3d-adf2-4578-9aaf-edbc2d06f57d (3c7cac3d-adf2-4578-9aaf-edbc2d06f57d): created successfully Nov 01 12:30:51 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2ad1e602-4075-490a-9da8-27102f6b5e16 tempest-VolumesTransfersTest-2040814939 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3b53cec5-9382-4b2d-954b-dbb080b6ab1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:30:51 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2ad1e602-4075-490a-9da8-27102f6b5e16 tempest-VolumesTransfersTest-2040814939 None] Flow 'volume_create_manager' (885bc32a-6649-4ff7-a269-7e54a2812043) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:30:51 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-2ad1e602-4075-490a-9da8-27102f6b5e16 tempest-VolumesTransfersTest-2040814939 None] Created volume successfully. Nov 01 12:30:52 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-cd133f8d-6ead-4f6f-bf30-fac20f061b12 tempest-VolumesTransfersTest-1205687450 None] Acquiring lock "cinder-3c7cac3d-adf2-4578-9aaf-edbc2d06f57d-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:30:52 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-cd133f8d-6ead-4f6f-bf30-fac20f061b12 tempest-VolumesTransfersTest-1205687450 None] Lock "cinder-3c7cac3d-adf2-4578-9aaf-edbc2d06f57d-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:30:52 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-cd133f8d-6ead-4f6f-bf30-fac20f061b12 tempest-VolumesTransfersTest-1205687450 None] Acquiring lock "cinder-quobyte-3c7cac3d-adf2-4578-9aaf-edbc2d06f57d" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:30:52 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-cd133f8d-6ead-4f6f-bf30-fac20f061b12 tempest-VolumesTransfersTest-1205687450 None] Lock "cinder-quobyte-3c7cac3d-adf2-4578-9aaf-edbc2d06f57d" acquired by "delete_volume" :: waited 0.030s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:30:52 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[7721da42-40ef-401e-8e0b-395100c4efb2]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:30:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-cd133f8d-6ead-4f6f-bf30-fac20f061b12 tempest-VolumesTransfersTest-1205687450 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3c7cac3d-adf2-4578-9aaf-edbc2d06f57d {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:52 devstack sudo[99980]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3c7cac3d-adf2-4578-9aaf-edbc2d06f57d Nov 01 12:30:52 devstack sudo[99980]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:53 devstack sudo[99980]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-cd133f8d-6ead-4f6f-bf30-fac20f061b12 tempest-VolumesTransfersTest-1205687450 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3c7cac3d-adf2-4578-9aaf-edbc2d06f57d" returned: 0 in 0.505s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-cd133f8d-6ead-4f6f-bf30-fac20f061b12 tempest-VolumesTransfersTest-1205687450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3c7cac3d-adf2-4578-9aaf-edbc2d06f57d {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:53 devstack sudo[99985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3c7cac3d-adf2-4578-9aaf-edbc2d06f57d Nov 01 12:30:53 devstack sudo[99985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:53 devstack sudo[99985]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-cd133f8d-6ead-4f6f-bf30-fac20f061b12 tempest-VolumesTransfersTest-1205687450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3c7cac3d-adf2-4578-9aaf-edbc2d06f57d" returned: 0 in 0.348s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:53 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-cd133f8d-6ead-4f6f-bf30-fac20f061b12 tempest-VolumesTransfersTest-1205687450 None] Lock "cinder-quobyte-3c7cac3d-adf2-4578-9aaf-edbc2d06f57d" released by "delete_volume" :: held 0.926s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:30:53 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-cd133f8d-6ead-4f6f-bf30-fac20f061b12 tempest-VolumesTransfersTest-1205687450 None] Created reservations ['7f85bd6e-ef37-4166-bc63-4aa8bb476b16', 'be234c81-aed4-41bf-b3e3-537f61b18edc', 'ddc7e96d-a13c-415f-9683-9dbe58f78baa', '7dce9356-7e0e-462d-82c8-03aa446d0353'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:30:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-cd133f8d-6ead-4f6f-bf30-fac20f061b12 tempest-VolumesTransfersTest-1205687450 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:30:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-cd133f8d-6ead-4f6f-bf30-fac20f061b12 tempest-VolumesTransfersTest-1205687450 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:30:53 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-cd133f8d-6ead-4f6f-bf30-fac20f061b12 tempest-VolumesTransfersTest-1205687450 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:30:53 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-cd133f8d-6ead-4f6f-bf30-fac20f061b12 tempest-VolumesTransfersTest-1205687450 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:30:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-cd133f8d-6ead-4f6f-bf30-fac20f061b12 tempest-VolumesTransfersTest-1205687450 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:30:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-cd133f8d-6ead-4f6f-bf30-fac20f061b12 tempest-VolumesTransfersTest-1205687450 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:30:53 devstack sudo[99988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:30:53 devstack sudo[99988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:30:54 devstack sudo[99988]: pam_unix(sudo:session): session closed for user root Nov 01 12:30:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-cd133f8d-6ead-4f6f-bf30-fac20f061b12 tempest-VolumesTransfersTest-1205687450 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.348s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:30:54 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-cd133f8d-6ead-4f6f-bf30-fac20f061b12 tempest-VolumesTransfersTest-1205687450 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:30:54 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-cd133f8d-6ead-4f6f-bf30-fac20f061b12 tempest-VolumesTransfersTest-1205687450 None] Deleted volume successfully. Nov 01 12:30:54 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-cd133f8d-6ead-4f6f-bf30-fac20f061b12 tempest-VolumesTransfersTest-1205687450 None] Lock "cinder-3c7cac3d-adf2-4578-9aaf-edbc2d06f57d-delete_volume" released by "delete_volume" :: held 1.598s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:31:00 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:31:00 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Flow 'volume_create_manager' (e319d315-bf74-40b9-9b12-1297c61e7d01) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:31:00 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fae708a-3320-4d5c-a4d0-95e35993599f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:00 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1fae708a-3320-4d5c-a4d0-95e35993599f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b210a33f-ad91-4911-848c-66c70e6165ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='323260cdf743431cbc6e652feac519dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:31:00Z,use_quota=True,user_id='af145483c52248369a9abe7dafaec90d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7a084d3-b75c-452f-95a2-71b734a433dc),volume_type_id=a7a084d3-b75c-452f-95a2-71b734a433dc)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:00 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4987eb7-c691-473d-8d91-b49d0c5744f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:00 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f4987eb7-c691-473d-8d91-b49d0c5744f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:00 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f845898-b27a-4f05-b6c9-979b444d7bfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:00 devstack cinder-volume[86574]: DEBUG cinder.image.glance [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Creating Keystone auth plugin from conf {{(pid=86574) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 01 12:31:01 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5f845898-b27a-4f05-b6c9-979b444d7bfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'b210a33f-ad91-4911-848c-66c70e6165ec', 'volume_name': 'volume-b210a33f-ad91-4911-848c-66c70e6165ec', 'volume_size': 1, 'image_id': 'adfe80c9-65b8-49e8-952b-8b6364d95a36', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/adfe80c9-65b8-49e8-952b-8b6364d95a36', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '720ccf51647b3e98ad652049a24918b7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '323260cdf743431cbc6e652feac519dd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '63c5e75e6b7aed5f415554453c52a7d1ab4cdcf7fd69b728ae86e3d9d1c2c27f375ddc99026d7eb7cbe9339cb55daf6a3c3a6f59ab1c8638b79168bbc834240f', 'id': 'adfe80c9-65b8-49e8-952b-8b6364d95a36', 'created_at': datetime.datetime(2026, 11, 1, 11, 30, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 30, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/adfe80c9-65b8-49e8-952b-8b6364d95a36/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:01 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b7250e-4a38-4c0f-a503-0e96759854d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:01 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d4b7250e-4a38-4c0f-a503-0e96759854d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:01 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1fbf117-3b82-4bdb-97dc-220627197460) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:01 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Volume b210a33f-ad91-4911-848c-66c70e6165ec: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-b210a33f-ad91-4911-848c-66c70e6165ec', 'volume_size': 1, 'image_id': 'adfe80c9-65b8-49e8-952b-8b6364d95a36', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/adfe80c9-65b8-49e8-952b-8b6364d95a36', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '720ccf51647b3e98ad652049a24918b7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '323260cdf743431cbc6e652feac519dd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '63c5e75e6b7aed5f415554453c52a7d1ab4cdcf7fd69b728ae86e3d9d1c2c27f375ddc99026d7eb7cbe9339cb55daf6a3c3a6f59ab1c8638b79168bbc834240f', 'id': 'adfe80c9-65b8-49e8-952b-8b6364d95a36', 'created_at': datetime.datetime(2026, 11, 1, 11, 30, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 30, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/adfe80c9-65b8-49e8-952b-8b6364d95a36/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 01 12:31:01 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Trying to clone b210a33f-ad91-4911-848c-66c70e6165ec from image adfe80c9-65b8-49e8-952b-8b6364d95a36 at location (None, [{'url': 'file:///opt/stack/data/glance/images/adfe80c9-65b8-49e8-952b-8b6364d95a36', 'metadata': {}}]). {{(pid=86574) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 01 12:31:01 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_adfe80c9-65b8-49e8-952b-8b6364d95a36_dknopkqmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86574) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 01 12:31:01 devstack cinder-volume[86574]: INFO cinder.image.image_utils [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Image download 0.00 MB at 0.00 MB/s Nov 01 12:31:01 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[0379702e-614f-402d-bc4d-c87d4101fd38]: (4, 'raw') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:31:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_adfe80c9-65b8-49e8-952b-8b6364d95a36_dknopkqmdevstack@QuobyteHD {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:01 devstack sudo[100009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_adfe80c9-65b8-49e8-952b-8b6364d95a36_dknopkqmdevstack@QuobyteHD Nov 01 12:31:01 devstack sudo[100009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:01 devstack sudo[100009]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_adfe80c9-65b8-49e8-952b-8b6364d95a36_dknopkqmdevstack@QuobyteHD" returned: 0 in 0.337s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_adfe80c9-65b8-49e8-952b-8b6364d95a36_dknopkqmdevstack@QuobyteHD {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:01 devstack sudo[100013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_adfe80c9-65b8-49e8-952b-8b6364d95a36_dknopkqmdevstack@QuobyteHD Nov 01 12:31:01 devstack sudo[100013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:02 devstack sudo[100013]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_adfe80c9-65b8-49e8-952b-8b6364d95a36_dknopkqmdevstack@QuobyteHD" returned: 1 in 0.407s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_adfe80c9-65b8-49e8-952b-8b6364d95a36_dknopkqmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 12:31:02 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Temporary image adfe80c9-65b8-49e8-952b-8b6364d95a36 is fetched for user af145483c52248369a9abe7dafaec90d. {{(pid=86574) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 01 12:31:02 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[54336b0b-738a-41df-a001-073b203ed550]: (4, 'raw') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:31:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_adfe80c9-65b8-49e8-952b-8b6364d95a36_dknopkqmdevstack@QuobyteHD {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:02 devstack sudo[100018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_adfe80c9-65b8-49e8-952b-8b6364d95a36_dknopkqmdevstack@QuobyteHD Nov 01 12:31:02 devstack sudo[100018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:02 devstack sudo[100018]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_adfe80c9-65b8-49e8-952b-8b6364d95a36_dknopkqmdevstack@QuobyteHD" returned: 0 in 0.458s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_adfe80c9-65b8-49e8-952b-8b6364d95a36_dknopkqmdevstack@QuobyteHD {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:02 devstack sudo[100022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_adfe80c9-65b8-49e8-952b-8b6364d95a36_dknopkqmdevstack@QuobyteHD Nov 01 12:31:02 devstack sudo[100022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:03 devstack sudo[100022]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_adfe80c9-65b8-49e8-952b-8b6364d95a36_dknopkqmdevstack@QuobyteHD" returned: 1 in 0.372s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_adfe80c9-65b8-49e8-952b-8b6364d95a36_dknopkqmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 12:31:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:31:00Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b210a33f-ad91-4911-848c-66c70e6165ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='323260cdf743431cbc6e652feac519dd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:31:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:31:00Z,use_quota=True,user_id='af145483c52248369a9abe7dafaec90d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a7a084d3-b75c-452f-95a2-71b734a433dc),volume_type_id=a7a084d3-b75c-452f-95a2-71b734a433dc)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:31:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Creating volume b210a33f-ad91-4911-848c-66c70e6165ec {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:31:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:31:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:31:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:31:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:31:03 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:31:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b210a33f-ad91-4911-848c-66c70e6165ec 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:03 devstack sudo[100027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b210a33f-ad91-4911-848c-66c70e6165ec 1073741824 Nov 01 12:31:03 devstack sudo[100027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:03 devstack sudo[100027]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b210a33f-ad91-4911-848c-66c70e6165ec 1073741824" returned: 0 in 0.616s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b210a33f-ad91-4911-848c-66c70e6165ec {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:03 devstack sudo[100036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b210a33f-ad91-4911-848c-66c70e6165ec Nov 01 12:31:03 devstack sudo[100036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:04 devstack sudo[100036]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b210a33f-ad91-4911-848c-66c70e6165ec" returned: 0 in 0.310s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:04 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] <== create_volume: return (982ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:31:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.986s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:31:04 devstack cinder-volume[86574]: DEBUG cinder.volume.volume_utils [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Attempting download of adfe80c9-65b8-49e8-952b-8b6364d95a36 ((None, [{'url': 'file:///opt/stack/data/glance/images/adfe80c9-65b8-49e8-952b-8b6364d95a36', 'metadata': {}}])) to volume b210a33f-ad91-4911-848c-66c70e6165ec. {{(pid=86574) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 01 12:31:04 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf96ecda-0e79-4485-baa1-2a26b280f394]: (4, 'raw') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:31:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_adfe80c9-65b8-49e8-952b-8b6364d95a36_40o8t4qz {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:04 devstack sudo[100040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_adfe80c9-65b8-49e8-952b-8b6364d95a36_40o8t4qz Nov 01 12:31:04 devstack sudo[100040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:04 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-95a502cf-d522-41ea-90e0-dc9507404db9 tempest-VolumesTransfersV355Test-1238527193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:31:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-95a502cf-d522-41ea-90e0-dc9507404db9 tempest-VolumesTransfersV355Test-1238527193 None] Flow 'volume_create_manager' (ad41b97d-ac5d-4b0f-816f-82eddf3ae14b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:31:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-95a502cf-d522-41ea-90e0-dc9507404db9 tempest-VolumesTransfersV355Test-1238527193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e744fdb-67b1-4a1e-8f19-eeece6775c9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-95a502cf-d522-41ea-90e0-dc9507404db9 tempest-VolumesTransfersV355Test-1238527193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e744fdb-67b1-4a1e-8f19-eeece6775c9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-433492537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f1bf6ff-f0cf-4183-a148-32aa8eebddb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='512c4a46485349a68d8f9c50f9f757fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:31:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:31:04Z,use_quota=True,user_id='3ed5fd6c5f7d43f694b6f657f88dedeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-95a502cf-d522-41ea-90e0-dc9507404db9 tempest-VolumesTransfersV355Test-1238527193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02629d15-0bdb-4e65-b398-aa03987fb433) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-95a502cf-d522-41ea-90e0-dc9507404db9 tempest-VolumesTransfersV355Test-1238527193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02629d15-0bdb-4e65-b398-aa03987fb433) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-95a502cf-d522-41ea-90e0-dc9507404db9 tempest-VolumesTransfersV355Test-1238527193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33928501-256a-497f-ba6f-866c8dc96f06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:04 devstack sudo[100040]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-95a502cf-d522-41ea-90e0-dc9507404db9 tempest-VolumesTransfersV355Test-1238527193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (33928501-256a-497f-ba6f-866c8dc96f06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2f1bf6ff-f0cf-4183-a148-32aa8eebddb7', 'volume_name': 'volume-2f1bf6ff-f0cf-4183-a148-32aa8eebddb7', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-95a502cf-d522-41ea-90e0-dc9507404db9 tempest-VolumesTransfersV355Test-1238527193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91afe533-f33c-4fe1-a50f-4d403183d064) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-95a502cf-d522-41ea-90e0-dc9507404db9 tempest-VolumesTransfersV355Test-1238527193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91afe533-f33c-4fe1-a50f-4d403183d064) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-95a502cf-d522-41ea-90e0-dc9507404db9 tempest-VolumesTransfersV355Test-1238527193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41f5d95b-dd78-4347-8218-fd591e6ccbc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:04 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-95a502cf-d522-41ea-90e0-dc9507404db9 tempest-VolumesTransfersV355Test-1238527193 None] Volume 2f1bf6ff-f0cf-4183-a148-32aa8eebddb7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2f1bf6ff-f0cf-4183-a148-32aa8eebddb7', 'volume_size': 1} Nov 01 12:31:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-95a502cf-d522-41ea-90e0-dc9507404db9 tempest-VolumesTransfersV355Test-1238527193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-95a502cf-d522-41ea-90e0-dc9507404db9 tempest-VolumesTransfersV355Test-1238527193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:04 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-95a502cf-d522-41ea-90e0-dc9507404db9 tempest-VolumesTransfersV355Test-1238527193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:31:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-433492537',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2f1bf6ff-f0cf-4183-a148-32aa8eebddb7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='512c4a46485349a68d8f9c50f9f757fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:31:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:31:04Z,use_quota=True,user_id='3ed5fd6c5f7d43f694b6f657f88dedeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:31:04 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-95a502cf-d522-41ea-90e0-dc9507404db9 tempest-VolumesTransfersV355Test-1238527193 None] Creating volume 2f1bf6ff-f0cf-4183-a148-32aa8eebddb7 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:31:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-95a502cf-d522-41ea-90e0-dc9507404db9 tempest-VolumesTransfersV355Test-1238527193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-95a502cf-d522-41ea-90e0-dc9507404db9 tempest-VolumesTransfersV355Test-1238527193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:04 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-95a502cf-d522-41ea-90e0-dc9507404db9 tempest-VolumesTransfersV355Test-1238527193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:31:04 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-95a502cf-d522-41ea-90e0-dc9507404db9 tempest-VolumesTransfersV355Test-1238527193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:31:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-95a502cf-d522-41ea-90e0-dc9507404db9 tempest-VolumesTransfersV355Test-1238527193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:31:04 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-95a502cf-d522-41ea-90e0-dc9507404db9 tempest-VolumesTransfersV355Test-1238527193 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:31:04 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-95a502cf-d522-41ea-90e0-dc9507404db9 tempest-VolumesTransfersV355Test-1238527193 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:31:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-95a502cf-d522-41ea-90e0-dc9507404db9 tempest-VolumesTransfersV355Test-1238527193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-2f1bf6ff-f0cf-4183-a148-32aa8eebddb7 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_adfe80c9-65b8-49e8-952b-8b6364d95a36_40o8t4qz" returned: 0 in 0.434s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_adfe80c9-65b8-49e8-952b-8b6364d95a36_40o8t4qz {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:04 devstack sudo[100044]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-2f1bf6ff-f0cf-4183-a148-32aa8eebddb7 1073741824 Nov 01 12:31:04 devstack sudo[100044]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:04 devstack sudo[100045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_adfe80c9-65b8-49e8-952b-8b6364d95a36_40o8t4qz Nov 01 12:31:04 devstack sudo[100045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:04 devstack sudo[100045]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_adfe80c9-65b8-49e8-952b-8b6364d95a36_40o8t4qz" returned: 1 in 0.371s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_adfe80c9-65b8-49e8-952b-8b6364d95a36_40o8t4qz' failed. Not Retrying. {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 12:31:05 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[70d9025a-0287-4cbd-9e2a-e5321115a71b]: (4, 'raw') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:31:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_adfe80c9-65b8-49e8-952b-8b6364d95a36_dknopkqmdevstack@QuobyteHD {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:05 devstack sudo[100053]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_adfe80c9-65b8-49e8-952b-8b6364d95a36_dknopkqmdevstack@QuobyteHD Nov 01 12:31:05 devstack sudo[100053]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:05 devstack sudo[100044]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-95a502cf-d522-41ea-90e0-dc9507404db9 tempest-VolumesTransfersV355Test-1238527193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-2f1bf6ff-f0cf-4183-a148-32aa8eebddb7 1073741824" returned: 0 in 0.582s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-95a502cf-d522-41ea-90e0-dc9507404db9 tempest-VolumesTransfersV355Test-1238527193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-2f1bf6ff-f0cf-4183-a148-32aa8eebddb7 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:05 devstack sudo[100055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-2f1bf6ff-f0cf-4183-a148-32aa8eebddb7 Nov 01 12:31:05 devstack sudo[100055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:05 devstack sudo[100053]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_adfe80c9-65b8-49e8-952b-8b6364d95a36_dknopkqmdevstack@QuobyteHD" returned: 0 in 0.408s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_adfe80c9-65b8-49e8-952b-8b6364d95a36_dknopkqmdevstack@QuobyteHD {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:05 devstack sudo[100059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_adfe80c9-65b8-49e8-952b-8b6364d95a36_dknopkqmdevstack@QuobyteHD Nov 01 12:31:05 devstack sudo[100059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:05 devstack sudo[100055]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-95a502cf-d522-41ea-90e0-dc9507404db9 tempest-VolumesTransfersV355Test-1238527193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-2f1bf6ff-f0cf-4183-a148-32aa8eebddb7" returned: 0 in 0.347s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:05 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-95a502cf-d522-41ea-90e0-dc9507404db9 tempest-VolumesTransfersV355Test-1238527193 None] <== create_volume: return (984ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:31:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-95a502cf-d522-41ea-90e0-dc9507404db9 tempest-VolumesTransfersV355Test-1238527193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.989s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:31:05 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-95a502cf-d522-41ea-90e0-dc9507404db9 tempest-VolumesTransfersV355Test-1238527193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (41f5d95b-dd78-4347-8218-fd591e6ccbc2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2f1bf6ff-f0cf-4183-a148-32aa8eebddb7', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:05 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-95a502cf-d522-41ea-90e0-dc9507404db9 tempest-VolumesTransfersV355Test-1238527193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (392a2c71-9a79-40cc-8bc2-9bbb75c5efb0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:05 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-95a502cf-d522-41ea-90e0-dc9507404db9 tempest-VolumesTransfersV355Test-1238527193 None] Volume volume-2f1bf6ff-f0cf-4183-a148-32aa8eebddb7 (2f1bf6ff-f0cf-4183-a148-32aa8eebddb7): created successfully Nov 01 12:31:05 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-95a502cf-d522-41ea-90e0-dc9507404db9 tempest-VolumesTransfersV355Test-1238527193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (392a2c71-9a79-40cc-8bc2-9bbb75c5efb0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:05 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-95a502cf-d522-41ea-90e0-dc9507404db9 tempest-VolumesTransfersV355Test-1238527193 None] Flow 'volume_create_manager' (ad41b97d-ac5d-4b0f-816f-82eddf3ae14b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:31:05 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-95a502cf-d522-41ea-90e0-dc9507404db9 tempest-VolumesTransfersV355Test-1238527193 None] Created volume successfully. Nov 01 12:31:05 devstack sudo[100059]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_adfe80c9-65b8-49e8-952b-8b6364d95a36_dknopkqmdevstack@QuobyteHD" returned: 1 in 0.390s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_adfe80c9-65b8-49e8-952b-8b6364d95a36_dknopkqmdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 12:31:05 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] adfe80c9-65b8-49e8-952b-8b6364d95a36 was raw, converting to qcow2 {{(pid=86574) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 01 12:31:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_adfe80c9-65b8-49e8-952b-8b6364d95a36_dknopkqmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b210a33f-ad91-4911-848c-66c70e6165ec {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:05 devstack sudo[100065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_adfe80c9-65b8-49e8-952b-8b6364d95a36_dknopkqmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b210a33f-ad91-4911-848c-66c70e6165ec Nov 01 12:31:05 devstack sudo[100065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:06 devstack sudo[100065]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_adfe80c9-65b8-49e8-952b-8b6364d95a36_dknopkqmdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b210a33f-ad91-4911-848c-66c70e6165ec" returned: 0 in 0.654s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:06 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_adfe80c9-65b8-49e8-952b-8b6364d95a36_dknopkqmdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b210a33f-ad91-4911-848c-66c70e6165ec {{(pid=86574) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 12:31:06 devstack cinder-volume[86574]: INFO cinder.image.image_utils [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Converted 0.00 MB image at 0.00 MB/s Nov 01 12:31:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b210a33f-ad91-4911-848c-66c70e6165ec 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:06 devstack sudo[100073]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b210a33f-ad91-4911-848c-66c70e6165ec 1G Nov 01 12:31:06 devstack sudo[100073]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:07 devstack sudo[100073]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b210a33f-ad91-4911-848c-66c70e6165ec 1G" returned: 0 in 0.528s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:07 devstack cinder-volume[86574]: DEBUG cinder.volume.volume_utils [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Downloaded image adfe80c9-65b8-49e8-952b-8b6364d95a36 ((None, [{'url': 'file:///opt/stack/data/glance/images/adfe80c9-65b8-49e8-952b-8b6364d95a36', 'metadata': {}}])) to volume b210a33f-ad91-4911-848c-66c70e6165ec successfully. {{(pid=86574) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 01 12:31:07 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Temporary image adfe80c9-65b8-49e8-952b-8b6364d95a36 for user af145483c52248369a9abe7dafaec90d is deleted. {{(pid=86574) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 01 12:31:07 devstack cinder-volume[86574]: DEBUG cinder.volume.volume_utils [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Marking volume b210a33f-ad91-4911-848c-66c70e6165ec as bootable. {{(pid=86574) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 01 12:31:07 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Copying metadata from image adfe80c9-65b8-49e8-952b-8b6364d95a36 to b210a33f-ad91-4911-848c-66c70e6165ec. {{(pid=86574) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 01 12:31:07 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Creating volume glance metadata for volume b210a33f-ad91-4911-848c-66c70e6165ec backed by image adfe80c9-65b8-49e8-952b-8b6364d95a36 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'adfe80c9-65b8-49e8-952b-8b6364d95a36', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': '720ccf51647b3e98ad652049a24918b7', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86574) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 01 12:31:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c1fbf117-3b82-4bdb-97dc-220627197460) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b210a33f-ad91-4911-848c-66c70e6165ec', 'volume_size': 1, 'image_id': 'adfe80c9-65b8-49e8-952b-8b6364d95a36', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/adfe80c9-65b8-49e8-952b-8b6364d95a36', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '720ccf51647b3e98ad652049a24918b7', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '323260cdf743431cbc6e652feac519dd', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '63c5e75e6b7aed5f415554453c52a7d1ab4cdcf7fd69b728ae86e3d9d1c2c27f375ddc99026d7eb7cbe9339cb55daf6a3c3a6f59ab1c8638b79168bbc834240f', 'id': 'adfe80c9-65b8-49e8-952b-8b6364d95a36', 'created_at': datetime.datetime(2026, 11, 1, 11, 30, 57, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 30, 59, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/adfe80c9-65b8-49e8-952b-8b6364d95a36/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59915037-a6c5-4b41-8461-2f00114b0f1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:07 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Volume volume-b210a33f-ad91-4911-848c-66c70e6165ec (b210a33f-ad91-4911-848c-66c70e6165ec): created successfully Nov 01 12:31:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (59915037-a6c5-4b41-8461-2f00114b0f1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Flow 'volume_create_manager' (e319d315-bf74-40b9-9b12-1297c61e7d01) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:31:07 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-63b3e8f6-c12d-48ea-beae-edf3105191c3 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Created volume successfully. Nov 01 12:31:07 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-6d7c5b5d-75a8-423e-82fd-063991ec253d tempest-VolumesTransfersV355Test-1092505137 None] Transfer volume completed successfully. Nov 01 12:31:08 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-c5b9a490-5011-4b45-8f80-68c8c0ecea42 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Acquiring lock "cinder-b210a33f-ad91-4911-848c-66c70e6165ec-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:31:08 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-c5b9a490-5011-4b45-8f80-68c8c0ecea42 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Lock "cinder-b210a33f-ad91-4911-848c-66c70e6165ec-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:31:08 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-c5b9a490-5011-4b45-8f80-68c8c0ecea42 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Acquiring lock "cinder-quobyte-b210a33f-ad91-4911-848c-66c70e6165ec" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:31:08 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-c5b9a490-5011-4b45-8f80-68c8c0ecea42 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Lock "cinder-quobyte-b210a33f-ad91-4911-848c-66c70e6165ec" acquired by "delete_volume" :: waited 0.028s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:31:08 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-12e77b07-bb67-4fa3-89c4-6e56ca05d898 tempest-VolumesTransfersV355Test-519164085 None] Acquiring lock "cinder-2f1bf6ff-f0cf-4183-a148-32aa8eebddb7-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:31:08 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-12e77b07-bb67-4fa3-89c4-6e56ca05d898 tempest-VolumesTransfersV355Test-519164085 None] Lock "cinder-2f1bf6ff-f0cf-4183-a148-32aa8eebddb7-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:31:08 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[208c96f1-fe2c-4d87-ab5f-72c76c0401bb]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:31:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c5b9a490-5011-4b45-8f80-68c8c0ecea42 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b210a33f-ad91-4911-848c-66c70e6165ec {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:08 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-12e77b07-bb67-4fa3-89c4-6e56ca05d898 tempest-VolumesTransfersV355Test-519164085 None] Acquiring lock "cinder-quobyte-2f1bf6ff-f0cf-4183-a148-32aa8eebddb7" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:31:08 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-818d793a-1d31-4a1a-a4ec-ecd808c2de81 tempest-VolumesActionsTest-573589455 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:31:08 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-818d793a-1d31-4a1a-a4ec-ecd808c2de81 tempest-VolumesActionsTest-573589455 None] Flow 'volume_create_manager' (7d044907-4931-42db-8d5b-f2e91ba822de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:31:08 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-818d793a-1d31-4a1a-a4ec-ecd808c2de81 tempest-VolumesActionsTest-573589455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06a14062-f8b9-4909-b7ed-ee18a1886d74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:08 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-818d793a-1d31-4a1a-a4ec-ecd808c2de81 tempest-VolumesActionsTest-573589455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (06a14062-f8b9-4909-b7ed-ee18a1886d74) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:31:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1803531115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79d240f8-e8a1-4d53-8697-972a549fb950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de050a4c03a8421fb4ad73aeceeaa4bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:31:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:31:08Z,use_quota=True,user_id='ead7f9609795495ea58b6ee35fb6f24a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:08 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-818d793a-1d31-4a1a-a4ec-ecd808c2de81 tempest-VolumesActionsTest-573589455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc7cc637-9bf4-4dea-a822-c20bf12dd29b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:08 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-818d793a-1d31-4a1a-a4ec-ecd808c2de81 tempest-VolumesActionsTest-573589455 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cc7cc637-9bf4-4dea-a822-c20bf12dd29b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:08 devstack sudo[100080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b210a33f-ad91-4911-848c-66c70e6165ec Nov 01 12:31:08 devstack sudo[100080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:08 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-818d793a-1d31-4a1a-a4ec-ecd808c2de81 tempest-VolumesActionsTest-573589455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0f6b7db-408b-4c88-85de-c6d5f18a52cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:08 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-818d793a-1d31-4a1a-a4ec-ecd808c2de81 tempest-VolumesActionsTest-573589455 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d0f6b7db-408b-4c88-85de-c6d5f18a52cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '79d240f8-e8a1-4d53-8697-972a549fb950', 'volume_name': 'volume-79d240f8-e8a1-4d53-8697-972a549fb950', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:08 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-818d793a-1d31-4a1a-a4ec-ecd808c2de81 tempest-VolumesActionsTest-573589455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf75fe5c-ce1e-445c-9a39-ec13379d9499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:08 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-818d793a-1d31-4a1a-a4ec-ecd808c2de81 tempest-VolumesActionsTest-573589455 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf75fe5c-ce1e-445c-9a39-ec13379d9499) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:08 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-818d793a-1d31-4a1a-a4ec-ecd808c2de81 tempest-VolumesActionsTest-573589455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (857b3d07-1e21-4fc9-9a97-ec15454e6023) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:08 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-818d793a-1d31-4a1a-a4ec-ecd808c2de81 tempest-VolumesActionsTest-573589455 None] Volume 79d240f8-e8a1-4d53-8697-972a549fb950: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-79d240f8-e8a1-4d53-8697-972a549fb950', 'volume_size': 1} Nov 01 12:31:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-818d793a-1d31-4a1a-a4ec-ecd808c2de81 tempest-VolumesActionsTest-573589455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-818d793a-1d31-4a1a-a4ec-ecd808c2de81 tempest-VolumesActionsTest-573589455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:08 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-818d793a-1d31-4a1a-a4ec-ecd808c2de81 tempest-VolumesActionsTest-573589455 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:31:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1803531115',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=79d240f8-e8a1-4d53-8697-972a549fb950,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de050a4c03a8421fb4ad73aeceeaa4bd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:31:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:31:08Z,use_quota=True,user_id='ead7f9609795495ea58b6ee35fb6f24a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:31:08 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-818d793a-1d31-4a1a-a4ec-ecd808c2de81 tempest-VolumesActionsTest-573589455 None] Creating volume 79d240f8-e8a1-4d53-8697-972a549fb950 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:31:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-818d793a-1d31-4a1a-a4ec-ecd808c2de81 tempest-VolumesActionsTest-573589455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-818d793a-1d31-4a1a-a4ec-ecd808c2de81 tempest-VolumesActionsTest-573589455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:08 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-818d793a-1d31-4a1a-a4ec-ecd808c2de81 tempest-VolumesActionsTest-573589455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:31:08 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-818d793a-1d31-4a1a-a4ec-ecd808c2de81 tempest-VolumesActionsTest-573589455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:31:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-818d793a-1d31-4a1a-a4ec-ecd808c2de81 tempest-VolumesActionsTest-573589455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:31:08 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-818d793a-1d31-4a1a-a4ec-ecd808c2de81 tempest-VolumesActionsTest-573589455 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:31:08 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-818d793a-1d31-4a1a-a4ec-ecd808c2de81 tempest-VolumesActionsTest-573589455 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:31:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-818d793a-1d31-4a1a-a4ec-ecd808c2de81 tempest-VolumesActionsTest-573589455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-79d240f8-e8a1-4d53-8697-972a549fb950 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:08 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-12e77b07-bb67-4fa3-89c4-6e56ca05d898 tempest-VolumesTransfersV355Test-519164085 None] Lock "cinder-quobyte-2f1bf6ff-f0cf-4183-a148-32aa8eebddb7" acquired by "delete_volume" :: waited 0.125s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:31:08 devstack sudo[100082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-79d240f8-e8a1-4d53-8697-972a549fb950 1073741824 Nov 01 12:31:08 devstack sudo[100082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:08 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[6baeab8d-406a-43c0-8fb3-6a6933d25a39]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:31:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-12e77b07-bb67-4fa3-89c4-6e56ca05d898 tempest-VolumesTransfersV355Test-519164085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-2f1bf6ff-f0cf-4183-a148-32aa8eebddb7 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:08 devstack sudo[100086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-2f1bf6ff-f0cf-4183-a148-32aa8eebddb7 Nov 01 12:31:08 devstack sudo[100086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:08 devstack sudo[100080]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c5b9a490-5011-4b45-8f80-68c8c0ecea42 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b210a33f-ad91-4911-848c-66c70e6165ec" returned: 0 in 0.529s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c5b9a490-5011-4b45-8f80-68c8c0ecea42 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b210a33f-ad91-4911-848c-66c70e6165ec {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:08 devstack sudo[100094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b210a33f-ad91-4911-848c-66c70e6165ec Nov 01 12:31:08 devstack sudo[100094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:09 devstack sudo[100086]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-12e77b07-bb67-4fa3-89c4-6e56ca05d898 tempest-VolumesTransfersV355Test-519164085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-2f1bf6ff-f0cf-4183-a148-32aa8eebddb7" returned: 0 in 0.523s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-12e77b07-bb67-4fa3-89c4-6e56ca05d898 tempest-VolumesTransfersV355Test-519164085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-2f1bf6ff-f0cf-4183-a148-32aa8eebddb7 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:09 devstack sudo[100101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-2f1bf6ff-f0cf-4183-a148-32aa8eebddb7 Nov 01 12:31:09 devstack sudo[100101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:09 devstack sudo[100094]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c5b9a490-5011-4b45-8f80-68c8c0ecea42 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b210a33f-ad91-4911-848c-66c70e6165ec" returned: 0 in 0.442s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:09 devstack sudo[100082]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-818d793a-1d31-4a1a-a4ec-ecd808c2de81 tempest-VolumesActionsTest-573589455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-79d240f8-e8a1-4d53-8697-972a549fb950 1073741824" returned: 0 in 0.776s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:09 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-c5b9a490-5011-4b45-8f80-68c8c0ecea42 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Lock "cinder-quobyte-b210a33f-ad91-4911-848c-66c70e6165ec" released by "delete_volume" :: held 1.089s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:31:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-818d793a-1d31-4a1a-a4ec-ecd808c2de81 tempest-VolumesActionsTest-573589455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-79d240f8-e8a1-4d53-8697-972a549fb950 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:09 devstack cinder-volume[86574]: WARNING cinder.quota [None req-c5b9a490-5011-4b45-8f80-68c8c0ecea42 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Deprecated: Default quota for resource: volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_volumes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:31:09 devstack cinder-volume[86574]: WARNING cinder.quota [None req-c5b9a490-5011-4b45-8f80-68c8c0ecea42 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Deprecated: Default quota for resource: gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6 is set by the default quota flag: quota_gigabytes_vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:31:09 devstack sudo[100104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-79d240f8-e8a1-4d53-8697-972a549fb950 Nov 01 12:31:09 devstack sudo[100104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:09 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-c5b9a490-5011-4b45-8f80-68c8c0ecea42 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Created reservations ['86cc8fd2-54e6-402b-bd0f-43f335634ef4', 'd02d715f-eb76-4c09-bac7-fc09861237c7', 'f9c74afc-7e86-48b8-8b49-130bfbe7d1b5', 'c5b0bf6a-50f4-4d03-94a1-a2010811b497'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:31:09 devstack sudo[100101]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-12e77b07-bb67-4fa3-89c4-6e56ca05d898 tempest-VolumesTransfersV355Test-519164085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-2f1bf6ff-f0cf-4183-a148-32aa8eebddb7" returned: 0 in 0.438s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:09 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-12e77b07-bb67-4fa3-89c4-6e56ca05d898 tempest-VolumesTransfersV355Test-519164085 None] Lock "cinder-quobyte-2f1bf6ff-f0cf-4183-a148-32aa8eebddb7" released by "delete_volume" :: held 1.054s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:31:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-c5b9a490-5011-4b45-8f80-68c8c0ecea42 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-c5b9a490-5011-4b45-8f80-68c8c0ecea42 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:09 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-c5b9a490-5011-4b45-8f80-68c8c0ecea42 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:31:09 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-c5b9a490-5011-4b45-8f80-68c8c0ecea42 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:31:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-c5b9a490-5011-4b45-8f80-68c8c0ecea42 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:31:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c5b9a490-5011-4b45-8f80-68c8c0ecea42 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:09 devstack sudo[100107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:31:09 devstack sudo[100107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:09 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-12e77b07-bb67-4fa3-89c4-6e56ca05d898 tempest-VolumesTransfersV355Test-519164085 None] Created reservations ['cdc313dc-ecf8-4582-8681-a9fb376e8502', '4f71c9f3-4bc2-40e6-b2f6-c7fa3e05f2ab', 'adc691e6-728b-4a65-a78c-be5ab8710b14', '16da1381-8913-4522-892e-c067b2694763'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:31:09 devstack sudo[100104]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-818d793a-1d31-4a1a-a4ec-ecd808c2de81 tempest-VolumesActionsTest-573589455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-79d240f8-e8a1-4d53-8697-972a549fb950" returned: 0 in 0.345s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:09 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-818d793a-1d31-4a1a-a4ec-ecd808c2de81 tempest-VolumesActionsTest-573589455 None] <== create_volume: return (1234ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:31:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-818d793a-1d31-4a1a-a4ec-ecd808c2de81 tempest-VolumesActionsTest-573589455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.236s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:31:09 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-818d793a-1d31-4a1a-a4ec-ecd808c2de81 tempest-VolumesActionsTest-573589455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (857b3d07-1e21-4fc9-9a97-ec15454e6023) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-79d240f8-e8a1-4d53-8697-972a549fb950', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:09 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-818d793a-1d31-4a1a-a4ec-ecd808c2de81 tempest-VolumesActionsTest-573589455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79c041c5-c883-499f-994b-d18e1e0661e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-12e77b07-bb67-4fa3-89c4-6e56ca05d898 tempest-VolumesTransfersV355Test-519164085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-12e77b07-bb67-4fa3-89c4-6e56ca05d898 tempest-VolumesTransfersV355Test-519164085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:09 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-12e77b07-bb67-4fa3-89c4-6e56ca05d898 tempest-VolumesTransfersV355Test-519164085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:31:09 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-12e77b07-bb67-4fa3-89c4-6e56ca05d898 tempest-VolumesTransfersV355Test-519164085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:31:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-12e77b07-bb67-4fa3-89c4-6e56ca05d898 tempest-VolumesTransfersV355Test-519164085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:31:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-12e77b07-bb67-4fa3-89c4-6e56ca05d898 tempest-VolumesTransfersV355Test-519164085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:09 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-818d793a-1d31-4a1a-a4ec-ecd808c2de81 tempest-VolumesActionsTest-573589455 None] Volume volume-79d240f8-e8a1-4d53-8697-972a549fb950 (79d240f8-e8a1-4d53-8697-972a549fb950): created successfully Nov 01 12:31:09 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-818d793a-1d31-4a1a-a4ec-ecd808c2de81 tempest-VolumesActionsTest-573589455 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (79c041c5-c883-499f-994b-d18e1e0661e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:09 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-818d793a-1d31-4a1a-a4ec-ecd808c2de81 tempest-VolumesActionsTest-573589455 None] Flow 'volume_create_manager' (7d044907-4931-42db-8d5b-f2e91ba822de) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:31:09 devstack sudo[100113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:31:09 devstack sudo[100113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:09 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-818d793a-1d31-4a1a-a4ec-ecd808c2de81 tempest-VolumesActionsTest-573589455 None] Created volume successfully. Nov 01 12:31:09 devstack sudo[100107]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c5b9a490-5011-4b45-8f80-68c8c0ecea42 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.317s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:09 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-c5b9a490-5011-4b45-8f80-68c8c0ecea42 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:31:09 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-c5b9a490-5011-4b45-8f80-68c8c0ecea42 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Deleted volume successfully. Nov 01 12:31:10 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-c5b9a490-5011-4b45-8f80-68c8c0ecea42 tempest-VolumeAndVolumeTypeFromImageTest-200278627 None] Lock "cinder-b210a33f-ad91-4911-848c-66c70e6165ec-delete_volume" released by "delete_volume" :: held 1.837s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:31:10 devstack sudo[100113]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-12e77b07-bb67-4fa3-89c4-6e56ca05d898 tempest-VolumesTransfersV355Test-519164085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.298s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:10 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-12e77b07-bb67-4fa3-89c4-6e56ca05d898 tempest-VolumesTransfersV355Test-519164085 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:31:10 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-12e77b07-bb67-4fa3-89c4-6e56ca05d898 tempest-VolumesTransfersV355Test-519164085 None] Deleted volume successfully. Nov 01 12:31:10 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-12e77b07-bb67-4fa3-89c4-6e56ca05d898 tempest-VolumesTransfersV355Test-519164085 None] Lock "cinder-2f1bf6ff-f0cf-4183-a148-32aa8eebddb7-delete_volume" released by "delete_volume" :: held 1.823s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:31:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-4401a22a-3c24-464f-8518-b0a8945cf88c req-d7a6e4ed-42d1-45e4-972c-c0a3b4cd4052 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-4401a22a-3c24-464f-8518-b0a8945cf88c req-d7a6e4ed-42d1-45e4-972c-c0a3b4cd4052 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-4401a22a-3c24-464f-8518-b0a8945cf88c req-d7a6e4ed-42d1-45e4-972c-c0a3b4cd4052 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.021s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:31:10 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-4401a22a-3c24-464f-8518-b0a8945cf88c req-d7a6e4ed-42d1-45e4-972c-c0a3b4cd4052 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb', 'name': 'volume-8c81d01b-a52f-4b7f-a181-88a1d3ddaa71', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '00a2180a-e469-4f78-94d0-6afe36b3c50b', 'enforce_multipath': True} {{(pid=86574) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 12:31:10 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-4401a22a-3c24-464f-8518-b0a8945cf88c req-d7a6e4ed-42d1-45e4-972c-c0a3b4cd4052 tempest-TestServerVolumeAttachmentScenario-1426975797 None] attachment_update completed successfully. Nov 01 12:31:11 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca47d7af-2c2a-4432-8527-66d85c430105 tempest-VolumesTransfersV355Test-1238527193 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:31:11 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ca47d7af-2c2a-4432-8527-66d85c430105 tempest-VolumesTransfersV355Test-1238527193 None] Flow 'volume_create_manager' (03afe876-824d-4737-b25f-335dbb5386d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:31:11 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ca47d7af-2c2a-4432-8527-66d85c430105 tempest-VolumesTransfersV355Test-1238527193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc6b013b-a170-4089-a735-519bd7fd6682) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:11 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ca47d7af-2c2a-4432-8527-66d85c430105 tempest-VolumesTransfersV355Test-1238527193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cc6b013b-a170-4089-a735-519bd7fd6682) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:31:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1959443746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a3518ca-09e5-4b6a-a314-75d818b07164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='512c4a46485349a68d8f9c50f9f757fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:31:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:31:11Z,use_quota=True,user_id='3ed5fd6c5f7d43f694b6f657f88dedeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:11 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ca47d7af-2c2a-4432-8527-66d85c430105 tempest-VolumesTransfersV355Test-1238527193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (978b0d9c-90e6-40d8-b4be-e237a3190043) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:11 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ca47d7af-2c2a-4432-8527-66d85c430105 tempest-VolumesTransfersV355Test-1238527193 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (978b0d9c-90e6-40d8-b4be-e237a3190043) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:11 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ca47d7af-2c2a-4432-8527-66d85c430105 tempest-VolumesTransfersV355Test-1238527193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5efe975-49c2-425d-9264-3f32293b7d72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:11 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ca47d7af-2c2a-4432-8527-66d85c430105 tempest-VolumesTransfersV355Test-1238527193 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5efe975-49c2-425d-9264-3f32293b7d72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a3518ca-09e5-4b6a-a314-75d818b07164', 'volume_name': 'volume-3a3518ca-09e5-4b6a-a314-75d818b07164', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:11 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ca47d7af-2c2a-4432-8527-66d85c430105 tempest-VolumesTransfersV355Test-1238527193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50abc543-802e-40f8-96bc-857c3c9d9cfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:11 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ca47d7af-2c2a-4432-8527-66d85c430105 tempest-VolumesTransfersV355Test-1238527193 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50abc543-802e-40f8-96bc-857c3c9d9cfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:11 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ca47d7af-2c2a-4432-8527-66d85c430105 tempest-VolumesTransfersV355Test-1238527193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (526b2753-bdfc-4125-a3e4-bc41fd4f3371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:11 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-ca47d7af-2c2a-4432-8527-66d85c430105 tempest-VolumesTransfersV355Test-1238527193 None] Volume 3a3518ca-09e5-4b6a-a314-75d818b07164: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a3518ca-09e5-4b6a-a314-75d818b07164', 'volume_size': 1} Nov 01 12:31:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ca47d7af-2c2a-4432-8527-66d85c430105 tempest-VolumesTransfersV355Test-1238527193 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ca47d7af-2c2a-4432-8527-66d85c430105 tempest-VolumesTransfersV355Test-1238527193 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:11 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ca47d7af-2c2a-4432-8527-66d85c430105 tempest-VolumesTransfersV355Test-1238527193 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:31:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1959443746',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a3518ca-09e5-4b6a-a314-75d818b07164,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='512c4a46485349a68d8f9c50f9f757fb',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:31:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:31:11Z,use_quota=True,user_id='3ed5fd6c5f7d43f694b6f657f88dedeb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:31:11 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-ca47d7af-2c2a-4432-8527-66d85c430105 tempest-VolumesTransfersV355Test-1238527193 None] Creating volume 3a3518ca-09e5-4b6a-a314-75d818b07164 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:31:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ca47d7af-2c2a-4432-8527-66d85c430105 tempest-VolumesTransfersV355Test-1238527193 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ca47d7af-2c2a-4432-8527-66d85c430105 tempest-VolumesTransfersV355Test-1238527193 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:11 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ca47d7af-2c2a-4432-8527-66d85c430105 tempest-VolumesTransfersV355Test-1238527193 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:31:11 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ca47d7af-2c2a-4432-8527-66d85c430105 tempest-VolumesTransfersV355Test-1238527193 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:31:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ca47d7af-2c2a-4432-8527-66d85c430105 tempest-VolumesTransfersV355Test-1238527193 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:31:11 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ca47d7af-2c2a-4432-8527-66d85c430105 tempest-VolumesTransfersV355Test-1238527193 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:31:11 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-ca47d7af-2c2a-4432-8527-66d85c430105 tempest-VolumesTransfersV355Test-1238527193 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:31:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ca47d7af-2c2a-4432-8527-66d85c430105 tempest-VolumesTransfersV355Test-1238527193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3a3518ca-09e5-4b6a-a314-75d818b07164 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:11 devstack sudo[100543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3a3518ca-09e5-4b6a-a314-75d818b07164 1073741824 Nov 01 12:31:11 devstack sudo[100543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:12 devstack sudo[100543]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ca47d7af-2c2a-4432-8527-66d85c430105 tempest-VolumesTransfersV355Test-1238527193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3a3518ca-09e5-4b6a-a314-75d818b07164 1073741824" returned: 0 in 0.785s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ca47d7af-2c2a-4432-8527-66d85c430105 tempest-VolumesTransfersV355Test-1238527193 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3a3518ca-09e5-4b6a-a314-75d818b07164 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:12 devstack sudo[100558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3a3518ca-09e5-4b6a-a314-75d818b07164 Nov 01 12:31:12 devstack sudo[100558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:12 devstack sudo[100558]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ca47d7af-2c2a-4432-8527-66d85c430105 tempest-VolumesTransfersV355Test-1238527193 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3a3518ca-09e5-4b6a-a314-75d818b07164" returned: 0 in 0.355s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:12 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ca47d7af-2c2a-4432-8527-66d85c430105 tempest-VolumesTransfersV355Test-1238527193 None] <== create_volume: return (1198ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:31:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ca47d7af-2c2a-4432-8527-66d85c430105 tempest-VolumesTransfersV355Test-1238527193 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.204s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:31:12 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ca47d7af-2c2a-4432-8527-66d85c430105 tempest-VolumesTransfersV355Test-1238527193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (526b2753-bdfc-4125-a3e4-bc41fd4f3371) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a3518ca-09e5-4b6a-a314-75d818b07164', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:12 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ca47d7af-2c2a-4432-8527-66d85c430105 tempest-VolumesTransfersV355Test-1238527193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d255c9a-a07a-4538-b3bb-4fa73d53a376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:12 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-ca47d7af-2c2a-4432-8527-66d85c430105 tempest-VolumesTransfersV355Test-1238527193 None] Volume volume-3a3518ca-09e5-4b6a-a314-75d818b07164 (3a3518ca-09e5-4b6a-a314-75d818b07164): created successfully Nov 01 12:31:12 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ca47d7af-2c2a-4432-8527-66d85c430105 tempest-VolumesTransfersV355Test-1238527193 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d255c9a-a07a-4538-b3bb-4fa73d53a376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:12 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ca47d7af-2c2a-4432-8527-66d85c430105 tempest-VolumesTransfersV355Test-1238527193 None] Flow 'volume_create_manager' (03afe876-824d-4737-b25f-335dbb5386d5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:31:12 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-ca47d7af-2c2a-4432-8527-66d85c430105 tempest-VolumesTransfersV355Test-1238527193 None] Created volume successfully. Nov 01 12:31:14 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6686fb58-cfe7-4b71-aabc-98883bc3961f tempest-VolumesTransfersV355Test-519164085 None] Acquiring lock "cinder-3a3518ca-09e5-4b6a-a314-75d818b07164-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:31:14 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6686fb58-cfe7-4b71-aabc-98883bc3961f tempest-VolumesTransfersV355Test-519164085 None] Lock "cinder-3a3518ca-09e5-4b6a-a314-75d818b07164-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:31:14 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6686fb58-cfe7-4b71-aabc-98883bc3961f tempest-VolumesTransfersV355Test-519164085 None] Acquiring lock "cinder-quobyte-3a3518ca-09e5-4b6a-a314-75d818b07164" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:31:14 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6686fb58-cfe7-4b71-aabc-98883bc3961f tempest-VolumesTransfersV355Test-519164085 None] Lock "cinder-quobyte-3a3518ca-09e5-4b6a-a314-75d818b07164" acquired by "delete_volume" :: waited 0.030s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:31:14 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[477c02c7-43ef-4685-87d5-c574152d3143]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:31:14 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6686fb58-cfe7-4b71-aabc-98883bc3961f tempest-VolumesTransfersV355Test-519164085 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3a3518ca-09e5-4b6a-a314-75d818b07164 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:14 devstack sudo[100574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3a3518ca-09e5-4b6a-a314-75d818b07164 Nov 01 12:31:14 devstack sudo[100574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:15 devstack sudo[100574]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6686fb58-cfe7-4b71-aabc-98883bc3961f tempest-VolumesTransfersV355Test-519164085 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3a3518ca-09e5-4b6a-a314-75d818b07164" returned: 0 in 0.534s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6686fb58-cfe7-4b71-aabc-98883bc3961f tempest-VolumesTransfersV355Test-519164085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3a3518ca-09e5-4b6a-a314-75d818b07164 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:15 devstack sudo[100583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3a3518ca-09e5-4b6a-a314-75d818b07164 Nov 01 12:31:15 devstack sudo[100583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:15 devstack sudo[100583]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6686fb58-cfe7-4b71-aabc-98883bc3961f tempest-VolumesTransfersV355Test-519164085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3a3518ca-09e5-4b6a-a314-75d818b07164" returned: 0 in 0.314s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:15 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6686fb58-cfe7-4b71-aabc-98883bc3961f tempest-VolumesTransfersV355Test-519164085 None] Lock "cinder-quobyte-3a3518ca-09e5-4b6a-a314-75d818b07164" released by "delete_volume" :: held 0.927s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:31:15 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-6686fb58-cfe7-4b71-aabc-98883bc3961f tempest-VolumesTransfersV355Test-519164085 None] Created reservations ['81b14af6-504f-48e8-bad7-84b98b73e375', 'fa76bbec-a8f5-4a61-9811-d4bae56eb242', '75c43825-6eaa-4ed9-b7ae-02ec49c4c12e', '2762a4c2-81c9-4227-ab2e-bdf1a553a7f1'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:31:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-6686fb58-cfe7-4b71-aabc-98883bc3961f tempest-VolumesTransfersV355Test-519164085 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-6686fb58-cfe7-4b71-aabc-98883bc3961f tempest-VolumesTransfersV355Test-519164085 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:15 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-6686fb58-cfe7-4b71-aabc-98883bc3961f tempest-VolumesTransfersV355Test-519164085 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:31:15 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-6686fb58-cfe7-4b71-aabc-98883bc3961f tempest-VolumesTransfersV355Test-519164085 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:31:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-6686fb58-cfe7-4b71-aabc-98883bc3961f tempest-VolumesTransfersV355Test-519164085 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:31:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6686fb58-cfe7-4b71-aabc-98883bc3961f tempest-VolumesTransfersV355Test-519164085 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:15 devstack sudo[100586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:31:15 devstack sudo[100586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:15 devstack sudo[100586]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6686fb58-cfe7-4b71-aabc-98883bc3961f tempest-VolumesTransfersV355Test-519164085 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.284s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:15 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-6686fb58-cfe7-4b71-aabc-98883bc3961f tempest-VolumesTransfersV355Test-519164085 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:31:15 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-6686fb58-cfe7-4b71-aabc-98883bc3961f tempest-VolumesTransfersV355Test-519164085 None] Deleted volume successfully. Nov 01 12:31:15 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6686fb58-cfe7-4b71-aabc-98883bc3961f tempest-VolumesTransfersV355Test-519164085 None] Lock "cinder-3a3518ca-09e5-4b6a-a314-75d818b07164-delete_volume" released by "delete_volume" :: held 1.581s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:31:17 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-9969dfc8-aa50-4d7a-b22d-533c7fc05b37 req-6d6dad59-93aa-4b31-bb7c-0f662292486b tempest-TestServerVolumeAttachmentScenario-1426975797 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:17 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-9969dfc8-aa50-4d7a-b22d-533c7fc05b37 req-6d6dad59-93aa-4b31-bb7c-0f662292486b tempest-TestServerVolumeAttachmentScenario-1426975797 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:17 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-9969dfc8-aa50-4d7a-b22d-533c7fc05b37 req-6d6dad59-93aa-4b31-bb7c-0f662292486b tempest-TestServerVolumeAttachmentScenario-1426975797 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.035s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:31:17 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-9969dfc8-aa50-4d7a-b22d-533c7fc05b37 req-6d6dad59-93aa-4b31-bb7c-0f662292486b tempest-TestServerVolumeAttachmentScenario-1426975797 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb', 'name': 'volume-f3459e0e-5fcc-4dd3-938b-ae96e2c8d426', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '6ea841ad-74c0-42e1-95ed-14f0213ffe6f', 'enforce_multipath': True} {{(pid=86574) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 12:31:18 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-9969dfc8-aa50-4d7a-b22d-533c7fc05b37 req-6d6dad59-93aa-4b31-bb7c-0f662292486b tempest-TestServerVolumeAttachmentScenario-1426975797 None] attachment_update completed successfully. Nov 01 12:31:18 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-3377504b-91e9-4a55-8ebb-d50d16ca1fca tempest-CreateVolumesFromSnapshotTest-428148873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:31:18 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-3377504b-91e9-4a55-8ebb-d50d16ca1fca tempest-CreateVolumesFromSnapshotTest-428148873 None] Flow 'volume_create_manager' (66aaaf90-3df9-4d2b-b88c-ee2621e2c69b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:31:18 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-3377504b-91e9-4a55-8ebb-d50d16ca1fca tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0fb03fd-a012-48b9-83e8-b25af863df45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:18 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-3377504b-91e9-4a55-8ebb-d50d16ca1fca tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b0fb03fd-a012-48b9-83e8-b25af863df45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:31:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1048909640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66e83dd9-cbec-42d2-8ed2-49a3462f21f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec7c281e39ad466993c906a6d0993299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:31:18Z,use_quota=True,user_id='885360d0f64c4d1abec652869c3c406d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:18 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-3377504b-91e9-4a55-8ebb-d50d16ca1fca tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (032cf2ef-4652-4190-98a9-749cf480d4b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:18 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-3377504b-91e9-4a55-8ebb-d50d16ca1fca tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (032cf2ef-4652-4190-98a9-749cf480d4b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:18 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-3377504b-91e9-4a55-8ebb-d50d16ca1fca tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39cf880a-4df6-4401-9340-317548cdf619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:18 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-3377504b-91e9-4a55-8ebb-d50d16ca1fca tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (39cf880a-4df6-4401-9340-317548cdf619) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '66e83dd9-cbec-42d2-8ed2-49a3462f21f9', 'volume_name': 'volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:18 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-3377504b-91e9-4a55-8ebb-d50d16ca1fca tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e2fd559-6c95-4a78-a793-688ec7492577) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:18 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-3377504b-91e9-4a55-8ebb-d50d16ca1fca tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e2fd559-6c95-4a78-a793-688ec7492577) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:18 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-3377504b-91e9-4a55-8ebb-d50d16ca1fca tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e097df7a-8175-4f25-8e9e-76adbb73a9ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:18 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-3377504b-91e9-4a55-8ebb-d50d16ca1fca tempest-CreateVolumesFromSnapshotTest-428148873 None] Volume 66e83dd9-cbec-42d2-8ed2-49a3462f21f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9', 'volume_size': 1} Nov 01 12:31:18 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-3377504b-91e9-4a55-8ebb-d50d16ca1fca tempest-CreateVolumesFromSnapshotTest-428148873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:18 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-3377504b-91e9-4a55-8ebb-d50d16ca1fca tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:18 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-3377504b-91e9-4a55-8ebb-d50d16ca1fca tempest-CreateVolumesFromSnapshotTest-428148873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:31:18Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1048909640',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=66e83dd9-cbec-42d2-8ed2-49a3462f21f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec7c281e39ad466993c906a6d0993299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:31:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:31:18Z,use_quota=True,user_id='885360d0f64c4d1abec652869c3c406d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:31:18 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-3377504b-91e9-4a55-8ebb-d50d16ca1fca tempest-CreateVolumesFromSnapshotTest-428148873 None] Creating volume 66e83dd9-cbec-42d2-8ed2-49a3462f21f9 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:31:18 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-3377504b-91e9-4a55-8ebb-d50d16ca1fca tempest-CreateVolumesFromSnapshotTest-428148873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:18 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-3377504b-91e9-4a55-8ebb-d50d16ca1fca tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:18 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-3377504b-91e9-4a55-8ebb-d50d16ca1fca tempest-CreateVolumesFromSnapshotTest-428148873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:31:18 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-3377504b-91e9-4a55-8ebb-d50d16ca1fca tempest-CreateVolumesFromSnapshotTest-428148873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:31:18 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-3377504b-91e9-4a55-8ebb-d50d16ca1fca tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:31:18 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-3377504b-91e9-4a55-8ebb-d50d16ca1fca tempest-CreateVolumesFromSnapshotTest-428148873 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:31:18 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-3377504b-91e9-4a55-8ebb-d50d16ca1fca tempest-CreateVolumesFromSnapshotTest-428148873 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:31:18 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3377504b-91e9-4a55-8ebb-d50d16ca1fca tempest-CreateVolumesFromSnapshotTest-428148873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:18 devstack sudo[100666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9 1073741824 Nov 01 12:31:18 devstack sudo[100666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:19 devstack sudo[100666]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:19 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3377504b-91e9-4a55-8ebb-d50d16ca1fca tempest-CreateVolumesFromSnapshotTest-428148873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9 1073741824" returned: 0 in 0.905s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:19 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3377504b-91e9-4a55-8ebb-d50d16ca1fca tempest-CreateVolumesFromSnapshotTest-428148873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:19 devstack sudo[100679]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9 Nov 01 12:31:19 devstack sudo[100679]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:20 devstack sudo[100679]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3377504b-91e9-4a55-8ebb-d50d16ca1fca tempest-CreateVolumesFromSnapshotTest-428148873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9" returned: 0 in 0.429s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:20 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-3377504b-91e9-4a55-8ebb-d50d16ca1fca tempest-CreateVolumesFromSnapshotTest-428148873 None] <== create_volume: return (1474ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:31:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-3377504b-91e9-4a55-8ebb-d50d16ca1fca tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.479s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:31:20 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-3377504b-91e9-4a55-8ebb-d50d16ca1fca tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e097df7a-8175-4f25-8e9e-76adbb73a9ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:20 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-3377504b-91e9-4a55-8ebb-d50d16ca1fca tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11b69434-2c82-4308-b0df-45a4d3b5f689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:20 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-3377504b-91e9-4a55-8ebb-d50d16ca1fca tempest-CreateVolumesFromSnapshotTest-428148873 None] Volume volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9 (66e83dd9-cbec-42d2-8ed2-49a3462f21f9): created successfully Nov 01 12:31:20 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-3377504b-91e9-4a55-8ebb-d50d16ca1fca tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (11b69434-2c82-4308-b0df-45a4d3b5f689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:20 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-3377504b-91e9-4a55-8ebb-d50d16ca1fca tempest-CreateVolumesFromSnapshotTest-428148873 None] Flow 'volume_create_manager' (66aaaf90-3df9-4d2b-b88c-ee2621e2c69b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:31:20 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-3377504b-91e9-4a55-8ebb-d50d16ca1fca tempest-CreateVolumesFromSnapshotTest-428148873 None] Created volume successfully. Nov 01 12:31:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-fbf0b8ae-9991-4224-a0b7-5d8aa4518a3f tempest-CreateVolumesFromSnapshotTest-428148873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-fbf0b8ae-9991-4224-a0b7-5d8aa4518a3f tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:20 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-f14e6f32-a808-4ee8-ace9-0ed0ee2939e3 req-20845406-7bac-411e-83a5-a1f7f7be3182 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Terminate volume connection completed successfully. Nov 01 12:31:20 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-f14e6f32-a808-4ee8-ace9-0ed0ee2939e3 req-20845406-7bac-411e-83a5-a1f7f7be3182 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Deleting attachment 6ea841ad-74c0-42e1-95ed-14f0213ffe6f. {{(pid=86574) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 12:31:20 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-fbf0b8ae-9991-4224-a0b7-5d8aa4518a3f tempest-CreateVolumesFromSnapshotTest-428148873 None] Creating offline snapshot 100715b4-d45e-4221-9f9f-c351f4c4ed29 of volume 66e83dd9-cbec-42d2-8ed2-49a3462f21f9 {{(pid=86574) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:31:21 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[41677447-0468-4722-9ac1-38ed34fbb845]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:31:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-fbf0b8ae-9991-4224-a0b7-5d8aa4518a3f tempest-CreateVolumesFromSnapshotTest-428148873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:21 devstack sudo[100684]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9 Nov 01 12:31:21 devstack sudo[100684]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:21 devstack sudo[100684]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-fbf0b8ae-9991-4224-a0b7-5d8aa4518a3f tempest-CreateVolumesFromSnapshotTest-428148873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9" returned: 0 in 0.629s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-fbf0b8ae-9991-4224-a0b7-5d8aa4518a3f tempest-CreateVolumesFromSnapshotTest-428148873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9.100715b4-d45e-4221-9f9f-c351f4c4ed29 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:21 devstack sudo[100690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9.100715b4-d45e-4221-9f9f-c351f4c4ed29 1G Nov 01 12:31:21 devstack sudo[100690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:21 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-89d34742-19c0-43d7-816b-efd801d547e5 tempest-VolumesActionsTest-573589455 None] Acquiring lock "cinder-79d240f8-e8a1-4d53-8697-972a549fb950" by "attach_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:31:21 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-89d34742-19c0-43d7-816b-efd801d547e5 tempest-VolumesActionsTest-573589455 None] Lock "cinder-79d240f8-e8a1-4d53-8697-972a549fb950" acquired by "attach_volume" :: waited 0.053s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:31:22 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-89d34742-19c0-43d7-816b-efd801d547e5 tempest-VolumesActionsTest-573589455 None] Attaching volume 79d240f8-e8a1-4d53-8697-972a549fb950 to instance 2a130f8d-41d9-49fe-ba6a-d7e49293b784 at mountpoint /dev/vdb on host None. Nov 01 12:31:22 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-89d34742-19c0-43d7-816b-efd801d547e5 tempest-VolumesActionsTest-573589455 None] Attach volume completed successfully. Nov 01 12:31:22 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-89d34742-19c0-43d7-816b-efd801d547e5 tempest-VolumesActionsTest-573589455 None] Lock "cinder-79d240f8-e8a1-4d53-8697-972a549fb950" released by "attach_volume" :: held 0.258s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:31:22 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-2a7bf919-19c8-4355-a110-f48382abba6b tempest-VolumesActionsTest-573589455 None] Acquiring lock "cinder-79d240f8-e8a1-4d53-8697-972a549fb950-detach_volume" by "detach_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:31:22 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-2a7bf919-19c8-4355-a110-f48382abba6b tempest-VolumesActionsTest-573589455 None] Lock "cinder-79d240f8-e8a1-4d53-8697-972a549fb950-detach_volume" acquired by "detach_volume" :: waited 0.033s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:31:22 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-2a7bf919-19c8-4355-a110-f48382abba6b tempest-VolumesActionsTest-573589455 None] Detaching volume 79d240f8-e8a1-4d53-8697-972a549fb950 from instance 2a130f8d-41d9-49fe-ba6a-d7e49293b784. Nov 01 12:31:22 devstack sudo[100690]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-fbf0b8ae-9991-4224-a0b7-5d8aa4518a3f tempest-CreateVolumesFromSnapshotTest-428148873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9.100715b4-d45e-4221-9f9f-c351f4c4ed29 1G" returned: 0 in 0.872s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-fbf0b8ae-9991-4224-a0b7-5d8aa4518a3f tempest-CreateVolumesFromSnapshotTest-428148873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9.100715b4-d45e-4221-9f9f-c351f4c4ed29 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:22 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-2a7bf919-19c8-4355-a110-f48382abba6b tempest-VolumesActionsTest-573589455 None] Detach volume completed successfully. Nov 01 12:31:22 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-2a7bf919-19c8-4355-a110-f48382abba6b tempest-VolumesActionsTest-573589455 None] Lock "cinder-79d240f8-e8a1-4d53-8697-972a549fb950-detach_volume" released by "detach_volume" :: held 0.134s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:31:22 devstack sudo[100695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9.100715b4-d45e-4221-9f9f-c351f4c4ed29 Nov 01 12:31:22 devstack sudo[100695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:22 devstack sudo[100695]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-fbf0b8ae-9991-4224-a0b7-5d8aa4518a3f tempest-CreateVolumesFromSnapshotTest-428148873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9.100715b4-d45e-4221-9f9f-c351f4c4ed29" returned: 0 in 0.452s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:22 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-fbf0b8ae-9991-4224-a0b7-5d8aa4518a3f tempest-CreateVolumesFromSnapshotTest-428148873 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9.100715b4-d45e-4221-9f9f-c351f4c4ed29 is being set with open permissions: ugo+rw Nov 01 12:31:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-fbf0b8ae-9991-4224-a0b7-5d8aa4518a3f tempest-CreateVolumesFromSnapshotTest-428148873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9.100715b4-d45e-4221-9f9f-c351f4c4ed29 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:23 devstack sudo[100728]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9.100715b4-d45e-4221-9f9f-c351f4c4ed29 Nov 01 12:31:23 devstack sudo[100728]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:23 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-d4f5ee57-3b18-4bd9-b067-a22d8729a478 req-e24b66a6-27b8-4b33-9dd6-760e5437aba6 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Terminate volume connection completed successfully. Nov 01 12:31:23 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-d4f5ee57-3b18-4bd9-b067-a22d8729a478 req-e24b66a6-27b8-4b33-9dd6-760e5437aba6 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Deleting attachment 00a2180a-e469-4f78-94d0-6afe36b3c50b. {{(pid=86574) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 12:31:23 devstack sudo[100728]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-fbf0b8ae-9991-4224-a0b7-5d8aa4518a3f tempest-CreateVolumesFromSnapshotTest-428148873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9.100715b4-d45e-4221-9f9f-c351f4c4ed29" returned: 0 in 0.513s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-fbf0b8ae-9991-4224-a0b7-5d8aa4518a3f tempest-CreateVolumesFromSnapshotTest-428148873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:23 devstack sudo[100735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9.info Nov 01 12:31:23 devstack sudo[100735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:24 devstack sudo[100735]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-fbf0b8ae-9991-4224-a0b7-5d8aa4518a3f tempest-CreateVolumesFromSnapshotTest-428148873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9.info" returned: 0 in 0.515s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:24 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-fbf0b8ae-9991-4224-a0b7-5d8aa4518a3f tempest-CreateVolumesFromSnapshotTest-428148873 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9.info is being set with open permissions: ugo+rw Nov 01 12:31:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-fbf0b8ae-9991-4224-a0b7-5d8aa4518a3f tempest-CreateVolumesFromSnapshotTest-428148873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:24 devstack sudo[100754]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9.info Nov 01 12:31:24 devstack sudo[100754]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:24 devstack sudo[100754]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-fbf0b8ae-9991-4224-a0b7-5d8aa4518a3f tempest-CreateVolumesFromSnapshotTest-428148873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9.info" returned: 0 in 0.429s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-fbf0b8ae-9991-4224-a0b7-5d8aa4518a3f tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.603s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:31:24 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-fbf0b8ae-9991-4224-a0b7-5d8aa4518a3f tempest-CreateVolumesFromSnapshotTest-428148873 None] Create snapshot completed successfully Nov 01 12:31:25 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-d70213f1-ce71-47bd-97c7-bdb908665243 tempest-CreateVolumesFromSnapshotTest-428148873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:31:25 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d70213f1-ce71-47bd-97c7-bdb908665243 tempest-CreateVolumesFromSnapshotTest-428148873 None] Flow 'volume_create_manager' (ed2f9946-4eb9-4b84-9d3f-cd44cdb1ed98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:31:25 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d70213f1-ce71-47bd-97c7-bdb908665243 tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0327597d-dd5a-4e6f-afb5-5ca09c7d5b5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:25 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d70213f1-ce71-47bd-97c7-bdb908665243 tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0327597d-dd5a-4e6f-afb5-5ca09c7d5b5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:31:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1824478876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6f3f565-aaef-4f73-bc3b-ff05784cafeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec7c281e39ad466993c906a6d0993299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:31:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:31:26Z,use_quota=True,user_id='885360d0f64c4d1abec652869c3c406d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d70213f1-ce71-47bd-97c7-bdb908665243 tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e98f6aa4-381f-4d56-9dfb-aa6ca1253e5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d70213f1-ce71-47bd-97c7-bdb908665243 tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e98f6aa4-381f-4d56-9dfb-aa6ca1253e5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d70213f1-ce71-47bd-97c7-bdb908665243 tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad11bc62-7d66-4580-9fd0-4301de90f699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d70213f1-ce71-47bd-97c7-bdb908665243 tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad11bc62-7d66-4580-9fd0-4301de90f699) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c6f3f565-aaef-4f73-bc3b-ff05784cafeb', 'volume_name': 'volume-c6f3f565-aaef-4f73-bc3b-ff05784cafeb', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d70213f1-ce71-47bd-97c7-bdb908665243 tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3435f4c-0703-4d2f-b3c8-6102244b1cd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d70213f1-ce71-47bd-97c7-bdb908665243 tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3435f4c-0703-4d2f-b3c8-6102244b1cd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d70213f1-ce71-47bd-97c7-bdb908665243 tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b20f0ded-fa6b-42f1-9485-c2c72cb57934) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:26 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-d70213f1-ce71-47bd-97c7-bdb908665243 tempest-CreateVolumesFromSnapshotTest-428148873 None] Volume c6f3f565-aaef-4f73-bc3b-ff05784cafeb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c6f3f565-aaef-4f73-bc3b-ff05784cafeb', 'volume_size': 1} Nov 01 12:31:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d70213f1-ce71-47bd-97c7-bdb908665243 tempest-CreateVolumesFromSnapshotTest-428148873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d70213f1-ce71-47bd-97c7-bdb908665243 tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:26 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d70213f1-ce71-47bd-97c7-bdb908665243 tempest-CreateVolumesFromSnapshotTest-428148873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:31:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1824478876',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c6f3f565-aaef-4f73-bc3b-ff05784cafeb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec7c281e39ad466993c906a6d0993299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:31:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:31:26Z,use_quota=True,user_id='885360d0f64c4d1abec652869c3c406d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:31:26 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-d70213f1-ce71-47bd-97c7-bdb908665243 tempest-CreateVolumesFromSnapshotTest-428148873 None] Creating volume c6f3f565-aaef-4f73-bc3b-ff05784cafeb {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:31:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d70213f1-ce71-47bd-97c7-bdb908665243 tempest-CreateVolumesFromSnapshotTest-428148873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d70213f1-ce71-47bd-97c7-bdb908665243 tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:26 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d70213f1-ce71-47bd-97c7-bdb908665243 tempest-CreateVolumesFromSnapshotTest-428148873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:31:26 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d70213f1-ce71-47bd-97c7-bdb908665243 tempest-CreateVolumesFromSnapshotTest-428148873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:31:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d70213f1-ce71-47bd-97c7-bdb908665243 tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:31:26 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d70213f1-ce71-47bd-97c7-bdb908665243 tempest-CreateVolumesFromSnapshotTest-428148873 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:31:26 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-d70213f1-ce71-47bd-97c7-bdb908665243 tempest-CreateVolumesFromSnapshotTest-428148873 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:31:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d70213f1-ce71-47bd-97c7-bdb908665243 tempest-CreateVolumesFromSnapshotTest-428148873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c6f3f565-aaef-4f73-bc3b-ff05784cafeb 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:26 devstack sudo[100779]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c6f3f565-aaef-4f73-bc3b-ff05784cafeb 1073741824 Nov 01 12:31:26 devstack sudo[100779]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:26 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-09cde827-5d61-4b37-a11b-09995a1f7d49 tempest-CreateVolumesFromSnapshotTest-428148873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:31:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-09cde827-5d61-4b37-a11b-09995a1f7d49 tempest-CreateVolumesFromSnapshotTest-428148873 None] Flow 'volume_create_manager' (0dc8cf33-860e-4191-ba36-5f32960a087b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:31:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-09cde827-5d61-4b37-a11b-09995a1f7d49 tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0c56012-6e08-4feb-9d90-aaa80aa7d8aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-09cde827-5d61-4b37-a11b-09995a1f7d49 tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0c56012-6e08-4feb-9d90-aaa80aa7d8aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:31:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-423525491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cee0b12e-ecd5-40c8-93d6-664953e34c96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec7c281e39ad466993c906a6d0993299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:31:27Z,use_quota=True,user_id='885360d0f64c4d1abec652869c3c406d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-09cde827-5d61-4b37-a11b-09995a1f7d49 tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (660fd1e7-5764-4b40-975f-3aa840189987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-09cde827-5d61-4b37-a11b-09995a1f7d49 tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (660fd1e7-5764-4b40-975f-3aa840189987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-09cde827-5d61-4b37-a11b-09995a1f7d49 tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2282675d-25d7-4ca9-9a9e-20dfb208e2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-09cde827-5d61-4b37-a11b-09995a1f7d49 tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2282675d-25d7-4ca9-9a9e-20dfb208e2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cee0b12e-ecd5-40c8-93d6-664953e34c96', 'volume_name': 'volume-cee0b12e-ecd5-40c8-93d6-664953e34c96', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-09cde827-5d61-4b37-a11b-09995a1f7d49 tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6890c08f-66dc-41ec-af4f-cadf6133ebdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-09cde827-5d61-4b37-a11b-09995a1f7d49 tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6890c08f-66dc-41ec-af4f-cadf6133ebdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-09cde827-5d61-4b37-a11b-09995a1f7d49 tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe20ca96-bbed-4de9-9bd9-a1c23092706a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:26 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-09cde827-5d61-4b37-a11b-09995a1f7d49 tempest-CreateVolumesFromSnapshotTest-428148873 None] Volume cee0b12e-ecd5-40c8-93d6-664953e34c96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cee0b12e-ecd5-40c8-93d6-664953e34c96', 'volume_size': 1} Nov 01 12:31:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-09cde827-5d61-4b37-a11b-09995a1f7d49 tempest-CreateVolumesFromSnapshotTest-428148873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:26 devstack sudo[100779]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d70213f1-ce71-47bd-97c7-bdb908665243 tempest-CreateVolumesFromSnapshotTest-428148873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c6f3f565-aaef-4f73-bc3b-ff05784cafeb 1073741824" returned: 0 in 0.840s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d70213f1-ce71-47bd-97c7-bdb908665243 tempest-CreateVolumesFromSnapshotTest-428148873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c6f3f565-aaef-4f73-bc3b-ff05784cafeb {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:27 devstack sudo[100785]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c6f3f565-aaef-4f73-bc3b-ff05784cafeb Nov 01 12:31:27 devstack sudo[100785]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:27 devstack sudo[100785]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d70213f1-ce71-47bd-97c7-bdb908665243 tempest-CreateVolumesFromSnapshotTest-428148873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c6f3f565-aaef-4f73-bc3b-ff05784cafeb" returned: 0 in 0.514s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:27 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d70213f1-ce71-47bd-97c7-bdb908665243 tempest-CreateVolumesFromSnapshotTest-428148873 None] <== create_volume: return (1450ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:31:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d70213f1-ce71-47bd-97c7-bdb908665243 tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.454s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:31:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-09cde827-5d61-4b37-a11b-09995a1f7d49 tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.652s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:27 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-09cde827-5d61-4b37-a11b-09995a1f7d49 tempest-CreateVolumesFromSnapshotTest-428148873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:31:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-423525491',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cee0b12e-ecd5-40c8-93d6-664953e34c96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec7c281e39ad466993c906a6d0993299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:31:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:31:27Z,use_quota=True,user_id='885360d0f64c4d1abec652869c3c406d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:31:27 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-09cde827-5d61-4b37-a11b-09995a1f7d49 tempest-CreateVolumesFromSnapshotTest-428148873 None] Creating volume cee0b12e-ecd5-40c8-93d6-664953e34c96 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:31:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-09cde827-5d61-4b37-a11b-09995a1f7d49 tempest-CreateVolumesFromSnapshotTest-428148873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-09cde827-5d61-4b37-a11b-09995a1f7d49 tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:27 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-09cde827-5d61-4b37-a11b-09995a1f7d49 tempest-CreateVolumesFromSnapshotTest-428148873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:31:27 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-09cde827-5d61-4b37-a11b-09995a1f7d49 tempest-CreateVolumesFromSnapshotTest-428148873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:31:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-09cde827-5d61-4b37-a11b-09995a1f7d49 tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:31:27 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-09cde827-5d61-4b37-a11b-09995a1f7d49 tempest-CreateVolumesFromSnapshotTest-428148873 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:31:27 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-09cde827-5d61-4b37-a11b-09995a1f7d49 tempest-CreateVolumesFromSnapshotTest-428148873 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:31:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-09cde827-5d61-4b37-a11b-09995a1f7d49 tempest-CreateVolumesFromSnapshotTest-428148873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cee0b12e-ecd5-40c8-93d6-664953e34c96 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:27 devstack sudo[100788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cee0b12e-ecd5-40c8-93d6-664953e34c96 1073741824 Nov 01 12:31:27 devstack sudo[100788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d70213f1-ce71-47bd-97c7-bdb908665243 tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b20f0ded-fa6b-42f1-9485-c2c72cb57934) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c6f3f565-aaef-4f73-bc3b-ff05784cafeb', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d70213f1-ce71-47bd-97c7-bdb908665243 tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b99e191-ad15-4cb2-ae8d-d7e974f4628d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:27 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-d70213f1-ce71-47bd-97c7-bdb908665243 tempest-CreateVolumesFromSnapshotTest-428148873 None] Volume volume-c6f3f565-aaef-4f73-bc3b-ff05784cafeb (c6f3f565-aaef-4f73-bc3b-ff05784cafeb): created successfully Nov 01 12:31:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d70213f1-ce71-47bd-97c7-bdb908665243 tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b99e191-ad15-4cb2-ae8d-d7e974f4628d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d70213f1-ce71-47bd-97c7-bdb908665243 tempest-CreateVolumesFromSnapshotTest-428148873 None] Flow 'volume_create_manager' (ed2f9946-4eb9-4b84-9d3f-cd44cdb1ed98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:31:27 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-896b2144-0c24-4148-bf56-c60ce20bbfc3 tempest-CreateVolumesFromSnapshotTest-428148873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:31:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-896b2144-0c24-4148-bf56-c60ce20bbfc3 tempest-CreateVolumesFromSnapshotTest-428148873 None] Flow 'volume_create_manager' (0148c573-b622-4d07-afc1-c98d130371d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:31:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-896b2144-0c24-4148-bf56-c60ce20bbfc3 tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b0c8265-4704-4a7b-9a54-4b20f3703e52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:27 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-d70213f1-ce71-47bd-97c7-bdb908665243 tempest-CreateVolumesFromSnapshotTest-428148873 None] Created volume successfully. Nov 01 12:31:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-896b2144-0c24-4148-bf56-c60ce20bbfc3 tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4b0c8265-4704-4a7b-9a54-4b20f3703e52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:31:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1959305533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19550827-d601-40cd-a965-62e6a9f41c85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec7c281e39ad466993c906a6d0993299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:31:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:31:28Z,use_quota=True,user_id='885360d0f64c4d1abec652869c3c406d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-896b2144-0c24-4148-bf56-c60ce20bbfc3 tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a29f0364-445d-4d33-9093-6d55baeaa827) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-896b2144-0c24-4148-bf56-c60ce20bbfc3 tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a29f0364-445d-4d33-9093-6d55baeaa827) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-896b2144-0c24-4148-bf56-c60ce20bbfc3 tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (810ce342-621a-47e4-bb5a-adaacb14c006) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-896b2144-0c24-4148-bf56-c60ce20bbfc3 tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (810ce342-621a-47e4-bb5a-adaacb14c006) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19550827-d601-40cd-a965-62e6a9f41c85', 'volume_name': 'volume-19550827-d601-40cd-a965-62e6a9f41c85', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-896b2144-0c24-4148-bf56-c60ce20bbfc3 tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (063962f0-ba3c-4b1f-90d1-8cf03361702b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-896b2144-0c24-4148-bf56-c60ce20bbfc3 tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (063962f0-ba3c-4b1f-90d1-8cf03361702b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-896b2144-0c24-4148-bf56-c60ce20bbfc3 tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (142821ac-5f6e-48d5-b1a4-f5120ebed782) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:27 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-896b2144-0c24-4148-bf56-c60ce20bbfc3 tempest-CreateVolumesFromSnapshotTest-428148873 None] Volume 19550827-d601-40cd-a965-62e6a9f41c85: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19550827-d601-40cd-a965-62e6a9f41c85', 'volume_size': 1} Nov 01 12:31:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-896b2144-0c24-4148-bf56-c60ce20bbfc3 tempest-CreateVolumesFromSnapshotTest-428148873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:28 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-9803d4c9-03c2-481b-b784-ce130d9743af tempest-CreateVolumesFromSnapshotTest-428148873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:31:28 devstack sudo[100788]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9803d4c9-03c2-481b-b784-ce130d9743af tempest-CreateVolumesFromSnapshotTest-428148873 None] Flow 'volume_create_manager' (38dde6b3-cae4-4afb-b433-ddfc7c423c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:31:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9803d4c9-03c2-481b-b784-ce130d9743af tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92f34490-d354-4b6f-989b-ea2021e9c028) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-09cde827-5d61-4b37-a11b-09995a1f7d49 tempest-CreateVolumesFromSnapshotTest-428148873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cee0b12e-ecd5-40c8-93d6-664953e34c96 1073741824" returned: 0 in 0.907s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9803d4c9-03c2-481b-b784-ce130d9743af tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (92f34490-d354-4b6f-989b-ea2021e9c028) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1180137154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b40e77e6-1a42-457c-84aa-e8e58e4f3312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec7c281e39ad466993c906a6d0993299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:31:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:31:28Z,use_quota=True,user_id='885360d0f64c4d1abec652869c3c406d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9803d4c9-03c2-481b-b784-ce130d9743af tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a12fb29-1f54-43ee-bde1-405d2bb8138d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9803d4c9-03c2-481b-b784-ce130d9743af tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3a12fb29-1f54-43ee-bde1-405d2bb8138d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9803d4c9-03c2-481b-b784-ce130d9743af tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e95bd8-2c20-48f6-b104-3bf69abfa480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9803d4c9-03c2-481b-b784-ce130d9743af tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e95bd8-2c20-48f6-b104-3bf69abfa480) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b40e77e6-1a42-457c-84aa-e8e58e4f3312', 'volume_name': 'volume-b40e77e6-1a42-457c-84aa-e8e58e4f3312', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9803d4c9-03c2-481b-b784-ce130d9743af tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d04d8d05-fb5e-4d0f-ba3b-15229d6c4488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9803d4c9-03c2-481b-b784-ce130d9743af tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d04d8d05-fb5e-4d0f-ba3b-15229d6c4488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9803d4c9-03c2-481b-b784-ce130d9743af tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e7b69be-2f5c-4b01-9fa3-336624e9b712) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:28 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-9803d4c9-03c2-481b-b784-ce130d9743af tempest-CreateVolumesFromSnapshotTest-428148873 None] Volume b40e77e6-1a42-457c-84aa-e8e58e4f3312: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b40e77e6-1a42-457c-84aa-e8e58e4f3312', 'volume_size': 1} Nov 01 12:31:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-9803d4c9-03c2-481b-b784-ce130d9743af tempest-CreateVolumesFromSnapshotTest-428148873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-09cde827-5d61-4b37-a11b-09995a1f7d49 tempest-CreateVolumesFromSnapshotTest-428148873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cee0b12e-ecd5-40c8-93d6-664953e34c96 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:28 devstack sudo[100798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cee0b12e-ecd5-40c8-93d6-664953e34c96 Nov 01 12:31:28 devstack sudo[100798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:28 devstack sudo[100798]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-09cde827-5d61-4b37-a11b-09995a1f7d49 tempest-CreateVolumesFromSnapshotTest-428148873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cee0b12e-ecd5-40c8-93d6-664953e34c96" returned: 0 in 0.350s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:28 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-09cde827-5d61-4b37-a11b-09995a1f7d49 tempest-CreateVolumesFromSnapshotTest-428148873 None] <== create_volume: return (1400ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:31:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-09cde827-5d61-4b37-a11b-09995a1f7d49 tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.407s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:31:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-896b2144-0c24-4148-bf56-c60ce20bbfc3 tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.079s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:28 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-896b2144-0c24-4148-bf56-c60ce20bbfc3 tempest-CreateVolumesFromSnapshotTest-428148873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:31:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1959305533',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19550827-d601-40cd-a965-62e6a9f41c85,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec7c281e39ad466993c906a6d0993299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:31:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:31:28Z,use_quota=True,user_id='885360d0f64c4d1abec652869c3c406d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:31:28 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-896b2144-0c24-4148-bf56-c60ce20bbfc3 tempest-CreateVolumesFromSnapshotTest-428148873 None] Creating volume 19550827-d601-40cd-a965-62e6a9f41c85 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:31:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-896b2144-0c24-4148-bf56-c60ce20bbfc3 tempest-CreateVolumesFromSnapshotTest-428148873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-896b2144-0c24-4148-bf56-c60ce20bbfc3 tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:28 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-896b2144-0c24-4148-bf56-c60ce20bbfc3 tempest-CreateVolumesFromSnapshotTest-428148873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:31:28 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-896b2144-0c24-4148-bf56-c60ce20bbfc3 tempest-CreateVolumesFromSnapshotTest-428148873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:31:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-896b2144-0c24-4148-bf56-c60ce20bbfc3 tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:31:28 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-896b2144-0c24-4148-bf56-c60ce20bbfc3 tempest-CreateVolumesFromSnapshotTest-428148873 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:31:28 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-896b2144-0c24-4148-bf56-c60ce20bbfc3 tempest-CreateVolumesFromSnapshotTest-428148873 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:31:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-896b2144-0c24-4148-bf56-c60ce20bbfc3 tempest-CreateVolumesFromSnapshotTest-428148873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-19550827-d601-40cd-a965-62e6a9f41c85 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:28 devstack sudo[100801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-19550827-d601-40cd-a965-62e6a9f41c85 1073741824 Nov 01 12:31:28 devstack sudo[100801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-09cde827-5d61-4b37-a11b-09995a1f7d49 tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fe20ca96-bbed-4de9-9bd9-a1c23092706a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cee0b12e-ecd5-40c8-93d6-664953e34c96', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-09cde827-5d61-4b37-a11b-09995a1f7d49 tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06945303-1bf1-4416-87a9-315b539446c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:29 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-208ebfdd-7107-4f0f-bf52-7f5a8e059ecf tempest-CreateVolumesFromSnapshotTest-428148873 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:31:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-208ebfdd-7107-4f0f-bf52-7f5a8e059ecf tempest-CreateVolumesFromSnapshotTest-428148873 None] Flow 'volume_create_manager' (bc55560f-23c2-4f6f-bb5c-27601e988484) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:31:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-208ebfdd-7107-4f0f-bf52-7f5a8e059ecf tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71a2b279-b764-4a1a-9b3e-a85a99809aeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-208ebfdd-7107-4f0f-bf52-7f5a8e059ecf tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (71a2b279-b764-4a1a-9b3e-a85a99809aeb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1692081675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1287bf34-f650-41ca-a1e4-4d06bad610d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec7c281e39ad466993c906a6d0993299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:31:29Z,use_quota=True,user_id='885360d0f64c4d1abec652869c3c406d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-208ebfdd-7107-4f0f-bf52-7f5a8e059ecf tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88e63cf0-30d6-4860-a41f-0bd37a976f90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-208ebfdd-7107-4f0f-bf52-7f5a8e059ecf tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (88e63cf0-30d6-4860-a41f-0bd37a976f90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-208ebfdd-7107-4f0f-bf52-7f5a8e059ecf tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f80364a-b4a1-49ce-8654-a230432bae1c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-208ebfdd-7107-4f0f-bf52-7f5a8e059ecf tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f80364a-b4a1-49ce-8654-a230432bae1c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1287bf34-f650-41ca-a1e4-4d06bad610d0', 'volume_name': 'volume-1287bf34-f650-41ca-a1e4-4d06bad610d0', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-208ebfdd-7107-4f0f-bf52-7f5a8e059ecf tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cf557b0-648a-4745-9bdf-a95c8090463e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-208ebfdd-7107-4f0f-bf52-7f5a8e059ecf tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7cf557b0-648a-4745-9bdf-a95c8090463e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-208ebfdd-7107-4f0f-bf52-7f5a8e059ecf tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8083f029-b39a-452e-b6bb-39e0e0e150df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:29 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-208ebfdd-7107-4f0f-bf52-7f5a8e059ecf tempest-CreateVolumesFromSnapshotTest-428148873 None] Volume 1287bf34-f650-41ca-a1e4-4d06bad610d0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1287bf34-f650-41ca-a1e4-4d06bad610d0', 'volume_size': 1} Nov 01 12:31:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-208ebfdd-7107-4f0f-bf52-7f5a8e059ecf tempest-CreateVolumesFromSnapshotTest-428148873 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:29 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-09cde827-5d61-4b37-a11b-09995a1f7d49 tempest-CreateVolumesFromSnapshotTest-428148873 None] Volume volume-cee0b12e-ecd5-40c8-93d6-664953e34c96 (cee0b12e-ecd5-40c8-93d6-664953e34c96): created successfully Nov 01 12:31:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-09cde827-5d61-4b37-a11b-09995a1f7d49 tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (06945303-1bf1-4416-87a9-315b539446c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-09cde827-5d61-4b37-a11b-09995a1f7d49 tempest-CreateVolumesFromSnapshotTest-428148873 None] Flow 'volume_create_manager' (0dc8cf33-860e-4191-ba36-5f32960a087b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:31:29 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-09cde827-5d61-4b37-a11b-09995a1f7d49 tempest-CreateVolumesFromSnapshotTest-428148873 None] Created volume successfully. Nov 01 12:31:29 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-34b2eb37-1aa3-4cb5-8c25-ae49f26a4402 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Acquiring lock "cinder-f3459e0e-5fcc-4dd3-938b-ae96e2c8d426-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:31:29 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-34b2eb37-1aa3-4cb5-8c25-ae49f26a4402 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Lock "cinder-f3459e0e-5fcc-4dd3-938b-ae96e2c8d426-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:31:29 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-34b2eb37-1aa3-4cb5-8c25-ae49f26a4402 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Acquiring lock "cinder-quobyte-f3459e0e-5fcc-4dd3-938b-ae96e2c8d426" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:31:29 devstack sudo[100801]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-896b2144-0c24-4148-bf56-c60ce20bbfc3 tempest-CreateVolumesFromSnapshotTest-428148873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-19550827-d601-40cd-a965-62e6a9f41c85 1073741824" returned: 0 in 0.737s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:29 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-34b2eb37-1aa3-4cb5-8c25-ae49f26a4402 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Lock "cinder-quobyte-f3459e0e-5fcc-4dd3-938b-ae96e2c8d426" acquired by "delete_volume" :: waited 0.031s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:31:29 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5a2e06a-3730-4d9b-bbca-924b6c8037f1]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:31:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-34b2eb37-1aa3-4cb5-8c25-ae49f26a4402 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f3459e0e-5fcc-4dd3-938b-ae96e2c8d426 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-896b2144-0c24-4148-bf56-c60ce20bbfc3 tempest-CreateVolumesFromSnapshotTest-428148873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-19550827-d601-40cd-a965-62e6a9f41c85 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:29 devstack sudo[100807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-19550827-d601-40cd-a965-62e6a9f41c85 Nov 01 12:31:29 devstack sudo[100807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:29 devstack sudo[100806]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f3459e0e-5fcc-4dd3-938b-ae96e2c8d426 Nov 01 12:31:29 devstack sudo[100806]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:30 devstack sudo[100807]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-896b2144-0c24-4148-bf56-c60ce20bbfc3 tempest-CreateVolumesFromSnapshotTest-428148873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-19550827-d601-40cd-a965-62e6a9f41c85" returned: 0 in 0.348s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:30 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-896b2144-0c24-4148-bf56-c60ce20bbfc3 tempest-CreateVolumesFromSnapshotTest-428148873 None] <== create_volume: return (1179ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:31:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-896b2144-0c24-4148-bf56-c60ce20bbfc3 tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.182s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:31:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-9803d4c9-03c2-481b-b784-ce130d9743af tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.603s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:30 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-9803d4c9-03c2-481b-b784-ce130d9743af tempest-CreateVolumesFromSnapshotTest-428148873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1180137154',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b40e77e6-1a42-457c-84aa-e8e58e4f3312,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec7c281e39ad466993c906a6d0993299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:31:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:31:28Z,use_quota=True,user_id='885360d0f64c4d1abec652869c3c406d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:31:30 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-9803d4c9-03c2-481b-b784-ce130d9743af tempest-CreateVolumesFromSnapshotTest-428148873 None] Creating volume b40e77e6-1a42-457c-84aa-e8e58e4f3312 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:31:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-9803d4c9-03c2-481b-b784-ce130d9743af tempest-CreateVolumesFromSnapshotTest-428148873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-9803d4c9-03c2-481b-b784-ce130d9743af tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:30 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-9803d4c9-03c2-481b-b784-ce130d9743af tempest-CreateVolumesFromSnapshotTest-428148873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:31:30 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-9803d4c9-03c2-481b-b784-ce130d9743af tempest-CreateVolumesFromSnapshotTest-428148873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:31:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-9803d4c9-03c2-481b-b784-ce130d9743af tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:31:30 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-9803d4c9-03c2-481b-b784-ce130d9743af tempest-CreateVolumesFromSnapshotTest-428148873 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:31:30 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-9803d4c9-03c2-481b-b784-ce130d9743af tempest-CreateVolumesFromSnapshotTest-428148873 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:31:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9803d4c9-03c2-481b-b784-ce130d9743af tempest-CreateVolumesFromSnapshotTest-428148873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b40e77e6-1a42-457c-84aa-e8e58e4f3312 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:30 devstack sudo[100811]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b40e77e6-1a42-457c-84aa-e8e58e4f3312 1073741824 Nov 01 12:31:30 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-896b2144-0c24-4148-bf56-c60ce20bbfc3 tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (142821ac-5f6e-48d5-b1a4-f5120ebed782) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19550827-d601-40cd-a965-62e6a9f41c85', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:30 devstack sudo[100811]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:30 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-896b2144-0c24-4148-bf56-c60ce20bbfc3 tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c132b49-b6df-4bab-a853-8f60b6defe4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:30 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-896b2144-0c24-4148-bf56-c60ce20bbfc3 tempest-CreateVolumesFromSnapshotTest-428148873 None] Volume volume-19550827-d601-40cd-a965-62e6a9f41c85 (19550827-d601-40cd-a965-62e6a9f41c85): created successfully Nov 01 12:31:30 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-896b2144-0c24-4148-bf56-c60ce20bbfc3 tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6c132b49-b6df-4bab-a853-8f60b6defe4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:30 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-896b2144-0c24-4148-bf56-c60ce20bbfc3 tempest-CreateVolumesFromSnapshotTest-428148873 None] Flow 'volume_create_manager' (0148c573-b622-4d07-afc1-c98d130371d6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:31:30 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-896b2144-0c24-4148-bf56-c60ce20bbfc3 tempest-CreateVolumesFromSnapshotTest-428148873 None] Created volume successfully. Nov 01 12:31:30 devstack sudo[100806]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-34b2eb37-1aa3-4cb5-8c25-ae49f26a4402 tempest-TestServerVolumeAttachmentScenario-1426975797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f3459e0e-5fcc-4dd3-938b-ae96e2c8d426" returned: 0 in 0.586s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-34b2eb37-1aa3-4cb5-8c25-ae49f26a4402 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f3459e0e-5fcc-4dd3-938b-ae96e2c8d426 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:30 devstack sudo[100817]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f3459e0e-5fcc-4dd3-938b-ae96e2c8d426 Nov 01 12:31:30 devstack sudo[100817]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:30 devstack sudo[100817]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-34b2eb37-1aa3-4cb5-8c25-ae49f26a4402 tempest-TestServerVolumeAttachmentScenario-1426975797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f3459e0e-5fcc-4dd3-938b-ae96e2c8d426" returned: 0 in 0.482s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:30 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-34b2eb37-1aa3-4cb5-8c25-ae49f26a4402 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Lock "cinder-quobyte-f3459e0e-5fcc-4dd3-938b-ae96e2c8d426" released by "delete_volume" :: held 1.138s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:31:30 devstack sudo[100811]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9803d4c9-03c2-481b-b784-ce130d9743af tempest-CreateVolumesFromSnapshotTest-428148873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b40e77e6-1a42-457c-84aa-e8e58e4f3312 1073741824" returned: 0 in 0.741s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:30 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-34b2eb37-1aa3-4cb5-8c25-ae49f26a4402 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Created reservations ['97feb773-22f1-4fdd-8f26-7f7be519c920', '3428214f-f4b1-42fa-bc1d-dfa8df9d7b2f', '34fee37d-7c5f-4f22-9733-fcde8477a78a', 'cec87924-db2e-4f6d-8d0b-aaffced98ce6'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:31:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9803d4c9-03c2-481b-b784-ce130d9743af tempest-CreateVolumesFromSnapshotTest-428148873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b40e77e6-1a42-457c-84aa-e8e58e4f3312 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:30 devstack sudo[100836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b40e77e6-1a42-457c-84aa-e8e58e4f3312 Nov 01 12:31:30 devstack sudo[100836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-34b2eb37-1aa3-4cb5-8c25-ae49f26a4402 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-34b2eb37-1aa3-4cb5-8c25-ae49f26a4402 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:31 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-34b2eb37-1aa3-4cb5-8c25-ae49f26a4402 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:31:31 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-34b2eb37-1aa3-4cb5-8c25-ae49f26a4402 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:31:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-34b2eb37-1aa3-4cb5-8c25-ae49f26a4402 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:31:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-34b2eb37-1aa3-4cb5-8c25-ae49f26a4402 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:31 devstack sudo[100841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:31:31 devstack sudo[100841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:31 devstack sudo[100836]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9803d4c9-03c2-481b-b784-ce130d9743af tempest-CreateVolumesFromSnapshotTest-428148873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b40e77e6-1a42-457c-84aa-e8e58e4f3312" returned: 0 in 0.602s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:31 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-9803d4c9-03c2-481b-b784-ce130d9743af tempest-CreateVolumesFromSnapshotTest-428148873 None] <== create_volume: return (1413ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:31:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-9803d4c9-03c2-481b-b784-ce130d9743af tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.417s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:31:31 devstack sudo[100841]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-208ebfdd-7107-4f0f-bf52-7f5a8e059ecf tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.396s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:31 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-208ebfdd-7107-4f0f-bf52-7f5a8e059ecf tempest-CreateVolumesFromSnapshotTest-428148873 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:31:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1692081675',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1287bf34-f650-41ca-a1e4-4d06bad610d0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ec7c281e39ad466993c906a6d0993299',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:31:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:31:29Z,use_quota=True,user_id='885360d0f64c4d1abec652869c3c406d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:31:31 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-208ebfdd-7107-4f0f-bf52-7f5a8e059ecf tempest-CreateVolumesFromSnapshotTest-428148873 None] Creating volume 1287bf34-f650-41ca-a1e4-4d06bad610d0 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:31:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-208ebfdd-7107-4f0f-bf52-7f5a8e059ecf tempest-CreateVolumesFromSnapshotTest-428148873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-208ebfdd-7107-4f0f-bf52-7f5a8e059ecf tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:31 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-208ebfdd-7107-4f0f-bf52-7f5a8e059ecf tempest-CreateVolumesFromSnapshotTest-428148873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:31:31 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-208ebfdd-7107-4f0f-bf52-7f5a8e059ecf tempest-CreateVolumesFromSnapshotTest-428148873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:31:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-208ebfdd-7107-4f0f-bf52-7f5a8e059ecf tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:31:31 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-208ebfdd-7107-4f0f-bf52-7f5a8e059ecf tempest-CreateVolumesFromSnapshotTest-428148873 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:31:31 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-208ebfdd-7107-4f0f-bf52-7f5a8e059ecf tempest-CreateVolumesFromSnapshotTest-428148873 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:31:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-208ebfdd-7107-4f0f-bf52-7f5a8e059ecf tempest-CreateVolumesFromSnapshotTest-428148873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1287bf34-f650-41ca-a1e4-4d06bad610d0 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-34b2eb37-1aa3-4cb5-8c25-ae49f26a4402 tempest-TestServerVolumeAttachmentScenario-1426975797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.407s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:31 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-34b2eb37-1aa3-4cb5-8c25-ae49f26a4402 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:31:31 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-34b2eb37-1aa3-4cb5-8c25-ae49f26a4402 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Deleted volume successfully. Nov 01 12:31:31 devstack sudo[100845]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1287bf34-f650-41ca-a1e4-4d06bad610d0 1073741824 Nov 01 12:31:31 devstack sudo[100845]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:31 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9803d4c9-03c2-481b-b784-ce130d9743af tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e7b69be-2f5c-4b01-9fa3-336624e9b712) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b40e77e6-1a42-457c-84aa-e8e58e4f3312', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:31 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9803d4c9-03c2-481b-b784-ce130d9743af tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eeb3eb1-17c2-4663-ae0d-5dc454e7baa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:31 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-34b2eb37-1aa3-4cb5-8c25-ae49f26a4402 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Lock "cinder-f3459e0e-5fcc-4dd3-938b-ae96e2c8d426-delete_volume" released by "delete_volume" :: held 2.003s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:31:31 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-9803d4c9-03c2-481b-b784-ce130d9743af tempest-CreateVolumesFromSnapshotTest-428148873 None] Volume volume-b40e77e6-1a42-457c-84aa-e8e58e4f3312 (b40e77e6-1a42-457c-84aa-e8e58e4f3312): created successfully Nov 01 12:31:31 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9803d4c9-03c2-481b-b784-ce130d9743af tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9eeb3eb1-17c2-4663-ae0d-5dc454e7baa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:31 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9803d4c9-03c2-481b-b784-ce130d9743af tempest-CreateVolumesFromSnapshotTest-428148873 None] Flow 'volume_create_manager' (38dde6b3-cae4-4afb-b433-ddfc7c423c3e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:31:31 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-9803d4c9-03c2-481b-b784-ce130d9743af tempest-CreateVolumesFromSnapshotTest-428148873 None] Created volume successfully. Nov 01 12:31:31 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-b01f7946-d305-431b-bdad-0d76dc4535a2 tempest-VolumesTransfersV357Test-437108577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:31:31 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b01f7946-d305-431b-bdad-0d76dc4535a2 tempest-VolumesTransfersV357Test-437108577 None] Flow 'volume_create_manager' (8e42b180-23cb-4f47-b3ed-255068725ebb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:31:31 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b01f7946-d305-431b-bdad-0d76dc4535a2 tempest-VolumesTransfersV357Test-437108577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60b95510-a124-4ddb-890d-70a4dcd09ce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:31 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b01f7946-d305-431b-bdad-0d76dc4535a2 tempest-VolumesTransfersV357Test-437108577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (60b95510-a124-4ddb-890d-70a4dcd09ce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1658407236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=828bf06c-6f0a-4d91-b592-3d2912f1279f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99fada30d6d744ac95effff0976a23c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:31:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:31:32Z,use_quota=True,user_id='cece74a6b4e2466894a17a0701750f8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:31 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b01f7946-d305-431b-bdad-0d76dc4535a2 tempest-VolumesTransfersV357Test-437108577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82d5bb92-59ad-4d07-92a3-bbf672af0ffa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:31 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b01f7946-d305-431b-bdad-0d76dc4535a2 tempest-VolumesTransfersV357Test-437108577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82d5bb92-59ad-4d07-92a3-bbf672af0ffa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:31 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b01f7946-d305-431b-bdad-0d76dc4535a2 tempest-VolumesTransfersV357Test-437108577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60ab3415-4321-49d1-aa50-0faa702a5aca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:31 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b01f7946-d305-431b-bdad-0d76dc4535a2 tempest-VolumesTransfersV357Test-437108577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (60ab3415-4321-49d1-aa50-0faa702a5aca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '828bf06c-6f0a-4d91-b592-3d2912f1279f', 'volume_name': 'volume-828bf06c-6f0a-4d91-b592-3d2912f1279f', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:31 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b01f7946-d305-431b-bdad-0d76dc4535a2 tempest-VolumesTransfersV357Test-437108577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (284cd47e-5761-4426-a936-1fecd8792a79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:31 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b01f7946-d305-431b-bdad-0d76dc4535a2 tempest-VolumesTransfersV357Test-437108577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (284cd47e-5761-4426-a936-1fecd8792a79) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:31 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b01f7946-d305-431b-bdad-0d76dc4535a2 tempest-VolumesTransfersV357Test-437108577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce331438-3d04-4d6d-b381-8181c877c044) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:31 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-b01f7946-d305-431b-bdad-0d76dc4535a2 tempest-VolumesTransfersV357Test-437108577 None] Volume 828bf06c-6f0a-4d91-b592-3d2912f1279f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-828bf06c-6f0a-4d91-b592-3d2912f1279f', 'volume_size': 1} Nov 01 12:31:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b01f7946-d305-431b-bdad-0d76dc4535a2 tempest-VolumesTransfersV357Test-437108577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:31 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-5d13ad7a-2cd7-4f49-a2cc-25b4eab50385 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Acquiring lock "cinder-8c81d01b-a52f-4b7f-a181-88a1d3ddaa71-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:31:31 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-5d13ad7a-2cd7-4f49-a2cc-25b4eab50385 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Lock "cinder-8c81d01b-a52f-4b7f-a181-88a1d3ddaa71-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:31:32 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-5d13ad7a-2cd7-4f49-a2cc-25b4eab50385 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Acquiring lock "cinder-quobyte-8c81d01b-a52f-4b7f-a181-88a1d3ddaa71" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:31:32 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-5d13ad7a-2cd7-4f49-a2cc-25b4eab50385 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Lock "cinder-quobyte-8c81d01b-a52f-4b7f-a181-88a1d3ddaa71" acquired by "delete_volume" :: waited 0.019s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:31:32 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[0779166f-215b-47b5-bb18-1339c222764e]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:31:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5d13ad7a-2cd7-4f49-a2cc-25b4eab50385 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c81d01b-a52f-4b7f-a181-88a1d3ddaa71 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:32 devstack sudo[100845]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-208ebfdd-7107-4f0f-bf52-7f5a8e059ecf tempest-CreateVolumesFromSnapshotTest-428148873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1287bf34-f650-41ca-a1e4-4d06bad610d0 1073741824" returned: 0 in 0.604s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:32 devstack sudo[100850]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c81d01b-a52f-4b7f-a181-88a1d3ddaa71 Nov 01 12:31:32 devstack sudo[100850]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-208ebfdd-7107-4f0f-bf52-7f5a8e059ecf tempest-CreateVolumesFromSnapshotTest-428148873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1287bf34-f650-41ca-a1e4-4d06bad610d0 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:32 devstack sudo[100853]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1287bf34-f650-41ca-a1e4-4d06bad610d0 Nov 01 12:31:32 devstack sudo[100853]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:32 devstack sudo[100853]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:32 devstack sudo[100850]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5d13ad7a-2cd7-4f49-a2cc-25b4eab50385 tempest-TestServerVolumeAttachmentScenario-1426975797 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c81d01b-a52f-4b7f-a181-88a1d3ddaa71" returned: 0 in 0.430s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5d13ad7a-2cd7-4f49-a2cc-25b4eab50385 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c81d01b-a52f-4b7f-a181-88a1d3ddaa71 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-208ebfdd-7107-4f0f-bf52-7f5a8e059ecf tempest-CreateVolumesFromSnapshotTest-428148873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1287bf34-f650-41ca-a1e4-4d06bad610d0" returned: 0 in 0.303s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:32 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-208ebfdd-7107-4f0f-bf52-7f5a8e059ecf tempest-CreateVolumesFromSnapshotTest-428148873 None] <== create_volume: return (956ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:31:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-208ebfdd-7107-4f0f-bf52-7f5a8e059ecf tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.959s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:31:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b01f7946-d305-431b-bdad-0d76dc4535a2 tempest-VolumesTransfersV357Test-437108577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.724s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:32 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-b01f7946-d305-431b-bdad-0d76dc4535a2 tempest-VolumesTransfersV357Test-437108577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:31:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1658407236',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=828bf06c-6f0a-4d91-b592-3d2912f1279f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99fada30d6d744ac95effff0976a23c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:31:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:31:32Z,use_quota=True,user_id='cece74a6b4e2466894a17a0701750f8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:31:32 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-b01f7946-d305-431b-bdad-0d76dc4535a2 tempest-VolumesTransfersV357Test-437108577 None] Creating volume 828bf06c-6f0a-4d91-b592-3d2912f1279f {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:31:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b01f7946-d305-431b-bdad-0d76dc4535a2 tempest-VolumesTransfersV357Test-437108577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b01f7946-d305-431b-bdad-0d76dc4535a2 tempest-VolumesTransfersV357Test-437108577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:32 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-b01f7946-d305-431b-bdad-0d76dc4535a2 tempest-VolumesTransfersV357Test-437108577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:31:32 devstack sudo[100859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c81d01b-a52f-4b7f-a181-88a1d3ddaa71 Nov 01 12:31:32 devstack sudo[100859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:32 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-b01f7946-d305-431b-bdad-0d76dc4535a2 tempest-VolumesTransfersV357Test-437108577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:31:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b01f7946-d305-431b-bdad-0d76dc4535a2 tempest-VolumesTransfersV357Test-437108577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:31:32 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-b01f7946-d305-431b-bdad-0d76dc4535a2 tempest-VolumesTransfersV357Test-437108577 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:31:32 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-b01f7946-d305-431b-bdad-0d76dc4535a2 tempest-VolumesTransfersV357Test-437108577 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:31:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b01f7946-d305-431b-bdad-0d76dc4535a2 tempest-VolumesTransfersV357Test-437108577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-828bf06c-6f0a-4d91-b592-3d2912f1279f 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-208ebfdd-7107-4f0f-bf52-7f5a8e059ecf tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8083f029-b39a-452e-b6bb-39e0e0e150df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1287bf34-f650-41ca-a1e4-4d06bad610d0', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:32 devstack sudo[100861]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-828bf06c-6f0a-4d91-b592-3d2912f1279f 1073741824 Nov 01 12:31:32 devstack sudo[100861]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-208ebfdd-7107-4f0f-bf52-7f5a8e059ecf tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (658c61b2-d0f7-4ca5-b95e-c1a8859a7c30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:32 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-208ebfdd-7107-4f0f-bf52-7f5a8e059ecf tempest-CreateVolumesFromSnapshotTest-428148873 None] Volume volume-1287bf34-f650-41ca-a1e4-4d06bad610d0 (1287bf34-f650-41ca-a1e4-4d06bad610d0): created successfully Nov 01 12:31:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-208ebfdd-7107-4f0f-bf52-7f5a8e059ecf tempest-CreateVolumesFromSnapshotTest-428148873 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (658c61b2-d0f7-4ca5-b95e-c1a8859a7c30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-208ebfdd-7107-4f0f-bf52-7f5a8e059ecf tempest-CreateVolumesFromSnapshotTest-428148873 None] Flow 'volume_create_manager' (bc55560f-23c2-4f6f-bb5c-27601e988484) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:31:32 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-208ebfdd-7107-4f0f-bf52-7f5a8e059ecf tempest-CreateVolumesFromSnapshotTest-428148873 None] Created volume successfully. Nov 01 12:31:32 devstack sudo[100859]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5d13ad7a-2cd7-4f49-a2cc-25b4eab50385 tempest-TestServerVolumeAttachmentScenario-1426975797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c81d01b-a52f-4b7f-a181-88a1d3ddaa71" returned: 0 in 0.329s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:32 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-5d13ad7a-2cd7-4f49-a2cc-25b4eab50385 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Lock "cinder-quobyte-8c81d01b-a52f-4b7f-a181-88a1d3ddaa71" released by "delete_volume" :: held 0.810s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:31:32 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-5d13ad7a-2cd7-4f49-a2cc-25b4eab50385 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Created reservations ['40c99afa-7992-43ee-8703-5e01cd6f9cdf', '109d146c-0127-41a8-aed1-f7d91b1f3373', '9770e939-93ed-4c26-a38f-46d1084b485c', '051ed61f-e6f8-4e7c-bdf3-c5ed386a3cb4'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:31:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5d13ad7a-2cd7-4f49-a2cc-25b4eab50385 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5d13ad7a-2cd7-4f49-a2cc-25b4eab50385 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:32 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-5d13ad7a-2cd7-4f49-a2cc-25b4eab50385 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:31:32 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-5d13ad7a-2cd7-4f49-a2cc-25b4eab50385 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:31:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5d13ad7a-2cd7-4f49-a2cc-25b4eab50385 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:31:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5d13ad7a-2cd7-4f49-a2cc-25b4eab50385 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:32 devstack sudo[100868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:31:32 devstack sudo[100868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:33 devstack sudo[100861]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b01f7946-d305-431b-bdad-0d76dc4535a2 tempest-VolumesTransfersV357Test-437108577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-828bf06c-6f0a-4d91-b592-3d2912f1279f 1073741824" returned: 0 in 0.628s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b01f7946-d305-431b-bdad-0d76dc4535a2 tempest-VolumesTransfersV357Test-437108577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-828bf06c-6f0a-4d91-b592-3d2912f1279f {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:33 devstack sudo[100871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-828bf06c-6f0a-4d91-b592-3d2912f1279f Nov 01 12:31:33 devstack sudo[100871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:33 devstack sudo[100868]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5d13ad7a-2cd7-4f49-a2cc-25b4eab50385 tempest-TestServerVolumeAttachmentScenario-1426975797 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.444s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:33 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-5d13ad7a-2cd7-4f49-a2cc-25b4eab50385 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:31:33 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-5d13ad7a-2cd7-4f49-a2cc-25b4eab50385 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Deleted volume successfully. Nov 01 12:31:33 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-5d13ad7a-2cd7-4f49-a2cc-25b4eab50385 tempest-TestServerVolumeAttachmentScenario-1426975797 None] Lock "cinder-8c81d01b-a52f-4b7f-a181-88a1d3ddaa71-delete_volume" released by "delete_volume" :: held 1.548s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:31:33 devstack sudo[100871]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b01f7946-d305-431b-bdad-0d76dc4535a2 tempest-VolumesTransfersV357Test-437108577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-828bf06c-6f0a-4d91-b592-3d2912f1279f" returned: 0 in 0.363s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:33 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-b01f7946-d305-431b-bdad-0d76dc4535a2 tempest-VolumesTransfersV357Test-437108577 None] <== create_volume: return (1064ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:31:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b01f7946-d305-431b-bdad-0d76dc4535a2 tempest-VolumesTransfersV357Test-437108577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.068s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:31:33 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b01f7946-d305-431b-bdad-0d76dc4535a2 tempest-VolumesTransfersV357Test-437108577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce331438-3d04-4d6d-b381-8181c877c044) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-828bf06c-6f0a-4d91-b592-3d2912f1279f', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:33 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b01f7946-d305-431b-bdad-0d76dc4535a2 tempest-VolumesTransfersV357Test-437108577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e310c061-f334-4e2b-afcf-ba0b4e595d3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:33 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-b01f7946-d305-431b-bdad-0d76dc4535a2 tempest-VolumesTransfersV357Test-437108577 None] Volume volume-828bf06c-6f0a-4d91-b592-3d2912f1279f (828bf06c-6f0a-4d91-b592-3d2912f1279f): created successfully Nov 01 12:31:33 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b01f7946-d305-431b-bdad-0d76dc4535a2 tempest-VolumesTransfersV357Test-437108577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e310c061-f334-4e2b-afcf-ba0b4e595d3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:33 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b01f7946-d305-431b-bdad-0d76dc4535a2 tempest-VolumesTransfersV357Test-437108577 None] Flow 'volume_create_manager' (8e42b180-23cb-4f47-b3ed-255068725ebb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:31:33 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-b01f7946-d305-431b-bdad-0d76dc4535a2 tempest-VolumesTransfersV357Test-437108577 None] Created volume successfully. Nov 01 12:31:33 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b270e848-919a-4bae-a9d3-b810759eb457 tempest-CreateVolumesFromSnapshotTest-428148873 None] Acquiring lock "cinder-1287bf34-f650-41ca-a1e4-4d06bad610d0-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:31:33 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b270e848-919a-4bae-a9d3-b810759eb457 tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "cinder-1287bf34-f650-41ca-a1e4-4d06bad610d0-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:31:33 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b270e848-919a-4bae-a9d3-b810759eb457 tempest-CreateVolumesFromSnapshotTest-428148873 None] Acquiring lock "cinder-quobyte-1287bf34-f650-41ca-a1e4-4d06bad610d0" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:31:33 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b270e848-919a-4bae-a9d3-b810759eb457 tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "cinder-quobyte-1287bf34-f650-41ca-a1e4-4d06bad610d0" acquired by "delete_volume" :: waited 0.032s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:31:34 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[78d1af8b-7be5-40b8-9822-968e26482a89]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:31:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b270e848-919a-4bae-a9d3-b810759eb457 tempest-CreateVolumesFromSnapshotTest-428148873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1287bf34-f650-41ca-a1e4-4d06bad610d0 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:34 devstack sudo[100928]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1287bf34-f650-41ca-a1e4-4d06bad610d0 Nov 01 12:31:34 devstack sudo[100928]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:34 devstack sudo[100928]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b270e848-919a-4bae-a9d3-b810759eb457 tempest-CreateVolumesFromSnapshotTest-428148873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1287bf34-f650-41ca-a1e4-4d06bad610d0" returned: 0 in 0.720s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b270e848-919a-4bae-a9d3-b810759eb457 tempest-CreateVolumesFromSnapshotTest-428148873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1287bf34-f650-41ca-a1e4-4d06bad610d0 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:34 devstack sudo[100946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1287bf34-f650-41ca-a1e4-4d06bad610d0 Nov 01 12:31:34 devstack sudo[100946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:35 devstack sudo[100946]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b270e848-919a-4bae-a9d3-b810759eb457 tempest-CreateVolumesFromSnapshotTest-428148873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1287bf34-f650-41ca-a1e4-4d06bad610d0" returned: 0 in 0.436s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:35 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b270e848-919a-4bae-a9d3-b810759eb457 tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "cinder-quobyte-1287bf34-f650-41ca-a1e4-4d06bad610d0" released by "delete_volume" :: held 1.261s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:31:35 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-b270e848-919a-4bae-a9d3-b810759eb457 tempest-CreateVolumesFromSnapshotTest-428148873 None] Created reservations ['d4a08ee8-9377-4cd9-ac8c-81a57331b150', 'cd9748b4-d8ee-42c3-9906-187450a8cbd4', '558c4e29-c2b3-49e5-bcf9-e51a4062fb8d', '20c15982-342b-401f-8fac-a590ffa3976b'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:31:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b270e848-919a-4bae-a9d3-b810759eb457 tempest-CreateVolumesFromSnapshotTest-428148873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b270e848-919a-4bae-a9d3-b810759eb457 tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:35 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-b270e848-919a-4bae-a9d3-b810759eb457 tempest-CreateVolumesFromSnapshotTest-428148873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:31:35 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-b270e848-919a-4bae-a9d3-b810759eb457 tempest-CreateVolumesFromSnapshotTest-428148873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:31:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b270e848-919a-4bae-a9d3-b810759eb457 tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:31:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b270e848-919a-4bae-a9d3-b810759eb457 tempest-CreateVolumesFromSnapshotTest-428148873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:35 devstack sudo[100952]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:31:35 devstack sudo[100952]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:35 devstack sudo[100952]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b270e848-919a-4bae-a9d3-b810759eb457 tempest-CreateVolumesFromSnapshotTest-428148873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.343s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:35 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-b270e848-919a-4bae-a9d3-b810759eb457 tempest-CreateVolumesFromSnapshotTest-428148873 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:31:35 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-b270e848-919a-4bae-a9d3-b810759eb457 tempest-CreateVolumesFromSnapshotTest-428148873 None] Deleted volume successfully. Nov 01 12:31:35 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-5287d6d0-3117-4fb2-a444-05379497af93 tempest-VolumesTransfersV357Test-1167846265 None] Transfer volume completed successfully. Nov 01 12:31:35 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b270e848-919a-4bae-a9d3-b810759eb457 tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "cinder-1287bf34-f650-41ca-a1e4-4d06bad610d0-delete_volume" released by "delete_volume" :: held 2.085s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:31:36 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-4896f85d-ac97-4eb9-a89e-dd44488ee142 tempest-CreateVolumesFromSnapshotTest-428148873 None] Acquiring lock "cinder-b40e77e6-1a42-457c-84aa-e8e58e4f3312-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:31:36 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-4896f85d-ac97-4eb9-a89e-dd44488ee142 tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "cinder-b40e77e6-1a42-457c-84aa-e8e58e4f3312-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:31:36 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-4896f85d-ac97-4eb9-a89e-dd44488ee142 tempest-CreateVolumesFromSnapshotTest-428148873 None] Acquiring lock "cinder-quobyte-b40e77e6-1a42-457c-84aa-e8e58e4f3312" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:31:36 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-4896f85d-ac97-4eb9-a89e-dd44488ee142 tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "cinder-quobyte-b40e77e6-1a42-457c-84aa-e8e58e4f3312" acquired by "delete_volume" :: waited 0.025s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:31:36 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[405ff324-674b-49c0-8c6a-559f524799c4]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:31:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4896f85d-ac97-4eb9-a89e-dd44488ee142 tempest-CreateVolumesFromSnapshotTest-428148873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b40e77e6-1a42-457c-84aa-e8e58e4f3312 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:36 devstack sudo[100955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b40e77e6-1a42-457c-84aa-e8e58e4f3312 Nov 01 12:31:36 devstack sudo[100955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:36 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ace35c1d-2de4-4ccf-96cd-8ec354f23ee1 tempest-VolumesActionsTest-573589455 None] Acquiring lock "cinder-79d240f8-e8a1-4d53-8697-972a549fb950" by "attach_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:31:36 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ace35c1d-2de4-4ccf-96cd-8ec354f23ee1 tempest-VolumesActionsTest-573589455 None] Lock "cinder-79d240f8-e8a1-4d53-8697-972a549fb950" acquired by "attach_volume" :: waited 0.025s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:31:36 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-ace35c1d-2de4-4ccf-96cd-8ec354f23ee1 tempest-VolumesActionsTest-573589455 None] Attaching volume 79d240f8-e8a1-4d53-8697-972a549fb950 to instance bd8436b7-b678-4b9e-ac3d-cd029051efb1 at mountpoint /dev/vdb on host None. Nov 01 12:31:36 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d9201662-9913-45dc-8905-e9a327416739 tempest-VolumesTransfersV357Test-1464526135 None] Acquiring lock "cinder-828bf06c-6f0a-4d91-b592-3d2912f1279f-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:31:36 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-ace35c1d-2de4-4ccf-96cd-8ec354f23ee1 tempest-VolumesActionsTest-573589455 None] Attach volume completed successfully. Nov 01 12:31:37 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d9201662-9913-45dc-8905-e9a327416739 tempest-VolumesTransfersV357Test-1464526135 None] Lock "cinder-828bf06c-6f0a-4d91-b592-3d2912f1279f-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:31:37 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ace35c1d-2de4-4ccf-96cd-8ec354f23ee1 tempest-VolumesActionsTest-573589455 None] Lock "cinder-79d240f8-e8a1-4d53-8697-972a549fb950" released by "attach_volume" :: held 0.196s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:31:37 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d9201662-9913-45dc-8905-e9a327416739 tempest-VolumesTransfersV357Test-1464526135 None] Acquiring lock "cinder-quobyte-828bf06c-6f0a-4d91-b592-3d2912f1279f" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:31:37 devstack sudo[100955]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4896f85d-ac97-4eb9-a89e-dd44488ee142 tempest-CreateVolumesFromSnapshotTest-428148873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b40e77e6-1a42-457c-84aa-e8e58e4f3312" returned: 0 in 0.729s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4896f85d-ac97-4eb9-a89e-dd44488ee142 tempest-CreateVolumesFromSnapshotTest-428148873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b40e77e6-1a42-457c-84aa-e8e58e4f3312 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:37 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d9201662-9913-45dc-8905-e9a327416739 tempest-VolumesTransfersV357Test-1464526135 None] Lock "cinder-quobyte-828bf06c-6f0a-4d91-b592-3d2912f1279f" acquired by "delete_volume" :: waited 0.067s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:31:37 devstack sudo[100961]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b40e77e6-1a42-457c-84aa-e8e58e4f3312 Nov 01 12:31:37 devstack sudo[100961]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:37 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b5467f-e0b6-4187-a4bb-495713e69189]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:31:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d9201662-9913-45dc-8905-e9a327416739 tempest-VolumesTransfersV357Test-1464526135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-828bf06c-6f0a-4d91-b592-3d2912f1279f {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:37 devstack sudo[100963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-828bf06c-6f0a-4d91-b592-3d2912f1279f Nov 01 12:31:37 devstack sudo[100963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:37 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6ac857bb-cbf2-495c-a305-1e41cfd11a70 tempest-VolumesActionsTest-573589455 None] Acquiring lock "cinder-79d240f8-e8a1-4d53-8697-972a549fb950-detach_volume" by "detach_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:31:37 devstack sudo[100961]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4896f85d-ac97-4eb9-a89e-dd44488ee142 tempest-CreateVolumesFromSnapshotTest-428148873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b40e77e6-1a42-457c-84aa-e8e58e4f3312" returned: 0 in 0.477s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:37 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6ac857bb-cbf2-495c-a305-1e41cfd11a70 tempest-VolumesActionsTest-573589455 None] Lock "cinder-79d240f8-e8a1-4d53-8697-972a549fb950-detach_volume" acquired by "detach_volume" :: waited 0.048s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:31:37 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-6ac857bb-cbf2-495c-a305-1e41cfd11a70 tempest-VolumesActionsTest-573589455 None] Detaching volume 79d240f8-e8a1-4d53-8697-972a549fb950 from instance bd8436b7-b678-4b9e-ac3d-cd029051efb1. Nov 01 12:31:37 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-4896f85d-ac97-4eb9-a89e-dd44488ee142 tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "cinder-quobyte-b40e77e6-1a42-457c-84aa-e8e58e4f3312" released by "delete_volume" :: held 1.332s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:31:37 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-6ac857bb-cbf2-495c-a305-1e41cfd11a70 tempest-VolumesActionsTest-573589455 None] Detach volume completed successfully. Nov 01 12:31:37 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-4896f85d-ac97-4eb9-a89e-dd44488ee142 tempest-CreateVolumesFromSnapshotTest-428148873 None] Created reservations ['01f545b8-4c09-498a-bd45-fcfc590b4dab', 'a44a4868-4190-4be1-99df-509fce37ab1c', '1f01cb05-ccc7-487a-b33a-68de33c4fd55', 'cd1467a9-e45d-4c51-88cd-e4782f16f677'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:31:37 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6ac857bb-cbf2-495c-a305-1e41cfd11a70 tempest-VolumesActionsTest-573589455 None] Lock "cinder-79d240f8-e8a1-4d53-8697-972a549fb950-detach_volume" released by "detach_volume" :: held 0.132s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:31:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4896f85d-ac97-4eb9-a89e-dd44488ee142 tempest-CreateVolumesFromSnapshotTest-428148873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4896f85d-ac97-4eb9-a89e-dd44488ee142 tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:37 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-4896f85d-ac97-4eb9-a89e-dd44488ee142 tempest-CreateVolumesFromSnapshotTest-428148873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:31:37 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-4896f85d-ac97-4eb9-a89e-dd44488ee142 tempest-CreateVolumesFromSnapshotTest-428148873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:31:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4896f85d-ac97-4eb9-a89e-dd44488ee142 tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:31:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4896f85d-ac97-4eb9-a89e-dd44488ee142 tempest-CreateVolumesFromSnapshotTest-428148873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:37 devstack sudo[100968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:31:37 devstack sudo[100968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:38 devstack sudo[100963]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d9201662-9913-45dc-8905-e9a327416739 tempest-VolumesTransfersV357Test-1464526135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-828bf06c-6f0a-4d91-b592-3d2912f1279f" returned: 0 in 0.783s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d9201662-9913-45dc-8905-e9a327416739 tempest-VolumesTransfersV357Test-1464526135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-828bf06c-6f0a-4d91-b592-3d2912f1279f {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:38 devstack sudo[100971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-828bf06c-6f0a-4d91-b592-3d2912f1279f Nov 01 12:31:38 devstack sudo[100971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:38 devstack sudo[100968]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4896f85d-ac97-4eb9-a89e-dd44488ee142 tempest-CreateVolumesFromSnapshotTest-428148873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.369s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:38 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-4896f85d-ac97-4eb9-a89e-dd44488ee142 tempest-CreateVolumesFromSnapshotTest-428148873 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:31:38 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-4896f85d-ac97-4eb9-a89e-dd44488ee142 tempest-CreateVolumesFromSnapshotTest-428148873 None] Deleted volume successfully. Nov 01 12:31:38 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-4896f85d-ac97-4eb9-a89e-dd44488ee142 tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "cinder-b40e77e6-1a42-457c-84aa-e8e58e4f3312-delete_volume" released by "delete_volume" :: held 2.196s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:31:38 devstack sudo[100971]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d9201662-9913-45dc-8905-e9a327416739 tempest-VolumesTransfersV357Test-1464526135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-828bf06c-6f0a-4d91-b592-3d2912f1279f" returned: 0 in 0.599s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:38 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-1b1c5e14-24f3-4f1c-ad63-9107de10c3ec tempest-CreateVolumesFromSnapshotTest-428148873 None] Acquiring lock "cinder-19550827-d601-40cd-a965-62e6a9f41c85-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:31:38 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d9201662-9913-45dc-8905-e9a327416739 tempest-VolumesTransfersV357Test-1464526135 None] Lock "cinder-quobyte-828bf06c-6f0a-4d91-b592-3d2912f1279f" released by "delete_volume" :: held 1.497s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:31:38 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-1b1c5e14-24f3-4f1c-ad63-9107de10c3ec tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "cinder-19550827-d601-40cd-a965-62e6a9f41c85-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:31:38 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-1b1c5e14-24f3-4f1c-ad63-9107de10c3ec tempest-CreateVolumesFromSnapshotTest-428148873 None] Acquiring lock "cinder-quobyte-19550827-d601-40cd-a965-62e6a9f41c85" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:31:38 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-d9201662-9913-45dc-8905-e9a327416739 tempest-VolumesTransfersV357Test-1464526135 None] Created reservations ['824be704-c483-4a9c-bb50-e5755c575419', 'dd83b10e-79a4-415a-acf1-85be8778fa9c', '36b3e101-648b-460a-8838-50d49f8743c2', 'e4214576-6561-4bb4-b763-f579f3696ff9'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:31:38 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-1b1c5e14-24f3-4f1c-ad63-9107de10c3ec tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "cinder-quobyte-19550827-d601-40cd-a965-62e6a9f41c85" acquired by "delete_volume" :: waited 0.045s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:31:38 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[050cf510-107b-4467-86f0-8267de1298a5]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:31:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1b1c5e14-24f3-4f1c-ad63-9107de10c3ec tempest-CreateVolumesFromSnapshotTest-428148873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-19550827-d601-40cd-a965-62e6a9f41c85 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d9201662-9913-45dc-8905-e9a327416739 tempest-VolumesTransfersV357Test-1464526135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d9201662-9913-45dc-8905-e9a327416739 tempest-VolumesTransfersV357Test-1464526135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:38 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d9201662-9913-45dc-8905-e9a327416739 tempest-VolumesTransfersV357Test-1464526135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:31:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d9201662-9913-45dc-8905-e9a327416739 tempest-VolumesTransfersV357Test-1464526135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:31:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d9201662-9913-45dc-8905-e9a327416739 tempest-VolumesTransfersV357Test-1464526135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:31:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d9201662-9913-45dc-8905-e9a327416739 tempest-VolumesTransfersV357Test-1464526135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:39 devstack sudo[100997]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:31:39 devstack sudo[100997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:39 devstack sudo[100991]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-19550827-d601-40cd-a965-62e6a9f41c85 Nov 01 12:31:39 devstack sudo[100991]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:39 devstack sudo[100991]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:39 devstack sudo[100997]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1b1c5e14-24f3-4f1c-ad63-9107de10c3ec tempest-CreateVolumesFromSnapshotTest-428148873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-19550827-d601-40cd-a965-62e6a9f41c85" returned: 0 in 0.678s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1b1c5e14-24f3-4f1c-ad63-9107de10c3ec tempest-CreateVolumesFromSnapshotTest-428148873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-19550827-d601-40cd-a965-62e6a9f41c85 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d9201662-9913-45dc-8905-e9a327416739 tempest-VolumesTransfersV357Test-1464526135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.564s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:39 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-d9201662-9913-45dc-8905-e9a327416739 tempest-VolumesTransfersV357Test-1464526135 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:31:39 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-d9201662-9913-45dc-8905-e9a327416739 tempest-VolumesTransfersV357Test-1464526135 None] Deleted volume successfully. Nov 01 12:31:39 devstack sudo[101039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-19550827-d601-40cd-a965-62e6a9f41c85 Nov 01 12:31:39 devstack sudo[101039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:39 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d9201662-9913-45dc-8905-e9a327416739 tempest-VolumesTransfersV357Test-1464526135 None] Lock "cinder-828bf06c-6f0a-4d91-b592-3d2912f1279f-delete_volume" released by "delete_volume" :: held 2.624s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:31:39 devstack cinder-volume[86574]: DEBUG oslo_service.periodic_task [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86574) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:31:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:31:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:31:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:31:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:39 devstack sudo[101039]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1b1c5e14-24f3-4f1c-ad63-9107de10c3ec tempest-CreateVolumesFromSnapshotTest-428148873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-19550827-d601-40cd-a965-62e6a9f41c85" returned: 0 in 0.389s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:39 devstack sudo[101046]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:31:39 devstack sudo[101046]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:39 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-1b1c5e14-24f3-4f1c-ad63-9107de10c3ec tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "cinder-quobyte-19550827-d601-40cd-a965-62e6a9f41c85" released by "delete_volume" :: held 1.215s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:31:40 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-1b1c5e14-24f3-4f1c-ad63-9107de10c3ec tempest-CreateVolumesFromSnapshotTest-428148873 None] Created reservations ['47e0fbbd-7cdc-41e6-88cc-4e4f0eadb181', 'de24dfa8-bc9f-4fba-840e-49e66243fc27', '0eddcee7-a668-4fc8-a513-9b1ea335a888', 'b8e24321-9302-4075-8667-60e1bd9d25eb'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:31:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-1b1c5e14-24f3-4f1c-ad63-9107de10c3ec tempest-CreateVolumesFromSnapshotTest-428148873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-1b1c5e14-24f3-4f1c-ad63-9107de10c3ec tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:40 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-1b1c5e14-24f3-4f1c-ad63-9107de10c3ec tempest-CreateVolumesFromSnapshotTest-428148873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:31:40 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-1b1c5e14-24f3-4f1c-ad63-9107de10c3ec tempest-CreateVolumesFromSnapshotTest-428148873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:31:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-1b1c5e14-24f3-4f1c-ad63-9107de10c3ec tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:31:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1b1c5e14-24f3-4f1c-ad63-9107de10c3ec tempest-CreateVolumesFromSnapshotTest-428148873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:40 devstack sudo[101056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:31:40 devstack sudo[101056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:40 devstack sudo[101046]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.586s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:40 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:31:40 devstack cinder-volume[86574]: DEBUG oslo_service.periodic_task [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running periodic task VolumeManager._thread_info {{(pid=86574) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:31:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] thread count: 28 {{(pid=86574) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 12:31:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] thread info: [<_MainThread(MainThread, started 131331184930944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86574) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 12:31:40 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1e3502f-18d3-4d11-88cd-75b767b77c75 tempest-VolumesTransfersV357Test-437108577 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:31:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b1e3502f-18d3-4d11-88cd-75b767b77c75 tempest-VolumesTransfersV357Test-437108577 None] Flow 'volume_create_manager' (b7053bfe-4f64-43b2-90da-9b4ac0a0f3e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:31:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b1e3502f-18d3-4d11-88cd-75b767b77c75 tempest-VolumesTransfersV357Test-437108577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2b7e59a-cef3-4c95-85c6-f8f3b3afc111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:40 devstack sudo[101056]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b1e3502f-18d3-4d11-88cd-75b767b77c75 tempest-VolumesTransfersV357Test-437108577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2b7e59a-cef3-4c95-85c6-f8f3b3afc111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-538994437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27636895-b299-4d8a-8f78-a58dcdac269e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99fada30d6d744ac95effff0976a23c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:31:41Z,use_quota=True,user_id='cece74a6b4e2466894a17a0701750f8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b1e3502f-18d3-4d11-88cd-75b767b77c75 tempest-VolumesTransfersV357Test-437108577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b1eab43-2af2-46ee-9e30-5ad31594328e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b1e3502f-18d3-4d11-88cd-75b767b77c75 tempest-VolumesTransfersV357Test-437108577 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6b1eab43-2af2-46ee-9e30-5ad31594328e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b1e3502f-18d3-4d11-88cd-75b767b77c75 tempest-VolumesTransfersV357Test-437108577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f2d06e5-2c97-4bfe-9775-f4268a2739cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b1e3502f-18d3-4d11-88cd-75b767b77c75 tempest-VolumesTransfersV357Test-437108577 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2f2d06e5-2c97-4bfe-9775-f4268a2739cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '27636895-b299-4d8a-8f78-a58dcdac269e', 'volume_name': 'volume-27636895-b299-4d8a-8f78-a58dcdac269e', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b1e3502f-18d3-4d11-88cd-75b767b77c75 tempest-VolumesTransfersV357Test-437108577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50f49a8a-56ca-4ae4-8821-338da20e2d69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b1e3502f-18d3-4d11-88cd-75b767b77c75 tempest-VolumesTransfersV357Test-437108577 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50f49a8a-56ca-4ae4-8821-338da20e2d69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b1e3502f-18d3-4d11-88cd-75b767b77c75 tempest-VolumesTransfersV357Test-437108577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f68678a3-c56d-4ebf-bb48-787f76b0f6af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:40 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-b1e3502f-18d3-4d11-88cd-75b767b77c75 tempest-VolumesTransfersV357Test-437108577 None] Volume 27636895-b299-4d8a-8f78-a58dcdac269e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-27636895-b299-4d8a-8f78-a58dcdac269e', 'volume_size': 1} Nov 01 12:31:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b1e3502f-18d3-4d11-88cd-75b767b77c75 tempest-VolumesTransfersV357Test-437108577 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b1e3502f-18d3-4d11-88cd-75b767b77c75 tempest-VolumesTransfersV357Test-437108577 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:40 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-b1e3502f-18d3-4d11-88cd-75b767b77c75 tempest-VolumesTransfersV357Test-437108577 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:31:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-538994437',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=27636895-b299-4d8a-8f78-a58dcdac269e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='99fada30d6d744ac95effff0976a23c3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:31:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:31:41Z,use_quota=True,user_id='cece74a6b4e2466894a17a0701750f8f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:31:40 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-b1e3502f-18d3-4d11-88cd-75b767b77c75 tempest-VolumesTransfersV357Test-437108577 None] Creating volume 27636895-b299-4d8a-8f78-a58dcdac269e {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:31:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b1e3502f-18d3-4d11-88cd-75b767b77c75 tempest-VolumesTransfersV357Test-437108577 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b1e3502f-18d3-4d11-88cd-75b767b77c75 tempest-VolumesTransfersV357Test-437108577 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:40 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-b1e3502f-18d3-4d11-88cd-75b767b77c75 tempest-VolumesTransfersV357Test-437108577 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:31:40 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-b1e3502f-18d3-4d11-88cd-75b767b77c75 tempest-VolumesTransfersV357Test-437108577 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:31:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b1e3502f-18d3-4d11-88cd-75b767b77c75 tempest-VolumesTransfersV357Test-437108577 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:31:40 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-b1e3502f-18d3-4d11-88cd-75b767b77c75 tempest-VolumesTransfersV357Test-437108577 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:31:40 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-b1e3502f-18d3-4d11-88cd-75b767b77c75 tempest-VolumesTransfersV357Test-437108577 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:31:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b1e3502f-18d3-4d11-88cd-75b767b77c75 tempest-VolumesTransfersV357Test-437108577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-27636895-b299-4d8a-8f78-a58dcdac269e 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1b1c5e14-24f3-4f1c-ad63-9107de10c3ec tempest-CreateVolumesFromSnapshotTest-428148873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.460s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:40 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-1b1c5e14-24f3-4f1c-ad63-9107de10c3ec tempest-CreateVolumesFromSnapshotTest-428148873 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:31:40 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-1b1c5e14-24f3-4f1c-ad63-9107de10c3ec tempest-CreateVolumesFromSnapshotTest-428148873 None] Deleted volume successfully. Nov 01 12:31:40 devstack sudo[101059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-27636895-b299-4d8a-8f78-a58dcdac269e 1073741824 Nov 01 12:31:40 devstack sudo[101059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:40 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-1b1c5e14-24f3-4f1c-ad63-9107de10c3ec tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "cinder-19550827-d601-40cd-a965-62e6a9f41c85-delete_volume" released by "delete_volume" :: held 2.204s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:31:41 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-95347557-75b2-42b7-80ad-940ba8ee4965 tempest-CreateVolumesFromSnapshotTest-428148873 None] Acquiring lock "cinder-cee0b12e-ecd5-40c8-93d6-664953e34c96-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:31:41 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-95347557-75b2-42b7-80ad-940ba8ee4965 tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "cinder-cee0b12e-ecd5-40c8-93d6-664953e34c96-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:31:41 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-95347557-75b2-42b7-80ad-940ba8ee4965 tempest-CreateVolumesFromSnapshotTest-428148873 None] Acquiring lock "cinder-quobyte-cee0b12e-ecd5-40c8-93d6-664953e34c96" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:31:41 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-95347557-75b2-42b7-80ad-940ba8ee4965 tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "cinder-quobyte-cee0b12e-ecd5-40c8-93d6-664953e34c96" acquired by "delete_volume" :: waited 0.020s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:31:41 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[5307887a-cd18-4cc2-9d23-f227de0493ba]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:31:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-95347557-75b2-42b7-80ad-940ba8ee4965 tempest-CreateVolumesFromSnapshotTest-428148873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cee0b12e-ecd5-40c8-93d6-664953e34c96 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:41 devstack sudo[101059]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:41 devstack sudo[101065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cee0b12e-ecd5-40c8-93d6-664953e34c96 Nov 01 12:31:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b1e3502f-18d3-4d11-88cd-75b767b77c75 tempest-VolumesTransfersV357Test-437108577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-27636895-b299-4d8a-8f78-a58dcdac269e 1073741824" returned: 0 in 0.580s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:41 devstack sudo[101065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b1e3502f-18d3-4d11-88cd-75b767b77c75 tempest-VolumesTransfersV357Test-437108577 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-27636895-b299-4d8a-8f78-a58dcdac269e {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:41 devstack sudo[101068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-27636895-b299-4d8a-8f78-a58dcdac269e Nov 01 12:31:41 devstack sudo[101068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:41 devstack sudo[101065]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-95347557-75b2-42b7-80ad-940ba8ee4965 tempest-CreateVolumesFromSnapshotTest-428148873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cee0b12e-ecd5-40c8-93d6-664953e34c96" returned: 0 in 0.470s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-95347557-75b2-42b7-80ad-940ba8ee4965 tempest-CreateVolumesFromSnapshotTest-428148873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cee0b12e-ecd5-40c8-93d6-664953e34c96 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:41 devstack sudo[101068]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b1e3502f-18d3-4d11-88cd-75b767b77c75 tempest-VolumesTransfersV357Test-437108577 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-27636895-b299-4d8a-8f78-a58dcdac269e" returned: 0 in 0.303s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:41 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-b1e3502f-18d3-4d11-88cd-75b767b77c75 tempest-VolumesTransfersV357Test-437108577 None] <== create_volume: return (950ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:31:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b1e3502f-18d3-4d11-88cd-75b767b77c75 tempest-VolumesTransfersV357Test-437108577 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.954s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:31:41 devstack sudo[101075]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cee0b12e-ecd5-40c8-93d6-664953e34c96 Nov 01 12:31:41 devstack sudo[101075]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b1e3502f-18d3-4d11-88cd-75b767b77c75 tempest-VolumesTransfersV357Test-437108577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f68678a3-c56d-4ebf-bb48-787f76b0f6af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-27636895-b299-4d8a-8f78-a58dcdac269e', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b1e3502f-18d3-4d11-88cd-75b767b77c75 tempest-VolumesTransfersV357Test-437108577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (417ba326-66ff-46ba-96dc-8a47da8ea98b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:31:41 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-b1e3502f-18d3-4d11-88cd-75b767b77c75 tempest-VolumesTransfersV357Test-437108577 None] Volume volume-27636895-b299-4d8a-8f78-a58dcdac269e (27636895-b299-4d8a-8f78-a58dcdac269e): created successfully Nov 01 12:31:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b1e3502f-18d3-4d11-88cd-75b767b77c75 tempest-VolumesTransfersV357Test-437108577 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (417ba326-66ff-46ba-96dc-8a47da8ea98b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:31:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b1e3502f-18d3-4d11-88cd-75b767b77c75 tempest-VolumesTransfersV357Test-437108577 None] Flow 'volume_create_manager' (b7053bfe-4f64-43b2-90da-9b4ac0a0f3e7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:31:41 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-b1e3502f-18d3-4d11-88cd-75b767b77c75 tempest-VolumesTransfersV357Test-437108577 None] Created volume successfully. Nov 01 12:31:41 devstack sudo[101075]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-95347557-75b2-42b7-80ad-940ba8ee4965 tempest-CreateVolumesFromSnapshotTest-428148873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cee0b12e-ecd5-40c8-93d6-664953e34c96" returned: 0 in 0.291s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:42 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-95347557-75b2-42b7-80ad-940ba8ee4965 tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "cinder-quobyte-cee0b12e-ecd5-40c8-93d6-664953e34c96" released by "delete_volume" :: held 0.825s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:31:42 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-95347557-75b2-42b7-80ad-940ba8ee4965 tempest-CreateVolumesFromSnapshotTest-428148873 None] Created reservations ['1626679e-04e1-49e9-a22e-778107efffdc', 'ec345862-6434-4ce7-80dc-eeb35499779b', '2de21157-0c30-4347-b4f1-7bca9ddea801', '5510056e-4690-41bc-a679-2824b02af511'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:31:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-95347557-75b2-42b7-80ad-940ba8ee4965 tempest-CreateVolumesFromSnapshotTest-428148873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-95347557-75b2-42b7-80ad-940ba8ee4965 tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:42 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-95347557-75b2-42b7-80ad-940ba8ee4965 tempest-CreateVolumesFromSnapshotTest-428148873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:31:42 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-95347557-75b2-42b7-80ad-940ba8ee4965 tempest-CreateVolumesFromSnapshotTest-428148873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:31:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-95347557-75b2-42b7-80ad-940ba8ee4965 tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:31:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-95347557-75b2-42b7-80ad-940ba8ee4965 tempest-CreateVolumesFromSnapshotTest-428148873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:42 devstack sudo[101078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:31:42 devstack sudo[101078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:42 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a6480a2c-89c6-4d8d-a528-c664ece6932f tempest-CreateVolumesFromSnapshotTest-428148873 None] Acquiring lock "cinder-c6f3f565-aaef-4f73-bc3b-ff05784cafeb-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:31:42 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a6480a2c-89c6-4d8d-a528-c664ece6932f tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "cinder-c6f3f565-aaef-4f73-bc3b-ff05784cafeb-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:31:42 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a6480a2c-89c6-4d8d-a528-c664ece6932f tempest-CreateVolumesFromSnapshotTest-428148873 None] Acquiring lock "cinder-quobyte-c6f3f565-aaef-4f73-bc3b-ff05784cafeb" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:31:42 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a6480a2c-89c6-4d8d-a528-c664ece6932f tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "cinder-quobyte-c6f3f565-aaef-4f73-bc3b-ff05784cafeb" acquired by "delete_volume" :: waited 0.016s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:31:42 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[61fb9450-0d8c-48f2-9757-552b1cdad8e0]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:31:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a6480a2c-89c6-4d8d-a528-c664ece6932f tempest-CreateVolumesFromSnapshotTest-428148873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c6f3f565-aaef-4f73-bc3b-ff05784cafeb {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:42 devstack sudo[101078]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-95347557-75b2-42b7-80ad-940ba8ee4965 tempest-CreateVolumesFromSnapshotTest-428148873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.357s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:42 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-95347557-75b2-42b7-80ad-940ba8ee4965 tempest-CreateVolumesFromSnapshotTest-428148873 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:31:42 devstack sudo[101080]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c6f3f565-aaef-4f73-bc3b-ff05784cafeb Nov 01 12:31:42 devstack sudo[101080]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:42 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-95347557-75b2-42b7-80ad-940ba8ee4965 tempest-CreateVolumesFromSnapshotTest-428148873 None] Deleted volume successfully. Nov 01 12:31:42 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:UPDATE=184,cinder:DELETE=14,cinder:SELECT=139,cinder:INSERT=44 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:31:42 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-95347557-75b2-42b7-80ad-940ba8ee4965 tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "cinder-cee0b12e-ecd5-40c8-93d6-664953e34c96-delete_volume" released by "delete_volume" :: held 1.507s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:31:42 devstack sudo[101080]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a6480a2c-89c6-4d8d-a528-c664ece6932f tempest-CreateVolumesFromSnapshotTest-428148873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c6f3f565-aaef-4f73-bc3b-ff05784cafeb" returned: 0 in 0.426s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a6480a2c-89c6-4d8d-a528-c664ece6932f tempest-CreateVolumesFromSnapshotTest-428148873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c6f3f565-aaef-4f73-bc3b-ff05784cafeb {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:42 devstack sudo[101086]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c6f3f565-aaef-4f73-bc3b-ff05784cafeb Nov 01 12:31:42 devstack sudo[101086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:43 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-c2251493-a75b-49a2-9a33-6a32bc262c6d tempest-VolumesTransfersV357Test-1464526135 None] Acquiring lock "cinder-27636895-b299-4d8a-8f78-a58dcdac269e-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:31:43 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-c2251493-a75b-49a2-9a33-6a32bc262c6d tempest-VolumesTransfersV357Test-1464526135 None] Lock "cinder-27636895-b299-4d8a-8f78-a58dcdac269e-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:31:43 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:SELECT=145,cinder:INSERT=46,cinder:UPDATE=163,cinder:DELETE=16 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:31:43 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-c2251493-a75b-49a2-9a33-6a32bc262c6d tempest-VolumesTransfersV357Test-1464526135 None] Acquiring lock "cinder-quobyte-27636895-b299-4d8a-8f78-a58dcdac269e" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:31:43 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-c2251493-a75b-49a2-9a33-6a32bc262c6d tempest-VolumesTransfersV357Test-1464526135 None] Lock "cinder-quobyte-27636895-b299-4d8a-8f78-a58dcdac269e" acquired by "delete_volume" :: waited 0.021s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:31:43 devstack sudo[101086]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a6480a2c-89c6-4d8d-a528-c664ece6932f tempest-CreateVolumesFromSnapshotTest-428148873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c6f3f565-aaef-4f73-bc3b-ff05784cafeb" returned: 0 in 0.323s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:43 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[32daaa8d-ac4d-4749-a2f9-6fe0fef018be]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:31:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c2251493-a75b-49a2-9a33-6a32bc262c6d tempest-VolumesTransfersV357Test-1464526135 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-27636895-b299-4d8a-8f78-a58dcdac269e {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:43 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a6480a2c-89c6-4d8d-a528-c664ece6932f tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "cinder-quobyte-c6f3f565-aaef-4f73-bc3b-ff05784cafeb" released by "delete_volume" :: held 0.816s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:31:43 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-a6480a2c-89c6-4d8d-a528-c664ece6932f tempest-CreateVolumesFromSnapshotTest-428148873 None] Created reservations ['bcd575c1-d53a-4070-af6e-fc3fba46202c', '2e8775b7-4797-4eea-ad45-5aab9e446251', '5184a265-71cc-4449-aa64-28f7a1a57e74', '3e83c277-4d48-49e5-a036-9808917b2fa4'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:31:43 devstack sudo[101090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-27636895-b299-4d8a-8f78-a58dcdac269e Nov 01 12:31:43 devstack sudo[101090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a6480a2c-89c6-4d8d-a528-c664ece6932f tempest-CreateVolumesFromSnapshotTest-428148873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a6480a2c-89c6-4d8d-a528-c664ece6932f tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:43 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a6480a2c-89c6-4d8d-a528-c664ece6932f tempest-CreateVolumesFromSnapshotTest-428148873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:31:43 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a6480a2c-89c6-4d8d-a528-c664ece6932f tempest-CreateVolumesFromSnapshotTest-428148873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:31:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a6480a2c-89c6-4d8d-a528-c664ece6932f tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:31:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a6480a2c-89c6-4d8d-a528-c664ece6932f tempest-CreateVolumesFromSnapshotTest-428148873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:43 devstack sudo[101092]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:31:43 devstack sudo[101092]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:43 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-125be134-bf92-446d-99ba-4702e8e96d45 tempest-CreateVolumesFromSnapshotTest-428148873 None] Acquiring lock "cinder-100715b4-d45e-4221-9f9f-c351f4c4ed29-delete_snapshot" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:31:43 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-125be134-bf92-446d-99ba-4702e8e96d45 tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "cinder-100715b4-d45e-4221-9f9f-c351f4c4ed29-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:31:43 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-125be134-bf92-446d-99ba-4702e8e96d45 tempest-CreateVolumesFromSnapshotTest-428148873 None] Acquiring lock "cinder-quobyte-66e83dd9-cbec-42d2-8ed2-49a3462f21f9" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:31:43 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-125be134-bf92-446d-99ba-4702e8e96d45 tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "cinder-quobyte-66e83dd9-cbec-42d2-8ed2-49a3462f21f9" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:31:43 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-125be134-bf92-446d-99ba-4702e8e96d45 tempest-CreateVolumesFromSnapshotTest-428148873 None] Acquiring lock "cinder-quobyte-100715b4-d45e-4221-9f9f-c351f4c4ed29" by "_delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:31:43 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-125be134-bf92-446d-99ba-4702e8e96d45 tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "cinder-quobyte-100715b4-d45e-4221-9f9f-c351f4c4ed29" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:31:43 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-125be134-bf92-446d-99ba-4702e8e96d45 tempest-CreateVolumesFromSnapshotTest-428148873 None] Deleting offline snapshot 100715b4-d45e-4221-9f9f-c351f4c4ed29 of volume 66e83dd9-cbec-42d2-8ed2-49a3462f21f9 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:31:43 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-125be134-bf92-446d-99ba-4702e8e96d45 tempest-CreateVolumesFromSnapshotTest-428148873 None] snapshot_file for this snap is: volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9.100715b4-d45e-4221-9f9f-c351f4c4ed29 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:31:43 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2a82ac-1abc-4195-8b7e-68795ca1f802]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:31:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-125be134-bf92-446d-99ba-4702e8e96d45 tempest-CreateVolumesFromSnapshotTest-428148873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9.100715b4-d45e-4221-9f9f-c351f4c4ed29 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:43 devstack sudo[101090]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c2251493-a75b-49a2-9a33-6a32bc262c6d tempest-VolumesTransfersV357Test-1464526135 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-27636895-b299-4d8a-8f78-a58dcdac269e" returned: 0 in 0.543s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c2251493-a75b-49a2-9a33-6a32bc262c6d tempest-VolumesTransfersV357Test-1464526135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-27636895-b299-4d8a-8f78-a58dcdac269e {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:43 devstack sudo[101092]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a6480a2c-89c6-4d8d-a528-c664ece6932f tempest-CreateVolumesFromSnapshotTest-428148873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.350s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:43 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-a6480a2c-89c6-4d8d-a528-c664ece6932f tempest-CreateVolumesFromSnapshotTest-428148873 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:31:43 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-a6480a2c-89c6-4d8d-a528-c664ece6932f tempest-CreateVolumesFromSnapshotTest-428148873 None] Deleted volume successfully. Nov 01 12:31:43 devstack sudo[101100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-27636895-b299-4d8a-8f78-a58dcdac269e Nov 01 12:31:43 devstack sudo[101100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-1996c358-5165-4465-912d-a866bde426ad tempest-VolumesActionsTest-573589455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-1996c358-5165-4465-912d-a866bde426ad tempest-VolumesActionsTest-573589455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:43 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a6480a2c-89c6-4d8d-a528-c664ece6932f tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "cinder-c6f3f565-aaef-4f73-bc3b-ff05784cafeb-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:31:43 devstack sudo[101099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9.100715b4-d45e-4221-9f9f-c351f4c4ed29 Nov 01 12:31:43 devstack sudo[101099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:43 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[27d71a51-f7fd-46be-80a7-1945c34ac439]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:31:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1996c358-5165-4465-912d-a866bde426ad tempest-VolumesActionsTest-573589455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-79d240f8-e8a1-4d53-8697-972a549fb950 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:44 devstack sudo[101104]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-79d240f8-e8a1-4d53-8697-972a549fb950 Nov 01 12:31:44 devstack sudo[101104]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:44 devstack sudo[101100]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c2251493-a75b-49a2-9a33-6a32bc262c6d tempest-VolumesTransfersV357Test-1464526135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-27636895-b299-4d8a-8f78-a58dcdac269e" returned: 0 in 0.370s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:44 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-c2251493-a75b-49a2-9a33-6a32bc262c6d tempest-VolumesTransfersV357Test-1464526135 None] Lock "cinder-quobyte-27636895-b299-4d8a-8f78-a58dcdac269e" released by "delete_volume" :: held 0.983s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:31:44 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-c2251493-a75b-49a2-9a33-6a32bc262c6d tempest-VolumesTransfersV357Test-1464526135 None] Created reservations ['2ee6e92f-9a35-490c-bab3-f17bb5d2d1da', 'f62eae20-f533-48ee-9221-72fab8456cab', '69dd378e-7d33-43bb-bd7e-11f0d3f80808', '594ed8ea-1ec7-4869-aa8a-9a6dae084e4d'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:31:44 devstack sudo[101099]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-125be134-bf92-446d-99ba-4702e8e96d45 tempest-CreateVolumesFromSnapshotTest-428148873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9.100715b4-d45e-4221-9f9f-c351f4c4ed29" returned: 0 in 0.526s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:44 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-125be134-bf92-446d-99ba-4702e8e96d45 tempest-CreateVolumesFromSnapshotTest-428148873 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:31:44 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[9727a1d9-2f16-404c-8278-090b0d622bed]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:31:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-125be134-bf92-446d-99ba-4702e8e96d45 tempest-CreateVolumesFromSnapshotTest-428148873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-c2251493-a75b-49a2-9a33-6a32bc262c6d tempest-VolumesTransfersV357Test-1464526135 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-c2251493-a75b-49a2-9a33-6a32bc262c6d tempest-VolumesTransfersV357Test-1464526135 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:44 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-c2251493-a75b-49a2-9a33-6a32bc262c6d tempest-VolumesTransfersV357Test-1464526135 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:31:44 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-c2251493-a75b-49a2-9a33-6a32bc262c6d tempest-VolumesTransfersV357Test-1464526135 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:31:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-c2251493-a75b-49a2-9a33-6a32bc262c6d tempest-VolumesTransfersV357Test-1464526135 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:31:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c2251493-a75b-49a2-9a33-6a32bc262c6d tempest-VolumesTransfersV357Test-1464526135 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:44 devstack sudo[101115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:31:44 devstack sudo[101115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:44 devstack sudo[101104]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:44 devstack sudo[101110]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9 Nov 01 12:31:44 devstack sudo[101110]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1996c358-5165-4465-912d-a866bde426ad tempest-VolumesActionsTest-573589455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-79d240f8-e8a1-4d53-8697-972a549fb950" returned: 0 in 0.581s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:44 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[2729fe0e-e6c5-406c-8218-a0975cc5482d]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:31:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1996c358-5165-4465-912d-a866bde426ad tempest-VolumesActionsTest-573589455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-79d240f8-e8a1-4d53-8697-972a549fb950 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:44 devstack sudo[101118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-79d240f8-e8a1-4d53-8697-972a549fb950 Nov 01 12:31:44 devstack sudo[101118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:44 devstack sudo[101115]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c2251493-a75b-49a2-9a33-6a32bc262c6d tempest-VolumesTransfersV357Test-1464526135 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.326s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:44 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-c2251493-a75b-49a2-9a33-6a32bc262c6d tempest-VolumesTransfersV357Test-1464526135 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:31:44 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-c2251493-a75b-49a2-9a33-6a32bc262c6d tempest-VolumesTransfersV357Test-1464526135 None] Deleted volume successfully. Nov 01 12:31:44 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-c2251493-a75b-49a2-9a33-6a32bc262c6d tempest-VolumesTransfersV357Test-1464526135 None] Lock "cinder-27636895-b299-4d8a-8f78-a58dcdac269e-delete_volume" released by "delete_volume" :: held 1.699s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:31:44 devstack sudo[101110]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-125be134-bf92-446d-99ba-4702e8e96d45 tempest-CreateVolumesFromSnapshotTest-428148873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9" returned: 0 in 0.529s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-125be134-bf92-446d-99ba-4702e8e96d45 tempest-CreateVolumesFromSnapshotTest-428148873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9.100715b4-d45e-4221-9f9f-c351f4c4ed29 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:44 devstack sudo[101124]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9.100715b4-d45e-4221-9f9f-c351f4c4ed29 Nov 01 12:31:44 devstack sudo[101124]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:45 devstack sudo[101118]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1996c358-5165-4465-912d-a866bde426ad tempest-VolumesActionsTest-573589455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-79d240f8-e8a1-4d53-8697-972a549fb950" returned: 0 in 0.466s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1996c358-5165-4465-912d-a866bde426ad tempest-VolumesActionsTest-573589455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-79d240f8-e8a1-4d53-8697-972a549fb950 /opt/stack/data/cinder/conversion/79d240f8-e8a1-4d53-8697-972a549fb950.temp_image.b20788fe-5573-4997-9cd8-13bc0c5cf53e9prpceyl.img {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:45 devstack sudo[101129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-79d240f8-e8a1-4d53-8697-972a549fb950 /opt/stack/data/cinder/conversion/79d240f8-e8a1-4d53-8697-972a549fb950.temp_image.b20788fe-5573-4997-9cd8-13bc0c5cf53e9prpceyl.img Nov 01 12:31:45 devstack sudo[101129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:45 devstack sudo[101124]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-125be134-bf92-446d-99ba-4702e8e96d45 tempest-CreateVolumesFromSnapshotTest-428148873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9.100715b4-d45e-4221-9f9f-c351f4c4ed29" returned: 0 in 0.343s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-125be134-bf92-446d-99ba-4702e8e96d45 tempest-CreateVolumesFromSnapshotTest-428148873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9.100715b4-d45e-4221-9f9f-c351f4c4ed29 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:45 devstack sudo[101134]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9.100715b4-d45e-4221-9f9f-c351f4c4ed29 Nov 01 12:31:45 devstack sudo[101134]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:45 devstack sudo[101134]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-125be134-bf92-446d-99ba-4702e8e96d45 tempest-CreateVolumesFromSnapshotTest-428148873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9.100715b4-d45e-4221-9f9f-c351f4c4ed29" returned: 0 in 0.356s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:45 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-125be134-bf92-446d-99ba-4702e8e96d45 tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "cinder-quobyte-100715b4-d45e-4221-9f9f-c351f4c4ed29" released by "_delete_snapshot" :: held 1.982s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:31:45 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-125be134-bf92-446d-99ba-4702e8e96d45 tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "cinder-quobyte-66e83dd9-cbec-42d2-8ed2-49a3462f21f9" released by "delete_snapshot" :: held 2.024s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:31:45 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-125be134-bf92-446d-99ba-4702e8e96d45 tempest-CreateVolumesFromSnapshotTest-428148873 None] Created reservations ['ac985cf8-524d-44f8-8c9a-3358009a8999', '908462a4-a580-4169-b3c0-1dbc829be163', '8c9804ca-0967-42ae-97c7-02c9a9d46679', '5c170f59-e263-4fea-9b12-db0cb0487259'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:31:46 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-125be134-bf92-446d-99ba-4702e8e96d45 tempest-CreateVolumesFromSnapshotTest-428148873 None] Delete snapshot completed successfully. Nov 01 12:31:46 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-125be134-bf92-446d-99ba-4702e8e96d45 tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "cinder-100715b4-d45e-4221-9f9f-c351f4c4ed29-delete_snapshot" released by "delete_snapshot" :: held 2.486s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:31:47 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-02fa0e08-975e-49c1-a43d-28a2194a010c tempest-CreateVolumesFromSnapshotTest-428148873 None] Acquiring lock "cinder-66e83dd9-cbec-42d2-8ed2-49a3462f21f9-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:31:47 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-02fa0e08-975e-49c1-a43d-28a2194a010c tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "cinder-66e83dd9-cbec-42d2-8ed2-49a3462f21f9-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:31:47 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-02fa0e08-975e-49c1-a43d-28a2194a010c tempest-CreateVolumesFromSnapshotTest-428148873 None] Acquiring lock "cinder-quobyte-66e83dd9-cbec-42d2-8ed2-49a3462f21f9" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:31:47 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-02fa0e08-975e-49c1-a43d-28a2194a010c tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "cinder-quobyte-66e83dd9-cbec-42d2-8ed2-49a3462f21f9" acquired by "delete_volume" :: waited 0.050s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:31:47 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[8668361d-d60a-4383-a2a4-e28461f1ee36]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:31:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-02fa0e08-975e-49c1-a43d-28a2194a010c tempest-CreateVolumesFromSnapshotTest-428148873 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:47 devstack sudo[101148]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9 Nov 01 12:31:47 devstack sudo[101148]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:48 devstack sudo[101148]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-02fa0e08-975e-49c1-a43d-28a2194a010c tempest-CreateVolumesFromSnapshotTest-428148873 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9" returned: 0 in 0.986s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-02fa0e08-975e-49c1-a43d-28a2194a010c tempest-CreateVolumesFromSnapshotTest-428148873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:48 devstack sudo[101156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9 Nov 01 12:31:48 devstack sudo[101156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:49 devstack sudo[101156]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-02fa0e08-975e-49c1-a43d-28a2194a010c tempest-CreateVolumesFromSnapshotTest-428148873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-66e83dd9-cbec-42d2-8ed2-49a3462f21f9" returned: 0 in 0.779s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:49 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-02fa0e08-975e-49c1-a43d-28a2194a010c tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "cinder-quobyte-66e83dd9-cbec-42d2-8ed2-49a3462f21f9" released by "delete_volume" :: held 1.968s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:31:49 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-02fa0e08-975e-49c1-a43d-28a2194a010c tempest-CreateVolumesFromSnapshotTest-428148873 None] Created reservations ['07317216-7be0-46f8-b91f-9c30581086f8', 'e55c4bc1-3d7c-4e7c-a179-66dee787ef42', '99e6ae38-797d-4119-8d46-b05967313ddf', 'ddc54bb7-adb1-4421-9b7e-22300e3d930c'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:31:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-02fa0e08-975e-49c1-a43d-28a2194a010c tempest-CreateVolumesFromSnapshotTest-428148873 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:31:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-02fa0e08-975e-49c1-a43d-28a2194a010c tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:31:49 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-02fa0e08-975e-49c1-a43d-28a2194a010c tempest-CreateVolumesFromSnapshotTest-428148873 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:31:49 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-02fa0e08-975e-49c1-a43d-28a2194a010c tempest-CreateVolumesFromSnapshotTest-428148873 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:31:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-02fa0e08-975e-49c1-a43d-28a2194a010c tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:31:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-02fa0e08-975e-49c1-a43d-28a2194a010c tempest-CreateVolumesFromSnapshotTest-428148873 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:49 devstack sudo[101159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:31:49 devstack sudo[101159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:50 devstack sudo[101159]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-02fa0e08-975e-49c1-a43d-28a2194a010c tempest-CreateVolumesFromSnapshotTest-428148873 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.413s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:50 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-02fa0e08-975e-49c1-a43d-28a2194a010c tempest-CreateVolumesFromSnapshotTest-428148873 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:31:50 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-02fa0e08-975e-49c1-a43d-28a2194a010c tempest-CreateVolumesFromSnapshotTest-428148873 None] Deleted volume successfully. Nov 01 12:31:50 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-02fa0e08-975e-49c1-a43d-28a2194a010c tempest-CreateVolumesFromSnapshotTest-428148873 None] Lock "cinder-66e83dd9-cbec-42d2-8ed2-49a3462f21f9-delete_volume" released by "delete_volume" :: held 2.976s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:31:54 devstack sudo[101129]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1996c358-5165-4465-912d-a866bde426ad tempest-VolumesActionsTest-573589455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-79d240f8-e8a1-4d53-8697-972a549fb950 /opt/stack/data/cinder/conversion/79d240f8-e8a1-4d53-8697-972a549fb950.temp_image.b20788fe-5573-4997-9cd8-13bc0c5cf53e9prpceyl.img" returned: 0 in 9.432s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:54 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[f521ebcb-5fc7-42a9-aab8-00e4dbb93db9]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:31:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1996c358-5165-4465-912d-a866bde426ad tempest-VolumesActionsTest-573589455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-79d240f8-e8a1-4d53-8697-972a549fb950 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:31:54 devstack sudo[101162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-79d240f8-e8a1-4d53-8697-972a549fb950 Nov 01 12:31:54 devstack sudo[101162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:31:55 devstack sudo[101162]: pam_unix(sudo:session): session closed for user root Nov 01 12:31:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1996c358-5165-4465-912d-a866bde426ad tempest-VolumesActionsTest-573589455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-79d240f8-e8a1-4d53-8697-972a549fb950" returned: 0 in 0.638s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:31:55 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-1996c358-5165-4465-912d-a866bde426ad tempest-VolumesActionsTest-573589455 None] Image conversion details: src /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-79d240f8-e8a1-4d53-8697-972a549fb950, size 1024.00 MB, duration 9.43 sec, destination /opt/stack/data/cinder/conversion/79d240f8-e8a1-4d53-8697-972a549fb950.temp_image.b20788fe-5573-4997-9cd8-13bc0c5cf53e9prpceyl.img {{(pid=86574) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 12:31:55 devstack cinder-volume[86574]: INFO cinder.image.image_utils [None req-1996c358-5165-4465-912d-a866bde426ad tempest-VolumesActionsTest-573589455 None] Converted 1024.00 MB image at 108.54 MB/s Nov 01 12:31:55 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-1996c358-5165-4465-912d-a866bde426ad tempest-VolumesActionsTest-573589455 None] b20788fe-5573-4997-9cd8-13bc0c5cf53e was raw, no need to convert to raw {{(pid=86574) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 01 12:32:00 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:SELECT=20,cinder:INSERT=8,cinder:UPDATE=25,cinder:DELETE=3 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:32:05 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:UPDATE=33,cinder:SELECT=21,cinder:INSERT=8 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:32:19 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8bb1ae0-01a1-45d7-8c78-9b18dee18ffd tempest-VolumesSnapshotTestJSON-1948679985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:32:19 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a8bb1ae0-01a1-45d7-8c78-9b18dee18ffd tempest-VolumesSnapshotTestJSON-1948679985 None] Flow 'volume_create_manager' (b6bfc9e8-2924-4aa3-b875-30c1756cda8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:32:19 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a8bb1ae0-01a1-45d7-8c78-9b18dee18ffd tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88c28a92-5d7e-4b1c-a6b8-dd43cd0dbd3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:19 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a8bb1ae0-01a1-45d7-8c78-9b18dee18ffd tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (88c28a92-5d7e-4b1c-a6b8-dd43cd0dbd3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:32:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-566658515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59df17bc-f404-460c-8aec-55196af2645d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91bd3d6227a3427c99d886af727c7024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:32:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:32:19Z,use_quota=True,user_id='a5b1003031114b029ede968cb9c9a409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:19 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a8bb1ae0-01a1-45d7-8c78-9b18dee18ffd tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d775522b-be08-4fa8-b98c-7c4d95166c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:19 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a8bb1ae0-01a1-45d7-8c78-9b18dee18ffd tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d775522b-be08-4fa8-b98c-7c4d95166c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:19 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a8bb1ae0-01a1-45d7-8c78-9b18dee18ffd tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b815f682-6a12-44dc-9b1d-b3c6bd484a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:19 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a8bb1ae0-01a1-45d7-8c78-9b18dee18ffd tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b815f682-6a12-44dc-9b1d-b3c6bd484a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '59df17bc-f404-460c-8aec-55196af2645d', 'volume_name': 'volume-59df17bc-f404-460c-8aec-55196af2645d', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:19 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a8bb1ae0-01a1-45d7-8c78-9b18dee18ffd tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae4bdc11-4fb2-4576-baf1-e97129d2fcee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:19 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a8bb1ae0-01a1-45d7-8c78-9b18dee18ffd tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae4bdc11-4fb2-4576-baf1-e97129d2fcee) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:19 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a8bb1ae0-01a1-45d7-8c78-9b18dee18ffd tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e38cf252-48b5-447f-910b-afe81e1778fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:19 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-a8bb1ae0-01a1-45d7-8c78-9b18dee18ffd tempest-VolumesSnapshotTestJSON-1948679985 None] Volume 59df17bc-f404-460c-8aec-55196af2645d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-59df17bc-f404-460c-8aec-55196af2645d', 'volume_size': 1} Nov 01 12:32:19 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a8bb1ae0-01a1-45d7-8c78-9b18dee18ffd tempest-VolumesSnapshotTestJSON-1948679985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:32:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-1996c358-5165-4465-912d-a866bde426ad tempest-VolumesActionsTest-573589455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 38.216s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:32:22 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-1996c358-5165-4465-912d-a866bde426ad tempest-VolumesActionsTest-573589455 None] Uploaded volume to glance image-id: b20788fe-5573-4997-9cd8-13bc0c5cf53e. {{(pid=86574) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 01 12:32:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a8bb1ae0-01a1-45d7-8c78-9b18dee18ffd tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.682s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:32:22 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a8bb1ae0-01a1-45d7-8c78-9b18dee18ffd tempest-VolumesSnapshotTestJSON-1948679985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:32:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-566658515',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=59df17bc-f404-460c-8aec-55196af2645d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91bd3d6227a3427c99d886af727c7024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:32:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:32:19Z,use_quota=True,user_id='a5b1003031114b029ede968cb9c9a409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:32:22 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-a8bb1ae0-01a1-45d7-8c78-9b18dee18ffd tempest-VolumesSnapshotTestJSON-1948679985 None] Creating volume 59df17bc-f404-460c-8aec-55196af2645d {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:32:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a8bb1ae0-01a1-45d7-8c78-9b18dee18ffd tempest-VolumesSnapshotTestJSON-1948679985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:32:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a8bb1ae0-01a1-45d7-8c78-9b18dee18ffd tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:32:22 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a8bb1ae0-01a1-45d7-8c78-9b18dee18ffd tempest-VolumesSnapshotTestJSON-1948679985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:32:22 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a8bb1ae0-01a1-45d7-8c78-9b18dee18ffd tempest-VolumesSnapshotTestJSON-1948679985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:32:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a8bb1ae0-01a1-45d7-8c78-9b18dee18ffd tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:32:22 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a8bb1ae0-01a1-45d7-8c78-9b18dee18ffd tempest-VolumesSnapshotTestJSON-1948679985 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:32:22 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-a8bb1ae0-01a1-45d7-8c78-9b18dee18ffd tempest-VolumesSnapshotTestJSON-1948679985 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:32:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a8bb1ae0-01a1-45d7-8c78-9b18dee18ffd tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-59df17bc-f404-460c-8aec-55196af2645d 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:22 devstack sudo[101176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-59df17bc-f404-460c-8aec-55196af2645d 1073741824 Nov 01 12:32:22 devstack sudo[101176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:22 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-1996c358-5165-4465-912d-a866bde426ad tempest-VolumesActionsTest-573589455 None] Copy volume to image completed successfully. Nov 01 12:32:22 devstack sudo[101176]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a8bb1ae0-01a1-45d7-8c78-9b18dee18ffd tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-59df17bc-f404-460c-8aec-55196af2645d 1073741824" returned: 0 in 0.538s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a8bb1ae0-01a1-45d7-8c78-9b18dee18ffd tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-59df17bc-f404-460c-8aec-55196af2645d {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:22 devstack sudo[101182]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-59df17bc-f404-460c-8aec-55196af2645d Nov 01 12:32:22 devstack sudo[101182]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:22 devstack sudo[101182]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a8bb1ae0-01a1-45d7-8c78-9b18dee18ffd tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-59df17bc-f404-460c-8aec-55196af2645d" returned: 0 in 0.267s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:22 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a8bb1ae0-01a1-45d7-8c78-9b18dee18ffd tempest-VolumesSnapshotTestJSON-1948679985 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:32:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a8bb1ae0-01a1-45d7-8c78-9b18dee18ffd tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.854s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:32:22 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a8bb1ae0-01a1-45d7-8c78-9b18dee18ffd tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e38cf252-48b5-447f-910b-afe81e1778fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-59df17bc-f404-460c-8aec-55196af2645d', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:22 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a8bb1ae0-01a1-45d7-8c78-9b18dee18ffd tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b082cf13-e50c-4910-9520-a739ab24cc2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:23 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-a8bb1ae0-01a1-45d7-8c78-9b18dee18ffd tempest-VolumesSnapshotTestJSON-1948679985 None] Volume volume-59df17bc-f404-460c-8aec-55196af2645d (59df17bc-f404-460c-8aec-55196af2645d): created successfully Nov 01 12:32:23 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a8bb1ae0-01a1-45d7-8c78-9b18dee18ffd tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b082cf13-e50c-4910-9520-a739ab24cc2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:23 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a8bb1ae0-01a1-45d7-8c78-9b18dee18ffd tempest-VolumesSnapshotTestJSON-1948679985 None] Flow 'volume_create_manager' (b6bfc9e8-2924-4aa3-b875-30c1756cda8d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:32:23 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-a8bb1ae0-01a1-45d7-8c78-9b18dee18ffd tempest-VolumesSnapshotTestJSON-1948679985 None] Created volume successfully. Nov 01 12:32:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-3a28114b-0a28-4e1c-a941-b5c7e4aec295 tempest-VolumesSnapshotTestJSON-1948679985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:32:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-3a28114b-0a28-4e1c-a941-b5c7e4aec295 tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:32:24 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-3a28114b-0a28-4e1c-a941-b5c7e4aec295 tempest-VolumesSnapshotTestJSON-1948679985 None] Creating offline snapshot 83528e9c-62c8-4a6c-930b-f73d270bd582 of volume 59df17bc-f404-460c-8aec-55196af2645d {{(pid=86574) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:32:24 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[e2a657c8-aec7-4734-9db6-bb6d30708530]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:32:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3a28114b-0a28-4e1c-a941-b5c7e4aec295 tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-59df17bc-f404-460c-8aec-55196af2645d {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:24 devstack sudo[101185]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-59df17bc-f404-460c-8aec-55196af2645d Nov 01 12:32:24 devstack sudo[101185]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-3c50803a-7841-476b-9774-114732b06449 tempest-VolumesActionsTest-573589455 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:32:24 devstack sudo[101185]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3a28114b-0a28-4e1c-a941-b5c7e4aec295 tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-59df17bc-f404-460c-8aec-55196af2645d" returned: 0 in 0.487s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3a28114b-0a28-4e1c-a941-b5c7e4aec295 tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-59df17bc-f404-460c-8aec-55196af2645d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-59df17bc-f404-460c-8aec-55196af2645d.83528e9c-62c8-4a6c-930b-f73d270bd582 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:24 devstack sudo[101190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-59df17bc-f404-460c-8aec-55196af2645d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-59df17bc-f404-460c-8aec-55196af2645d.83528e9c-62c8-4a6c-930b-f73d270bd582 1G Nov 01 12:32:24 devstack sudo[101190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:25 devstack sudo[101190]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3a28114b-0a28-4e1c-a941-b5c7e4aec295 tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-59df17bc-f404-460c-8aec-55196af2645d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-59df17bc-f404-460c-8aec-55196af2645d.83528e9c-62c8-4a6c-930b-f73d270bd582 1G" returned: 0 in 0.544s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3a28114b-0a28-4e1c-a941-b5c7e4aec295 tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59df17bc-f404-460c-8aec-55196af2645d -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-59df17bc-f404-460c-8aec-55196af2645d.83528e9c-62c8-4a6c-930b-f73d270bd582 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:25 devstack sudo[101196]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59df17bc-f404-460c-8aec-55196af2645d -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-59df17bc-f404-460c-8aec-55196af2645d.83528e9c-62c8-4a6c-930b-f73d270bd582 Nov 01 12:32:25 devstack sudo[101196]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:25 devstack sudo[101196]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3a28114b-0a28-4e1c-a941-b5c7e4aec295 tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-59df17bc-f404-460c-8aec-55196af2645d -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-59df17bc-f404-460c-8aec-55196af2645d.83528e9c-62c8-4a6c-930b-f73d270bd582" returned: 0 in 0.358s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:25 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-3a28114b-0a28-4e1c-a941-b5c7e4aec295 tempest-VolumesSnapshotTestJSON-1948679985 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-59df17bc-f404-460c-8aec-55196af2645d.83528e9c-62c8-4a6c-930b-f73d270bd582 is being set with open permissions: ugo+rw Nov 01 12:32:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3a28114b-0a28-4e1c-a941-b5c7e4aec295 tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-59df17bc-f404-460c-8aec-55196af2645d.83528e9c-62c8-4a6c-930b-f73d270bd582 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:25 devstack sudo[101201]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-59df17bc-f404-460c-8aec-55196af2645d.83528e9c-62c8-4a6c-930b-f73d270bd582 Nov 01 12:32:25 devstack sudo[101201]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:25 devstack sudo[101201]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3a28114b-0a28-4e1c-a941-b5c7e4aec295 tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-59df17bc-f404-460c-8aec-55196af2645d.83528e9c-62c8-4a6c-930b-f73d270bd582" returned: 0 in 0.309s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3a28114b-0a28-4e1c-a941-b5c7e4aec295 tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-59df17bc-f404-460c-8aec-55196af2645d.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:26 devstack sudo[101204]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-59df17bc-f404-460c-8aec-55196af2645d.info Nov 01 12:32:26 devstack sudo[101204]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:26 devstack sudo[101204]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3a28114b-0a28-4e1c-a941-b5c7e4aec295 tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-59df17bc-f404-460c-8aec-55196af2645d.info" returned: 0 in 0.351s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:26 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-3a28114b-0a28-4e1c-a941-b5c7e4aec295 tempest-VolumesSnapshotTestJSON-1948679985 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-59df17bc-f404-460c-8aec-55196af2645d.info is being set with open permissions: ugo+rw Nov 01 12:32:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3a28114b-0a28-4e1c-a941-b5c7e4aec295 tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-59df17bc-f404-460c-8aec-55196af2645d.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:26 devstack sudo[101207]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-59df17bc-f404-460c-8aec-55196af2645d.info Nov 01 12:32:26 devstack sudo[101207]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:26 devstack sudo[101207]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3a28114b-0a28-4e1c-a941-b5c7e4aec295 tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-59df17bc-f404-460c-8aec-55196af2645d.info" returned: 0 in 0.305s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-3a28114b-0a28-4e1c-a941-b5c7e4aec295 tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.502s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:32:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-3c50803a-7841-476b-9774-114732b06449 tempest-VolumesActionsTest-573589455 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 2.143s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:32:26 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb75dcdf-abd9-4e54-9708-ed6c43997ee7]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:32:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3c50803a-7841-476b-9774-114732b06449 tempest-VolumesActionsTest-573589455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-79d240f8-e8a1-4d53-8697-972a549fb950 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:26 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-3a28114b-0a28-4e1c-a941-b5c7e4aec295 tempest-VolumesSnapshotTestJSON-1948679985 None] Create snapshot completed successfully Nov 01 12:32:26 devstack sudo[101210]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-79d240f8-e8a1-4d53-8697-972a549fb950 Nov 01 12:32:26 devstack sudo[101210]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:27 devstack sudo[101210]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3c50803a-7841-476b-9774-114732b06449 tempest-VolumesActionsTest-573589455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-79d240f8-e8a1-4d53-8697-972a549fb950" returned: 0 in 0.516s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:27 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[faf65f31-ec05-4a5f-9af7-b4aaaf9c02ab]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:32:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3c50803a-7841-476b-9774-114732b06449 tempest-VolumesActionsTest-573589455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-79d240f8-e8a1-4d53-8697-972a549fb950 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:27 devstack sudo[101215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-79d240f8-e8a1-4d53-8697-972a549fb950 Nov 01 12:32:27 devstack sudo[101215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:27 devstack sudo[101215]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3c50803a-7841-476b-9774-114732b06449 tempest-VolumesActionsTest-573589455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-79d240f8-e8a1-4d53-8697-972a549fb950" returned: 0 in 0.507s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3c50803a-7841-476b-9774-114732b06449 tempest-VolumesActionsTest-573589455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-79d240f8-e8a1-4d53-8697-972a549fb950 /opt/stack/data/cinder/conversion/79d240f8-e8a1-4d53-8697-972a549fb950.temp_image.4febecda-bf3e-4222-82bd-78693f36bd92yyxcal6o.img {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:27 devstack sudo[101220]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-79d240f8-e8a1-4d53-8697-972a549fb950 /opt/stack/data/cinder/conversion/79d240f8-e8a1-4d53-8697-972a549fb950.temp_image.4febecda-bf3e-4222-82bd-78693f36bd92yyxcal6o.img Nov 01 12:32:27 devstack sudo[101220]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:27 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-eb0b1528-4b53-49c0-baab-6caff1c46a6e tempest-VolumesSnapshotTestJSON-1948679985 None] Acquiring lock "cinder-83528e9c-62c8-4a6c-930b-f73d270bd582-delete_snapshot" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:32:27 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-eb0b1528-4b53-49c0-baab-6caff1c46a6e tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "cinder-83528e9c-62c8-4a6c-930b-f73d270bd582-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:32:27 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-eb0b1528-4b53-49c0-baab-6caff1c46a6e tempest-VolumesSnapshotTestJSON-1948679985 None] Acquiring lock "cinder-quobyte-59df17bc-f404-460c-8aec-55196af2645d" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:32:27 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-eb0b1528-4b53-49c0-baab-6caff1c46a6e tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "cinder-quobyte-59df17bc-f404-460c-8aec-55196af2645d" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:32:27 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-eb0b1528-4b53-49c0-baab-6caff1c46a6e tempest-VolumesSnapshotTestJSON-1948679985 None] Acquiring lock "cinder-quobyte-83528e9c-62c8-4a6c-930b-f73d270bd582" by "_delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:32:27 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-eb0b1528-4b53-49c0-baab-6caff1c46a6e tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "cinder-quobyte-83528e9c-62c8-4a6c-930b-f73d270bd582" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:32:27 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-eb0b1528-4b53-49c0-baab-6caff1c46a6e tempest-VolumesSnapshotTestJSON-1948679985 None] Deleting offline snapshot 83528e9c-62c8-4a6c-930b-f73d270bd582 of volume 59df17bc-f404-460c-8aec-55196af2645d {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:32:28 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-eb0b1528-4b53-49c0-baab-6caff1c46a6e tempest-VolumesSnapshotTestJSON-1948679985 None] snapshot_file for this snap is: volume-59df17bc-f404-460c-8aec-55196af2645d.83528e9c-62c8-4a6c-930b-f73d270bd582 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:32:28 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[eee5d70e-1b2b-4aa0-a0c9-2e8e8bce21d5]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:32:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eb0b1528-4b53-49c0-baab-6caff1c46a6e tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-59df17bc-f404-460c-8aec-55196af2645d.83528e9c-62c8-4a6c-930b-f73d270bd582 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:28 devstack sudo[101222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-59df17bc-f404-460c-8aec-55196af2645d.83528e9c-62c8-4a6c-930b-f73d270bd582 Nov 01 12:32:28 devstack sudo[101222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:28 devstack sudo[101222]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eb0b1528-4b53-49c0-baab-6caff1c46a6e tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-59df17bc-f404-460c-8aec-55196af2645d.83528e9c-62c8-4a6c-930b-f73d270bd582" returned: 0 in 0.945s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:28 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-eb0b1528-4b53-49c0-baab-6caff1c46a6e tempest-VolumesSnapshotTestJSON-1948679985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-59df17bc-f404-460c-8aec-55196af2645d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:32:29 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[a8604a95-569f-41ff-921c-45f786bc4736]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:32:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eb0b1528-4b53-49c0-baab-6caff1c46a6e tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-59df17bc-f404-460c-8aec-55196af2645d {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:29 devstack sudo[101238]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-59df17bc-f404-460c-8aec-55196af2645d Nov 01 12:32:29 devstack sudo[101238]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:29 devstack sudo[101238]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eb0b1528-4b53-49c0-baab-6caff1c46a6e tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-59df17bc-f404-460c-8aec-55196af2645d" returned: 0 in 0.902s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eb0b1528-4b53-49c0-baab-6caff1c46a6e tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-59df17bc-f404-460c-8aec-55196af2645d.83528e9c-62c8-4a6c-930b-f73d270bd582 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:30 devstack sudo[101243]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-59df17bc-f404-460c-8aec-55196af2645d.83528e9c-62c8-4a6c-930b-f73d270bd582 Nov 01 12:32:30 devstack sudo[101243]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:30 devstack sudo[101243]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eb0b1528-4b53-49c0-baab-6caff1c46a6e tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-59df17bc-f404-460c-8aec-55196af2645d.83528e9c-62c8-4a6c-930b-f73d270bd582" returned: 0 in 0.781s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eb0b1528-4b53-49c0-baab-6caff1c46a6e tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-59df17bc-f404-460c-8aec-55196af2645d.83528e9c-62c8-4a6c-930b-f73d270bd582 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:30 devstack sudo[101249]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-59df17bc-f404-460c-8aec-55196af2645d.83528e9c-62c8-4a6c-930b-f73d270bd582 Nov 01 12:32:30 devstack sudo[101249]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:31 devstack sudo[101249]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eb0b1528-4b53-49c0-baab-6caff1c46a6e tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-59df17bc-f404-460c-8aec-55196af2645d.83528e9c-62c8-4a6c-930b-f73d270bd582" returned: 0 in 0.588s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:31 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-eb0b1528-4b53-49c0-baab-6caff1c46a6e tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "cinder-quobyte-83528e9c-62c8-4a6c-930b-f73d270bd582" released by "_delete_snapshot" :: held 3.487s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:32:31 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-eb0b1528-4b53-49c0-baab-6caff1c46a6e tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "cinder-quobyte-59df17bc-f404-460c-8aec-55196af2645d" released by "delete_snapshot" :: held 3.525s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:32:31 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-eb0b1528-4b53-49c0-baab-6caff1c46a6e tempest-VolumesSnapshotTestJSON-1948679985 None] Created reservations ['3e7fa101-5d28-4507-ba05-94ca4c75da12', '77c2c8bc-2c42-4c5c-a3d3-40131e06a24a', '159ab1cd-ffbe-412c-803d-6aa06f4d3d32', 'de2b603a-be46-4ebd-b21f-6d6703ae497d'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:32:31 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-eb0b1528-4b53-49c0-baab-6caff1c46a6e tempest-VolumesSnapshotTestJSON-1948679985 None] Delete snapshot completed successfully. Nov 01 12:32:31 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-eb0b1528-4b53-49c0-baab-6caff1c46a6e tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "cinder-83528e9c-62c8-4a6c-930b-f73d270bd582-delete_snapshot" released by "delete_snapshot" :: held 4.029s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:32:33 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-56a69da9-9591-4e05-8050-b683f66e40af tempest-VolumesSnapshotTestJSON-1948679985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:32:33 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-56a69da9-9591-4e05-8050-b683f66e40af tempest-VolumesSnapshotTestJSON-1948679985 None] Flow 'volume_create_manager' (be393f64-7eed-4a2b-899a-c733517abd5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:32:33 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-56a69da9-9591-4e05-8050-b683f66e40af tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a40844be-cec1-4144-b657-68de01d5d6f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:33 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-56a69da9-9591-4e05-8050-b683f66e40af tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a40844be-cec1-4144-b657-68de01d5d6f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-433906631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91bd3d6227a3427c99d886af727c7024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:32:34Z,use_quota=True,user_id='a5b1003031114b029ede968cb9c9a409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:33 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-56a69da9-9591-4e05-8050-b683f66e40af tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6707ef27-95e4-4371-bdcc-0bcd8ea20860) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:33 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-56a69da9-9591-4e05-8050-b683f66e40af tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6707ef27-95e4-4371-bdcc-0bcd8ea20860) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:33 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-56a69da9-9591-4e05-8050-b683f66e40af tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7df73e47-4014-4895-b3d5-13cff55e48eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:33 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-56a69da9-9591-4e05-8050-b683f66e40af tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7df73e47-4014-4895-b3d5-13cff55e48eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45', 'volume_name': 'volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:33 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-56a69da9-9591-4e05-8050-b683f66e40af tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43e6b1a9-9e3a-4a2b-bb5c-a8d9385eb1a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:33 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-56a69da9-9591-4e05-8050-b683f66e40af tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (43e6b1a9-9e3a-4a2b-bb5c-a8d9385eb1a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:34 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-56a69da9-9591-4e05-8050-b683f66e40af tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5892ef40-d329-4efa-96ac-544472f12a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:34 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-56a69da9-9591-4e05-8050-b683f66e40af tempest-VolumesSnapshotTestJSON-1948679985 None] Volume 380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45', 'volume_size': 1} Nov 01 12:32:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-56a69da9-9591-4e05-8050-b683f66e40af tempest-VolumesSnapshotTestJSON-1948679985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:32:36 devstack sudo[101220]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3c50803a-7841-476b-9774-114732b06449 tempest-VolumesActionsTest-573589455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-79d240f8-e8a1-4d53-8697-972a549fb950 /opt/stack/data/cinder/conversion/79d240f8-e8a1-4d53-8697-972a549fb950.temp_image.4febecda-bf3e-4222-82bd-78693f36bd92yyxcal6o.img" returned: 0 in 8.886s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:36 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[2a37a0c6-933c-4bda-9b6a-1cf9d0f5f01c]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:32:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3c50803a-7841-476b-9774-114732b06449 tempest-VolumesActionsTest-573589455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-79d240f8-e8a1-4d53-8697-972a549fb950 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:36 devstack sudo[101253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-79d240f8-e8a1-4d53-8697-972a549fb950 Nov 01 12:32:36 devstack sudo[101253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:37 devstack sudo[101253]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3c50803a-7841-476b-9774-114732b06449 tempest-VolumesActionsTest-573589455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-79d240f8-e8a1-4d53-8697-972a549fb950" returned: 0 in 0.649s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:37 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-3c50803a-7841-476b-9774-114732b06449 tempest-VolumesActionsTest-573589455 None] Image conversion details: src /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-79d240f8-e8a1-4d53-8697-972a549fb950, size 1024.00 MB, duration 8.89 sec, destination /opt/stack/data/cinder/conversion/79d240f8-e8a1-4d53-8697-972a549fb950.temp_image.4febecda-bf3e-4222-82bd-78693f36bd92yyxcal6o.img {{(pid=86574) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 12:32:37 devstack cinder-volume[86574]: INFO cinder.image.image_utils [None req-3c50803a-7841-476b-9774-114732b06449 tempest-VolumesActionsTest-573589455 None] Converted 1024.00 MB image at 115.21 MB/s Nov 01 12:32:37 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-3c50803a-7841-476b-9774-114732b06449 tempest-VolumesActionsTest-573589455 None] 4febecda-bf3e-4222-82bd-78693f36bd92 was raw, converting to qcow2 {{(pid=86574) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1203}} Nov 01 12:32:37 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[8dd7e091-dd96-4898-b455-bdf9c15a6592]: (4, 'raw') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:32:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3c50803a-7841-476b-9774-114732b06449 tempest-VolumesActionsTest-573589455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/79d240f8-e8a1-4d53-8697-972a549fb950.temp_image.4febecda-bf3e-4222-82bd-78693f36bd92yyxcal6o.img {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:37 devstack sudo[101258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/79d240f8-e8a1-4d53-8697-972a549fb950.temp_image.4febecda-bf3e-4222-82bd-78693f36bd92yyxcal6o.img Nov 01 12:32:37 devstack sudo[101258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:37 devstack sudo[101258]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3c50803a-7841-476b-9774-114732b06449 tempest-VolumesActionsTest-573589455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/79d240f8-e8a1-4d53-8697-972a549fb950.temp_image.4febecda-bf3e-4222-82bd-78693f36bd92yyxcal6o.img" returned: 0 in 0.370s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3c50803a-7841-476b-9774-114732b06449 tempest-VolumesActionsTest-573589455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/79d240f8-e8a1-4d53-8697-972a549fb950.temp_image.4febecda-bf3e-4222-82bd-78693f36bd92yyxcal6o.img {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:37 devstack sudo[101262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/79d240f8-e8a1-4d53-8697-972a549fb950.temp_image.4febecda-bf3e-4222-82bd-78693f36bd92yyxcal6o.img Nov 01 12:32:37 devstack sudo[101262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:38 devstack sudo[101262]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3c50803a-7841-476b-9774-114732b06449 tempest-VolumesActionsTest-573589455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/79d240f8-e8a1-4d53-8697-972a549fb950.temp_image.4febecda-bf3e-4222-82bd-78693f36bd92yyxcal6o.img" returned: 1 in 0.362s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3c50803a-7841-476b-9774-114732b06449 tempest-VolumesActionsTest-573589455 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/79d240f8-e8a1-4d53-8697-972a549fb950.temp_image.4febecda-bf3e-4222-82bd-78693f36bd92yyxcal6o.img' failed. Not Retrying. {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 12:32:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3c50803a-7841-476b-9774-114732b06449 tempest-VolumesActionsTest-573589455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/79d240f8-e8a1-4d53-8697-972a549fb950.temp_image.4febecda-bf3e-4222-82bd-78693f36bd92yyxcal6o.img /opt/stack/data/cinder/conversion/vol_upload_9d2cs2fb {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:38 devstack sudo[101268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/79d240f8-e8a1-4d53-8697-972a549fb950.temp_image.4febecda-bf3e-4222-82bd-78693f36bd92yyxcal6o.img /opt/stack/data/cinder/conversion/vol_upload_9d2cs2fb Nov 01 12:32:38 devstack sudo[101268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:38 devstack sudo[101268]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3c50803a-7841-476b-9774-114732b06449 tempest-VolumesActionsTest-573589455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/79d240f8-e8a1-4d53-8697-972a549fb950.temp_image.4febecda-bf3e-4222-82bd-78693f36bd92yyxcal6o.img /opt/stack/data/cinder/conversion/vol_upload_9d2cs2fb" returned: 0 in 0.302s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:38 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-3c50803a-7841-476b-9774-114732b06449 tempest-VolumesActionsTest-573589455 None] Image conversion details: src /opt/stack/data/cinder/conversion/79d240f8-e8a1-4d53-8697-972a549fb950.temp_image.4febecda-bf3e-4222-82bd-78693f36bd92yyxcal6o.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_9d2cs2fb {{(pid=86574) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 12:32:38 devstack cinder-volume[86574]: INFO cinder.image.image_utils [None req-3c50803a-7841-476b-9774-114732b06449 tempest-VolumesActionsTest-573589455 None] Converted 1024.00 MB image at 1024.00 MB/s Nov 01 12:32:38 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0708004-1fd8-4a35-b72c-568f73c5af3e]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:32:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3c50803a-7841-476b-9774-114732b06449 tempest-VolumesActionsTest-573589455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_9d2cs2fb {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:38 devstack sudo[101276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_9d2cs2fb Nov 01 12:32:38 devstack sudo[101276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:38 devstack sudo[101276]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3c50803a-7841-476b-9774-114732b06449 tempest-VolumesActionsTest-573589455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_9d2cs2fb" returned: 0 in 0.354s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:39 devstack cinder-volume[86574]: DEBUG oslo_service.periodic_task [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86574) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:32:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:32:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:32:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:32:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:32:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:32:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:39 devstack sudo[101282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:32:39 devstack sudo[101282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:40 devstack sudo[101282]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.366s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:40 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:32:40 devstack cinder-volume[86574]: DEBUG oslo_service.periodic_task [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running periodic task VolumeManager._thread_info {{(pid=86574) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:32:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] thread count: 28 {{(pid=86574) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 12:32:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] thread info: [<_MainThread(MainThread, started 131331184930944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86574) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 12:32:40 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-aba65548-e91e-49fb-8377-81c335a33a35 tempest-TestStampPattern-399521859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:32:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-aba65548-e91e-49fb-8377-81c335a33a35 tempest-TestStampPattern-399521859 None] Flow 'volume_create_manager' (d5677acd-3fbf-4959-a243-b38d474c7a57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:32:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-aba65548-e91e-49fb-8377-81c335a33a35 tempest-TestStampPattern-399521859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e66c4c47-aba4-4c6b-96fa-5a986104df73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-aba65548-e91e-49fb-8377-81c335a33a35 tempest-TestStampPattern-399521859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e66c4c47-aba4-4c6b-96fa-5a986104df73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-4893104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bee0113-3ffb-4a91-8376-422bef6e15db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7434afa1297e4ee4bad1a159b695131e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:32:41Z,use_quota=True,user_id='65258bf8c21b48319350ce6c5b404a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-aba65548-e91e-49fb-8377-81c335a33a35 tempest-TestStampPattern-399521859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f912789-17b5-4e4e-a4fa-adebfdce0ab9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-aba65548-e91e-49fb-8377-81c335a33a35 tempest-TestStampPattern-399521859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8f912789-17b5-4e4e-a4fa-adebfdce0ab9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-aba65548-e91e-49fb-8377-81c335a33a35 tempest-TestStampPattern-399521859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5e4bd01-3bb4-4eda-bf23-a94ffe35ca69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-aba65548-e91e-49fb-8377-81c335a33a35 tempest-TestStampPattern-399521859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5e4bd01-3bb4-4eda-bf23-a94ffe35ca69) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3bee0113-3ffb-4a91-8376-422bef6e15db', 'volume_name': 'volume-3bee0113-3ffb-4a91-8376-422bef6e15db', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-aba65548-e91e-49fb-8377-81c335a33a35 tempest-TestStampPattern-399521859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d21b880d-d5f9-4ad8-bb1a-85bd89b7ed93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-aba65548-e91e-49fb-8377-81c335a33a35 tempest-TestStampPattern-399521859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d21b880d-d5f9-4ad8-bb1a-85bd89b7ed93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-aba65548-e91e-49fb-8377-81c335a33a35 tempest-TestStampPattern-399521859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e2bc8d8-65e0-41c4-b006-e006c59a479a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:40 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-aba65548-e91e-49fb-8377-81c335a33a35 tempest-TestStampPattern-399521859 None] Volume 3bee0113-3ffb-4a91-8376-422bef6e15db: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3bee0113-3ffb-4a91-8376-422bef6e15db', 'volume_size': 1} Nov 01 12:32:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-aba65548-e91e-49fb-8377-81c335a33a35 tempest-TestStampPattern-399521859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:32:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-3c50803a-7841-476b-9774-114732b06449 tempest-VolumesActionsTest-573589455 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 14.332s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:32:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-3c50803a-7841-476b-9774-114732b06449 tempest-VolumesActionsTest-573589455 None] Uploaded volume to glance image-id: 4febecda-bf3e-4222-82bd-78693f36bd92. {{(pid=86574) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 01 12:32:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-56a69da9-9591-4e05-8050-b683f66e40af tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.064s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:32:41 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-56a69da9-9591-4e05-8050-b683f66e40af tempest-VolumesSnapshotTestJSON-1948679985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:32:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-433906631',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91bd3d6227a3427c99d886af727c7024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:32:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:32:34Z,use_quota=True,user_id='a5b1003031114b029ede968cb9c9a409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:32:41 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-56a69da9-9591-4e05-8050-b683f66e40af tempest-VolumesSnapshotTestJSON-1948679985 None] Creating volume 380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:32:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-56a69da9-9591-4e05-8050-b683f66e40af tempest-VolumesSnapshotTestJSON-1948679985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:32:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-56a69da9-9591-4e05-8050-b683f66e40af tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:32:41 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-56a69da9-9591-4e05-8050-b683f66e40af tempest-VolumesSnapshotTestJSON-1948679985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:32:41 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-56a69da9-9591-4e05-8050-b683f66e40af tempest-VolumesSnapshotTestJSON-1948679985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:32:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-56a69da9-9591-4e05-8050-b683f66e40af tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:32:41 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-56a69da9-9591-4e05-8050-b683f66e40af tempest-VolumesSnapshotTestJSON-1948679985 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:32:41 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-56a69da9-9591-4e05-8050-b683f66e40af tempest-VolumesSnapshotTestJSON-1948679985 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:32:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-56a69da9-9591-4e05-8050-b683f66e40af tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:41 devstack sudo[101327]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45 1073741824 Nov 01 12:32:41 devstack sudo[101327]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:41 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-3c50803a-7841-476b-9774-114732b06449 tempest-VolumesActionsTest-573589455 None] Copy volume to image completed successfully. Nov 01 12:32:41 devstack sudo[101327]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-56a69da9-9591-4e05-8050-b683f66e40af tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45 1073741824" returned: 0 in 0.660s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-56a69da9-9591-4e05-8050-b683f66e40af tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:41 devstack sudo[101333]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45 Nov 01 12:32:41 devstack sudo[101333]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:42 devstack sudo[101333]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-56a69da9-9591-4e05-8050-b683f66e40af tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45" returned: 0 in 0.502s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:42 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-56a69da9-9591-4e05-8050-b683f66e40af tempest-VolumesSnapshotTestJSON-1948679985 None] <== create_volume: return (1268ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:32:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-56a69da9-9591-4e05-8050-b683f66e40af tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.271s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:32:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-aba65548-e91e-49fb-8377-81c335a33a35 tempest-TestStampPattern-399521859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.535s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:32:42 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-aba65548-e91e-49fb-8377-81c335a33a35 tempest-TestStampPattern-399521859 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:32:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-4893104',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3bee0113-3ffb-4a91-8376-422bef6e15db,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7434afa1297e4ee4bad1a159b695131e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:32:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:32:41Z,use_quota=True,user_id='65258bf8c21b48319350ce6c5b404a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:32:42 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-aba65548-e91e-49fb-8377-81c335a33a35 tempest-TestStampPattern-399521859 None] Creating volume 3bee0113-3ffb-4a91-8376-422bef6e15db {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:32:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-aba65548-e91e-49fb-8377-81c335a33a35 tempest-TestStampPattern-399521859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:32:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-aba65548-e91e-49fb-8377-81c335a33a35 tempest-TestStampPattern-399521859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:32:42 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-aba65548-e91e-49fb-8377-81c335a33a35 tempest-TestStampPattern-399521859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:32:42 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-aba65548-e91e-49fb-8377-81c335a33a35 tempest-TestStampPattern-399521859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:32:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-aba65548-e91e-49fb-8377-81c335a33a35 tempest-TestStampPattern-399521859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:32:42 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-aba65548-e91e-49fb-8377-81c335a33a35 tempest-TestStampPattern-399521859 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:32:42 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-aba65548-e91e-49fb-8377-81c335a33a35 tempest-TestStampPattern-399521859 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:32:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-aba65548-e91e-49fb-8377-81c335a33a35 tempest-TestStampPattern-399521859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:42 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-56a69da9-9591-4e05-8050-b683f66e40af tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5892ef40-d329-4efa-96ac-544472f12a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:42 devstack sudo[101339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db 1073741824 Nov 01 12:32:42 devstack sudo[101339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:42 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-56a69da9-9591-4e05-8050-b683f66e40af tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0c9ddc4-99f6-4b87-b7e4-f7cd0436c02b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:42 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-56a69da9-9591-4e05-8050-b683f66e40af tempest-VolumesSnapshotTestJSON-1948679985 None] Volume volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45 (380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45): created successfully Nov 01 12:32:42 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-56a69da9-9591-4e05-8050-b683f66e40af tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0c9ddc4-99f6-4b87-b7e4-f7cd0436c02b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:42 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-56a69da9-9591-4e05-8050-b683f66e40af tempest-VolumesSnapshotTestJSON-1948679985 None] Flow 'volume_create_manager' (be393f64-7eed-4a2b-899a-c733517abd5a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:32:42 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-56a69da9-9591-4e05-8050-b683f66e40af tempest-VolumesSnapshotTestJSON-1948679985 None] Created volume successfully. Nov 01 12:32:42 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-9399d244-5451-4194-83ee-3eca10717258 tempest-VolumesActionsTest-573589455 None] Acquiring lock "cinder-79d240f8-e8a1-4d53-8697-972a549fb950-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:32:42 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-9399d244-5451-4194-83ee-3eca10717258 tempest-VolumesActionsTest-573589455 None] Lock "cinder-79d240f8-e8a1-4d53-8697-972a549fb950-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:32:43 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-9399d244-5451-4194-83ee-3eca10717258 tempest-VolumesActionsTest-573589455 None] Acquiring lock "cinder-quobyte-79d240f8-e8a1-4d53-8697-972a549fb950" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:32:43 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-9399d244-5451-4194-83ee-3eca10717258 tempest-VolumesActionsTest-573589455 None] Lock "cinder-quobyte-79d240f8-e8a1-4d53-8697-972a549fb950" acquired by "delete_volume" :: waited 0.033s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:32:43 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2ea0933-d614-4c1f-abbe-a8d9af9f0cc6]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:32:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9399d244-5451-4194-83ee-3eca10717258 tempest-VolumesActionsTest-573589455 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-79d240f8-e8a1-4d53-8697-972a549fb950 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:43 devstack sudo[101339]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-aba65548-e91e-49fb-8377-81c335a33a35 tempest-TestStampPattern-399521859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db 1073741824" returned: 0 in 0.811s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-aba65548-e91e-49fb-8377-81c335a33a35 tempest-TestStampPattern-399521859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:43 devstack sudo[101345]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-79d240f8-e8a1-4d53-8697-972a549fb950 Nov 01 12:32:43 devstack sudo[101345]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:43 devstack sudo[101347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db Nov 01 12:32:43 devstack sudo[101347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:43 devstack sudo[101347]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-aba65548-e91e-49fb-8377-81c335a33a35 tempest-TestStampPattern-399521859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db" returned: 0 in 0.514s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:43 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-aba65548-e91e-49fb-8377-81c335a33a35 tempest-TestStampPattern-399521859 None] <== create_volume: return (1432ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:32:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-aba65548-e91e-49fb-8377-81c335a33a35 tempest-TestStampPattern-399521859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.438s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:32:43 devstack sudo[101345]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:43 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-aba65548-e91e-49fb-8377-81c335a33a35 tempest-TestStampPattern-399521859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5e2bc8d8-65e0-41c4-b006-e006c59a479a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3bee0113-3ffb-4a91-8376-422bef6e15db', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:43 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-aba65548-e91e-49fb-8377-81c335a33a35 tempest-TestStampPattern-399521859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5524038-9b4a-4c55-8d2b-d6a9a86d9f80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-3e3a44d8-1ac4-4e76-841c-697263f5192c tempest-VolumesSnapshotTestJSON-1948679985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:32:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-3e3a44d8-1ac4-4e76-841c-697263f5192c tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:32:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9399d244-5451-4194-83ee-3eca10717258 tempest-VolumesActionsTest-573589455 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-79d240f8-e8a1-4d53-8697-972a549fb950" returned: 0 in 0.674s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9399d244-5451-4194-83ee-3eca10717258 tempest-VolumesActionsTest-573589455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-79d240f8-e8a1-4d53-8697-972a549fb950 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:43 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-aba65548-e91e-49fb-8377-81c335a33a35 tempest-TestStampPattern-399521859 None] Volume volume-3bee0113-3ffb-4a91-8376-422bef6e15db (3bee0113-3ffb-4a91-8376-422bef6e15db): created successfully Nov 01 12:32:43 devstack sudo[101353]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-79d240f8-e8a1-4d53-8697-972a549fb950 Nov 01 12:32:43 devstack sudo[101353]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:43 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-aba65548-e91e-49fb-8377-81c335a33a35 tempest-TestStampPattern-399521859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5524038-9b4a-4c55-8d2b-d6a9a86d9f80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:43 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-aba65548-e91e-49fb-8377-81c335a33a35 tempest-TestStampPattern-399521859 None] Flow 'volume_create_manager' (d5677acd-3fbf-4959-a243-b38d474c7a57) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:32:43 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-3e3a44d8-1ac4-4e76-841c-697263f5192c tempest-VolumesSnapshotTestJSON-1948679985 None] Creating offline snapshot 4c99ccbe-39f3-4371-aff2-5d9ef2dcce45 of volume 380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45 {{(pid=86574) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:32:43 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-aba65548-e91e-49fb-8377-81c335a33a35 tempest-TestStampPattern-399521859 None] Created volume successfully. Nov 01 12:32:43 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea4540d6-d874-4888-a39d-101bb056e97f]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:32:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3e3a44d8-1ac4-4e76-841c-697263f5192c tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:44 devstack sudo[101355]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45 Nov 01 12:32:44 devstack sudo[101355]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:44 devstack sudo[101353]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9399d244-5451-4194-83ee-3eca10717258 tempest-VolumesActionsTest-573589455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-79d240f8-e8a1-4d53-8697-972a549fb950" returned: 0 in 0.339s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:44 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-9399d244-5451-4194-83ee-3eca10717258 tempest-VolumesActionsTest-573589455 None] Lock "cinder-quobyte-79d240f8-e8a1-4d53-8697-972a549fb950" released by "delete_volume" :: held 1.108s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:32:44 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-9399d244-5451-4194-83ee-3eca10717258 tempest-VolumesActionsTest-573589455 None] Created reservations ['4b37ffe7-8adc-45ca-85b2-e11f94173446', '3799a3b5-6767-4415-925a-b997c7cbdc9d', '63976bca-0b7a-495b-aecc-c8907b220dec', 'b2b756df-f135-4cd5-948f-ceaa742155c5'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:32:44 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-5069133b-1136-4d3a-9908-d8edb96e61e5 tempest-SnapshotDependencyTests-692331658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:32:44 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5069133b-1136-4d3a-9908-d8edb96e61e5 tempest-SnapshotDependencyTests-692331658 None] Flow 'volume_create_manager' (6526b3dd-f390-4342-a75e-0774d01fa99b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:32:44 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5069133b-1136-4d3a-9908-d8edb96e61e5 tempest-SnapshotDependencyTests-692331658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6e96e43-5923-4ca8-86d2-35973c740fdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:44 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5069133b-1136-4d3a-9908-d8edb96e61e5 tempest-SnapshotDependencyTests-692331658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a6e96e43-5923-4ca8-86d2-35973c740fdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1084748323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57b5882e-b660-4dbc-9dae-7446d6382ad0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de693726bb694975920322096220bb7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:32:44Z,use_quota=True,user_id='5abe3d18f5f14185b2c5be72c250cd5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:44 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5069133b-1136-4d3a-9908-d8edb96e61e5 tempest-SnapshotDependencyTests-692331658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86d8780f-9a90-42f2-ba39-9cdbab02b294) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:44 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5069133b-1136-4d3a-9908-d8edb96e61e5 tempest-SnapshotDependencyTests-692331658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (86d8780f-9a90-42f2-ba39-9cdbab02b294) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:44 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5069133b-1136-4d3a-9908-d8edb96e61e5 tempest-SnapshotDependencyTests-692331658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4558dab4-c26a-4b32-916a-157dfe647f5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:44 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5069133b-1136-4d3a-9908-d8edb96e61e5 tempest-SnapshotDependencyTests-692331658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4558dab4-c26a-4b32-916a-157dfe647f5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57b5882e-b660-4dbc-9dae-7446d6382ad0', 'volume_name': 'volume-57b5882e-b660-4dbc-9dae-7446d6382ad0', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:44 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5069133b-1136-4d3a-9908-d8edb96e61e5 tempest-SnapshotDependencyTests-692331658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1544fb5f-9731-4e99-8f18-7d01320ae503) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:44 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5069133b-1136-4d3a-9908-d8edb96e61e5 tempest-SnapshotDependencyTests-692331658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1544fb5f-9731-4e99-8f18-7d01320ae503) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:44 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5069133b-1136-4d3a-9908-d8edb96e61e5 tempest-SnapshotDependencyTests-692331658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (005a7395-3d75-413a-a707-6d1d58d10d8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:44 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-5069133b-1136-4d3a-9908-d8edb96e61e5 tempest-SnapshotDependencyTests-692331658 None] Volume 57b5882e-b660-4dbc-9dae-7446d6382ad0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57b5882e-b660-4dbc-9dae-7446d6382ad0', 'volume_size': 1} Nov 01 12:32:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5069133b-1136-4d3a-9908-d8edb96e61e5 tempest-SnapshotDependencyTests-692331658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:32:44 devstack sudo[101355]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3e3a44d8-1ac4-4e76-841c-697263f5192c tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45" returned: 0 in 0.574s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3e3a44d8-1ac4-4e76-841c-697263f5192c tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45.4c99ccbe-39f3-4371-aff2-5d9ef2dcce45 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-9399d244-5451-4194-83ee-3eca10717258 tempest-VolumesActionsTest-573589455 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:32:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-9399d244-5451-4194-83ee-3eca10717258 tempest-VolumesActionsTest-573589455 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:32:44 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-9399d244-5451-4194-83ee-3eca10717258 tempest-VolumesActionsTest-573589455 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:32:44 devstack sudo[101363]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45.4c99ccbe-39f3-4371-aff2-5d9ef2dcce45 1G Nov 01 12:32:44 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-9399d244-5451-4194-83ee-3eca10717258 tempest-VolumesActionsTest-573589455 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:32:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-9399d244-5451-4194-83ee-3eca10717258 tempest-VolumesActionsTest-573589455 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:32:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9399d244-5451-4194-83ee-3eca10717258 tempest-VolumesActionsTest-573589455 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:44 devstack sudo[101363]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:44 devstack sudo[101365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:32:44 devstack sudo[101365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:44 devstack sudo[101365]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9399d244-5451-4194-83ee-3eca10717258 tempest-VolumesActionsTest-573589455 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.303s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:44 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-9399d244-5451-4194-83ee-3eca10717258 tempest-VolumesActionsTest-573589455 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:32:44 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-9399d244-5451-4194-83ee-3eca10717258 tempest-VolumesActionsTest-573589455 None] Deleted volume successfully. Nov 01 12:32:44 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-9399d244-5451-4194-83ee-3eca10717258 tempest-VolumesActionsTest-573589455 None] Lock "cinder-79d240f8-e8a1-4d53-8697-972a549fb950-delete_volume" released by "delete_volume" :: held 1.901s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:32:45 devstack sudo[101363]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3e3a44d8-1ac4-4e76-841c-697263f5192c tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45.4c99ccbe-39f3-4371-aff2-5d9ef2dcce45 1G" returned: 0 in 0.550s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3e3a44d8-1ac4-4e76-841c-697263f5192c tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45.4c99ccbe-39f3-4371-aff2-5d9ef2dcce45 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:45 devstack sudo[101383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45.4c99ccbe-39f3-4371-aff2-5d9ef2dcce45 Nov 01 12:32:45 devstack sudo[101383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:45 devstack sudo[101383]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3e3a44d8-1ac4-4e76-841c-697263f5192c tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45.4c99ccbe-39f3-4371-aff2-5d9ef2dcce45" returned: 0 in 0.390s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:45 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-3e3a44d8-1ac4-4e76-841c-697263f5192c tempest-VolumesSnapshotTestJSON-1948679985 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45.4c99ccbe-39f3-4371-aff2-5d9ef2dcce45 is being set with open permissions: ugo+rw Nov 01 12:32:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3e3a44d8-1ac4-4e76-841c-697263f5192c tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45.4c99ccbe-39f3-4371-aff2-5d9ef2dcce45 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:45 devstack sudo[101394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45.4c99ccbe-39f3-4371-aff2-5d9ef2dcce45 Nov 01 12:32:45 devstack sudo[101394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:45 devstack sudo[101394]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3e3a44d8-1ac4-4e76-841c-697263f5192c tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45.4c99ccbe-39f3-4371-aff2-5d9ef2dcce45" returned: 0 in 0.263s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3e3a44d8-1ac4-4e76-841c-697263f5192c tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:45 devstack sudo[101397]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45.info Nov 01 12:32:45 devstack sudo[101397]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:46 devstack sudo[101397]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3e3a44d8-1ac4-4e76-841c-697263f5192c tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45.info" returned: 0 in 0.303s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:46 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-3e3a44d8-1ac4-4e76-841c-697263f5192c tempest-VolumesSnapshotTestJSON-1948679985 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45.info is being set with open permissions: ugo+rw Nov 01 12:32:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3e3a44d8-1ac4-4e76-841c-697263f5192c tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:46 devstack sudo[101400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45.info Nov 01 12:32:46 devstack sudo[101400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:46 devstack sudo[101400]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3e3a44d8-1ac4-4e76-841c-697263f5192c tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45.info" returned: 0 in 0.319s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-3e3a44d8-1ac4-4e76-841c-697263f5192c tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.563s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:32:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5069133b-1136-4d3a-9908-d8edb96e61e5 tempest-SnapshotDependencyTests-692331658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.956s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:32:46 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-5069133b-1136-4d3a-9908-d8edb96e61e5 tempest-SnapshotDependencyTests-692331658 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:32:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1084748323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57b5882e-b660-4dbc-9dae-7446d6382ad0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de693726bb694975920322096220bb7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:32:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:32:44Z,use_quota=True,user_id='5abe3d18f5f14185b2c5be72c250cd5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:32:46 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-5069133b-1136-4d3a-9908-d8edb96e61e5 tempest-SnapshotDependencyTests-692331658 None] Creating volume 57b5882e-b660-4dbc-9dae-7446d6382ad0 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:32:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5069133b-1136-4d3a-9908-d8edb96e61e5 tempest-SnapshotDependencyTests-692331658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:32:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5069133b-1136-4d3a-9908-d8edb96e61e5 tempest-SnapshotDependencyTests-692331658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:32:46 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-5069133b-1136-4d3a-9908-d8edb96e61e5 tempest-SnapshotDependencyTests-692331658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:32:46 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-5069133b-1136-4d3a-9908-d8edb96e61e5 tempest-SnapshotDependencyTests-692331658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:32:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5069133b-1136-4d3a-9908-d8edb96e61e5 tempest-SnapshotDependencyTests-692331658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:32:46 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-5069133b-1136-4d3a-9908-d8edb96e61e5 tempest-SnapshotDependencyTests-692331658 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:32:46 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-5069133b-1136-4d3a-9908-d8edb96e61e5 tempest-SnapshotDependencyTests-692331658 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:32:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5069133b-1136-4d3a-9908-d8edb96e61e5 tempest-SnapshotDependencyTests-692331658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:46 devstack sudo[101403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0 1073741824 Nov 01 12:32:46 devstack sudo[101403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:46 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-3e3a44d8-1ac4-4e76-841c-697263f5192c tempest-VolumesSnapshotTestJSON-1948679985 None] Create snapshot completed successfully Nov 01 12:32:47 devstack sudo[101403]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5069133b-1136-4d3a-9908-d8edb96e61e5 tempest-SnapshotDependencyTests-692331658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0 1073741824" returned: 0 in 0.611s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5069133b-1136-4d3a-9908-d8edb96e61e5 tempest-SnapshotDependencyTests-692331658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:47 devstack sudo[101411]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0 Nov 01 12:32:47 devstack sudo[101411]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:47 devstack sudo[101411]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5069133b-1136-4d3a-9908-d8edb96e61e5 tempest-SnapshotDependencyTests-692331658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0" returned: 0 in 0.557s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:47 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-5069133b-1136-4d3a-9908-d8edb96e61e5 tempest-SnapshotDependencyTests-692331658 None] <== create_volume: return (1236ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:32:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5069133b-1136-4d3a-9908-d8edb96e61e5 tempest-SnapshotDependencyTests-692331658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:32:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5069133b-1136-4d3a-9908-d8edb96e61e5 tempest-SnapshotDependencyTests-692331658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (005a7395-3d75-413a-a707-6d1d58d10d8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57b5882e-b660-4dbc-9dae-7446d6382ad0', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5069133b-1136-4d3a-9908-d8edb96e61e5 tempest-SnapshotDependencyTests-692331658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa09f062-8a04-463d-a733-81111c8465da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:47 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-5069133b-1136-4d3a-9908-d8edb96e61e5 tempest-SnapshotDependencyTests-692331658 None] Volume volume-57b5882e-b660-4dbc-9dae-7446d6382ad0 (57b5882e-b660-4dbc-9dae-7446d6382ad0): created successfully Nov 01 12:32:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5069133b-1136-4d3a-9908-d8edb96e61e5 tempest-SnapshotDependencyTests-692331658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa09f062-8a04-463d-a733-81111c8465da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5069133b-1136-4d3a-9908-d8edb96e61e5 tempest-SnapshotDependencyTests-692331658 None] Flow 'volume_create_manager' (6526b3dd-f390-4342-a75e-0774d01fa99b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:32:47 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-5069133b-1136-4d3a-9908-d8edb96e61e5 tempest-SnapshotDependencyTests-692331658 None] Created volume successfully. Nov 01 12:32:48 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:32:48 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] Flow 'volume_create_manager' (821edfb4-3566-4fc3-ace0-dc622e10f515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:32:48 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d351966-6952-418b-8c86-8bd06ab2de11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:48 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d351966-6952-418b-8c86-8bd06ab2de11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:32:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-537513720',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=450461e5-6856-4b26-97ca-556f3e1f5910,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91bd3d6227a3427c99d886af727c7024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:32:48Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=4c99ccbe-39f3-4371-aff2-5d9ef2dcce45,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:32:48Z,use_quota=True,user_id='a5b1003031114b029ede968cb9c9a409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:48 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d80951c6-feb2-42f1-9e40-543cde85e074) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:48 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d80951c6-feb2-42f1-9e40-543cde85e074) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:48 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a2a846b-eaf3-435e-86cd-1bbefc39f05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:48 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7a2a846b-eaf3-435e-86cd-1bbefc39f05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '450461e5-6856-4b26-97ca-556f3e1f5910', 'volume_name': 'volume-450461e5-6856-4b26-97ca-556f3e1f5910', 'volume_size': 2, 'snapshot_id': '4c99ccbe-39f3-4371-aff2-5d9ef2dcce45'}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:48 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6df320a0-40f9-40b0-a353-1b2b9e7c9c6e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:48 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6df320a0-40f9-40b0-a353-1b2b9e7c9c6e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:32:48 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1c1169c-056b-45b9-b2ea-f4f299c457a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:32:48 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] Volume 450461e5-6856-4b26-97ca-556f3e1f5910: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-450461e5-6856-4b26-97ca-556f3e1f5910', 'volume_size': 2, 'snapshot_id': '4c99ccbe-39f3-4371-aff2-5d9ef2dcce45'} Nov 01 12:32:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:32:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:32:48 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] Acquiring lock "cinder-quobyte-4c99ccbe-39f3-4371-aff2-5d9ef2dcce45-450461e5-6856-4b26-97ca-556f3e1f5910" by "_create_volume_from_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:32:48 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "cinder-quobyte-4c99ccbe-39f3-4371-aff2-5d9ef2dcce45-450461e5-6856-4b26-97ca-556f3e1f5910" acquired by "_create_volume_from_snapshot" :: waited 0.024s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:32:48 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] Creating volume 450461e5-6856-4b26-97ca-556f3e1f5910 from snapshot 4c99ccbe-39f3-4371-aff2-5d9ef2dcce45 {{(pid=86574) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 01 12:32:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:32:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:32:48 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:32:48 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:32:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:32:48 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:32:48 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] Acquiring lock "cinder-quobyte-450461e5-6856-4b26-97ca-556f3e1f5910" by "_copy_volume_from_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:32:48 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "cinder-quobyte-450461e5-6856-4b26-97ca-556f3e1f5910" acquired by "_copy_volume_from_snapshot" :: waited 0.035s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:32:48 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] snapshot: 4c99ccbe-39f3-4371-aff2-5d9ef2dcce45, volume: 450461e5-6856-4b26-97ca-556f3e1f5910, {{(pid=86574) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 01 12:32:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:32:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:32:48 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:32:48 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:32:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:32:48 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[a93b59e1-fcc4-421f-8101-044c178f7227]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:32:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45.4c99ccbe-39f3-4371-aff2-5d9ef2dcce45 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:48 devstack sudo[101479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45.4c99ccbe-39f3-4371-aff2-5d9ef2dcce45 Nov 01 12:32:48 devstack sudo[101479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:49 devstack sudo[101479]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45.4c99ccbe-39f3-4371-aff2-5d9ef2dcce45" returned: 0 in 0.704s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:49 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:32:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-01799875-38a3-4c3d-ab91-a37aeeb149d7 tempest-SnapshotDependencyTests-692331658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:32:49 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[ac43602d-c824-4287-adbf-4b2b93114dec]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:32:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:49 devstack sudo[101486]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45 Nov 01 12:32:49 devstack sudo[101486]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:49 devstack sudo[101486]: pam_unix(sudo:session): session closed for user root Nov 01 12:32:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45" returned: 0 in 0.546s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:32:49 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45 {{(pid=86574) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 01 12:32:49 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] Creating direct copy from snapshot {{(pid=86574) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 01 12:32:49 devstack cinder-volume[86574]: DEBUG cinder.utils [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] Path /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-450461e5-6856-4b26-97ca-556f3e1f5910 not found in is_blk_device check {{(pid=86574) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 01 12:32:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-450461e5-6856-4b26-97ca-556f3e1f5910 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:32:50 devstack sudo[101492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-450461e5-6856-4b26-97ca-556f3e1f5910 Nov 01 12:32:50 devstack sudo[101492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:32:59 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:SELECT=32,cinder:UPDATE=29,cinder:INSERT=7,cinder:DELETE=4 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:32:59 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:UPDATE=33,cinder:SELECT=41,cinder:INSERT=7,cinder:DELETE=3 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:33:00 devstack sudo[101492]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-450461e5-6856-4b26-97ca-556f3e1f5910" returned: 0 in 10.557s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:00 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] Image conversion details: src /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45, size 1024.00 MB, duration 10.56 sec, destination /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-450461e5-6856-4b26-97ca-556f3e1f5910 {{(pid=86574) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 12:33:00 devstack cinder-volume[86574]: INFO cinder.image.image_utils [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] Converted 1024.00 MB image at 96.98 MB/s Nov 01 12:33:00 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-450461e5-6856-4b26-97ca-556f3e1f5910 is being set with open permissions: ugo+rw Nov 01 12:33:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-450461e5-6856-4b26-97ca-556f3e1f5910 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:00 devstack sudo[101509]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-450461e5-6856-4b26-97ca-556f3e1f5910 Nov 01 12:33:00 devstack sudo[101509]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:00 devstack sudo[101509]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-450461e5-6856-4b26-97ca-556f3e1f5910" returned: 0 in 0.286s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:00 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "cinder-quobyte-450461e5-6856-4b26-97ca-556f3e1f5910" released by "_copy_volume_from_snapshot" :: held 12.310s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:00 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "cinder-quobyte-4c99ccbe-39f3-4371-aff2-5d9ef2dcce45-450461e5-6856-4b26-97ca-556f3e1f5910" released by "_create_volume_from_snapshot" :: held 12.417s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.442s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-01799875-38a3-4c3d-ab91-a37aeeb149d7 tempest-SnapshotDependencyTests-692331658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 11.488s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:00 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-01799875-38a3-4c3d-ab91-a37aeeb149d7 tempest-SnapshotDependencyTests-692331658 None] Creating offline snapshot 3422853e-a457-4130-a63b-aec5bf192673 of volume 57b5882e-b660-4dbc-9dae-7446d6382ad0 {{(pid=86574) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:33:00 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d1c1169c-056b-45b9-b2ea-f4f299c457a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-450461e5-6856-4b26-97ca-556f3e1f5910', 'volume_size': 2, 'snapshot_id': '4c99ccbe-39f3-4371-aff2-5d9ef2dcce45'}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:00 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5b5f449-8b9c-4a06-83be-9479961a5f3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:00 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[ce4ee1e9-d38e-4bc8-9e69-35bf21bfc986]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-01799875-38a3-4c3d-ab91-a37aeeb149d7 tempest-SnapshotDependencyTests-692331658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:00 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-bea888e6-6296-4493-8c55-7af84eb76f9a tempest-VolumesCloneNegativeTest-932935871 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:33:01 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-bea888e6-6296-4493-8c55-7af84eb76f9a tempest-VolumesCloneNegativeTest-932935871 None] Flow 'volume_create_manager' (53a7973f-dbdd-4d9d-b219-a5f3de034766) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:33:01 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-bea888e6-6296-4493-8c55-7af84eb76f9a tempest-VolumesCloneNegativeTest-932935871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b6a0744-14e5-45ad-9125-afbbfff29ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:01 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] Volume volume-450461e5-6856-4b26-97ca-556f3e1f5910 (450461e5-6856-4b26-97ca-556f3e1f5910): created successfully Nov 01 12:33:01 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b5b5f449-8b9c-4a06-83be-9479961a5f3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:01 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] Flow 'volume_create_manager' (821edfb4-3566-4fc3-ace0-dc622e10f515) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:33:01 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-bea888e6-6296-4493-8c55-7af84eb76f9a tempest-VolumesCloneNegativeTest-932935871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9b6a0744-14e5-45ad-9125-afbbfff29ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:33:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1738690086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=477f87a0-ae22-48f4-94c1-af3f8a844502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c85e7f0f5f64899a9007a7d0364faee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:33:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:33:01Z,use_quota=True,user_id='253fafab598d4e5fa90d1ec47f3abfe5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:01 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-bea888e6-6296-4493-8c55-7af84eb76f9a tempest-VolumesCloneNegativeTest-932935871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16b8db7d-f4fd-4db5-a216-5ed388d3a3c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:01 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-bea888e6-6296-4493-8c55-7af84eb76f9a tempest-VolumesCloneNegativeTest-932935871 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (16b8db7d-f4fd-4db5-a216-5ed388d3a3c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:01 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-bea888e6-6296-4493-8c55-7af84eb76f9a tempest-VolumesCloneNegativeTest-932935871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc3ffd22-cc60-4e54-a848-ed4f6066e408) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:01 devstack sudo[101512]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0 Nov 01 12:33:01 devstack sudo[101512]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:01 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-bea888e6-6296-4493-8c55-7af84eb76f9a tempest-VolumesCloneNegativeTest-932935871 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fc3ffd22-cc60-4e54-a848-ed4f6066e408) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '477f87a0-ae22-48f4-94c1-af3f8a844502', 'volume_name': 'volume-477f87a0-ae22-48f4-94c1-af3f8a844502', 'volume_size': 2}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:01 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-bea888e6-6296-4493-8c55-7af84eb76f9a tempest-VolumesCloneNegativeTest-932935871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5a245c7-f1b5-41af-b89e-11e58b1f19cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:01 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-bea888e6-6296-4493-8c55-7af84eb76f9a tempest-VolumesCloneNegativeTest-932935871 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5a245c7-f1b5-41af-b89e-11e58b1f19cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:01 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-bea888e6-6296-4493-8c55-7af84eb76f9a tempest-VolumesCloneNegativeTest-932935871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ffc42e5-6761-43e6-b384-b47ae5cacb6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:01 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-bea888e6-6296-4493-8c55-7af84eb76f9a tempest-VolumesCloneNegativeTest-932935871 None] Volume 477f87a0-ae22-48f4-94c1-af3f8a844502: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-477f87a0-ae22-48f4-94c1-af3f8a844502', 'volume_size': 2} Nov 01 12:33:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-bea888e6-6296-4493-8c55-7af84eb76f9a tempest-VolumesCloneNegativeTest-932935871 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:01 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-ca5add81-c7a2-4242-bfca-86c4ffb0ebcc tempest-VolumesSnapshotTestJSON-1948679985 None] Created volume successfully. Nov 01 12:33:01 devstack sudo[101512]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-01799875-38a3-4c3d-ab91-a37aeeb149d7 tempest-SnapshotDependencyTests-692331658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0" returned: 0 in 0.380s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-01799875-38a3-4c3d-ab91-a37aeeb149d7 tempest-SnapshotDependencyTests-692331658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0.3422853e-a457-4130-a63b-aec5bf192673 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:01 devstack sudo[101530]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0.3422853e-a457-4130-a63b-aec5bf192673 1G Nov 01 12:33:01 devstack sudo[101530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:01 devstack sudo[101530]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-01799875-38a3-4c3d-ab91-a37aeeb149d7 tempest-SnapshotDependencyTests-692331658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0.3422853e-a457-4130-a63b-aec5bf192673 1G" returned: 0 in 0.387s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-01799875-38a3-4c3d-ab91-a37aeeb149d7 tempest-SnapshotDependencyTests-692331658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57b5882e-b660-4dbc-9dae-7446d6382ad0 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0.3422853e-a457-4130-a63b-aec5bf192673 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:01 devstack sudo[101536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57b5882e-b660-4dbc-9dae-7446d6382ad0 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0.3422853e-a457-4130-a63b-aec5bf192673 Nov 01 12:33:01 devstack sudo[101536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:02 devstack sudo[101536]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-01799875-38a3-4c3d-ab91-a37aeeb149d7 tempest-SnapshotDependencyTests-692331658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-57b5882e-b660-4dbc-9dae-7446d6382ad0 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0.3422853e-a457-4130-a63b-aec5bf192673" returned: 0 in 0.290s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:02 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-01799875-38a3-4c3d-ab91-a37aeeb149d7 tempest-SnapshotDependencyTests-692331658 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0.3422853e-a457-4130-a63b-aec5bf192673 is being set with open permissions: ugo+rw Nov 01 12:33:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-01799875-38a3-4c3d-ab91-a37aeeb149d7 tempest-SnapshotDependencyTests-692331658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0.3422853e-a457-4130-a63b-aec5bf192673 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:02 devstack sudo[101541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0.3422853e-a457-4130-a63b-aec5bf192673 Nov 01 12:33:02 devstack sudo[101541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:02 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ac671df9-3a6f-42e0-85cb-aa00b12eddf1 tempest-VolumesSnapshotTestJSON-1948679985 None] Acquiring lock "cinder-450461e5-6856-4b26-97ca-556f3e1f5910-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:02 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ac671df9-3a6f-42e0-85cb-aa00b12eddf1 tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "cinder-450461e5-6856-4b26-97ca-556f3e1f5910-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:02 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ac671df9-3a6f-42e0-85cb-aa00b12eddf1 tempest-VolumesSnapshotTestJSON-1948679985 None] Acquiring lock "cinder-quobyte-450461e5-6856-4b26-97ca-556f3e1f5910" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:02 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ac671df9-3a6f-42e0-85cb-aa00b12eddf1 tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "cinder-quobyte-450461e5-6856-4b26-97ca-556f3e1f5910" acquired by "delete_volume" :: waited 0.022s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:02 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f3d46ca-2d7b-4752-b4a7-1a3f5e4fe458]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ac671df9-3a6f-42e0-85cb-aa00b12eddf1 tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-450461e5-6856-4b26-97ca-556f3e1f5910 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:02 devstack sudo[101541]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-01799875-38a3-4c3d-ab91-a37aeeb149d7 tempest-SnapshotDependencyTests-692331658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0.3422853e-a457-4130-a63b-aec5bf192673" returned: 0 in 0.246s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-01799875-38a3-4c3d-ab91-a37aeeb149d7 tempest-SnapshotDependencyTests-692331658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:02 devstack sudo[101545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0.info Nov 01 12:33:02 devstack sudo[101545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:02 devstack sudo[101544]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-450461e5-6856-4b26-97ca-556f3e1f5910 Nov 01 12:33:02 devstack sudo[101544]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:02 devstack sudo[101545]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-01799875-38a3-4c3d-ab91-a37aeeb149d7 tempest-SnapshotDependencyTests-692331658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0.info" returned: 0 in 0.256s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:02 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-01799875-38a3-4c3d-ab91-a37aeeb149d7 tempest-SnapshotDependencyTests-692331658 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0.info is being set with open permissions: ugo+rw Nov 01 12:33:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-01799875-38a3-4c3d-ab91-a37aeeb149d7 tempest-SnapshotDependencyTests-692331658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:02 devstack sudo[101551]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0.info Nov 01 12:33:02 devstack sudo[101551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:02 devstack sudo[101544]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ac671df9-3a6f-42e0-85cb-aa00b12eddf1 tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-450461e5-6856-4b26-97ca-556f3e1f5910" returned: 0 in 0.363s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ac671df9-3a6f-42e0-85cb-aa00b12eddf1 tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-450461e5-6856-4b26-97ca-556f3e1f5910 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:02 devstack sudo[101554]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-450461e5-6856-4b26-97ca-556f3e1f5910 Nov 01 12:33:02 devstack sudo[101554]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:02 devstack sudo[101551]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-01799875-38a3-4c3d-ab91-a37aeeb149d7 tempest-SnapshotDependencyTests-692331658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0.info" returned: 0 in 0.257s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-01799875-38a3-4c3d-ab91-a37aeeb149d7 tempest-SnapshotDependencyTests-692331658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.953s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-bea888e6-6296-4493-8c55-7af84eb76f9a tempest-VolumesCloneNegativeTest-932935871 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.750s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:02 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-bea888e6-6296-4493-8c55-7af84eb76f9a tempest-VolumesCloneNegativeTest-932935871 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:33:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-1738690086',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=477f87a0-ae22-48f4-94c1-af3f8a844502,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='2c85e7f0f5f64899a9007a7d0364faee',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:33:01Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:33:01Z,use_quota=True,user_id='253fafab598d4e5fa90d1ec47f3abfe5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:33:02 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-bea888e6-6296-4493-8c55-7af84eb76f9a tempest-VolumesCloneNegativeTest-932935871 None] Creating volume 477f87a0-ae22-48f4-94c1-af3f8a844502 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:33:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-bea888e6-6296-4493-8c55-7af84eb76f9a tempest-VolumesCloneNegativeTest-932935871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-bea888e6-6296-4493-8c55-7af84eb76f9a tempest-VolumesCloneNegativeTest-932935871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:02 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-bea888e6-6296-4493-8c55-7af84eb76f9a tempest-VolumesCloneNegativeTest-932935871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:33:02 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-bea888e6-6296-4493-8c55-7af84eb76f9a tempest-VolumesCloneNegativeTest-932935871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:33:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-bea888e6-6296-4493-8c55-7af84eb76f9a tempest-VolumesCloneNegativeTest-932935871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:02 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-bea888e6-6296-4493-8c55-7af84eb76f9a tempest-VolumesCloneNegativeTest-932935871 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:33:02 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-bea888e6-6296-4493-8c55-7af84eb76f9a tempest-VolumesCloneNegativeTest-932935871 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:33:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bea888e6-6296-4493-8c55-7af84eb76f9a tempest-VolumesCloneNegativeTest-932935871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-477f87a0-ae22-48f4-94c1-af3f8a844502 2147483648 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:02 devstack sudo[101558]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-477f87a0-ae22-48f4-94c1-af3f8a844502 2147483648 Nov 01 12:33:02 devstack sudo[101558]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:02 devstack sudo[101554]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:02 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-01799875-38a3-4c3d-ab91-a37aeeb149d7 tempest-SnapshotDependencyTests-692331658 None] Create snapshot completed successfully Nov 01 12:33:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ac671df9-3a6f-42e0-85cb-aa00b12eddf1 tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-450461e5-6856-4b26-97ca-556f3e1f5910" returned: 0 in 0.279s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:02 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ac671df9-3a6f-42e0-85cb-aa00b12eddf1 tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "cinder-quobyte-450461e5-6856-4b26-97ca-556f3e1f5910" released by "delete_volume" :: held 0.685s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:02 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-ac671df9-3a6f-42e0-85cb-aa00b12eddf1 tempest-VolumesSnapshotTestJSON-1948679985 None] Created reservations ['765b140c-13a5-4ad0-8880-d1dcfd829315', '5ea1fc74-8e69-4cb5-bf55-9e33b7a7d8bc', 'acb2327d-a465-48a0-8c1e-59b4449d7089', '0b087114-fbeb-4ecd-9d38-7b181e626ca7'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:33:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ac671df9-3a6f-42e0-85cb-aa00b12eddf1 tempest-VolumesSnapshotTestJSON-1948679985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ac671df9-3a6f-42e0-85cb-aa00b12eddf1 tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ac671df9-3a6f-42e0-85cb-aa00b12eddf1 tempest-VolumesSnapshotTestJSON-1948679985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:33:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ac671df9-3a6f-42e0-85cb-aa00b12eddf1 tempest-VolumesSnapshotTestJSON-1948679985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:33:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ac671df9-3a6f-42e0-85cb-aa00b12eddf1 tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ac671df9-3a6f-42e0-85cb-aa00b12eddf1 tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:03 devstack sudo[101560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:33:03 devstack sudo[101560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:03 devstack sudo[101560]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ac671df9-3a6f-42e0-85cb-aa00b12eddf1 tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.250s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:03 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-ac671df9-3a6f-42e0-85cb-aa00b12eddf1 tempest-VolumesSnapshotTestJSON-1948679985 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:33:03 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-ac671df9-3a6f-42e0-85cb-aa00b12eddf1 tempest-VolumesSnapshotTestJSON-1948679985 None] Deleted volume successfully. Nov 01 12:33:03 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ac671df9-3a6f-42e0-85cb-aa00b12eddf1 tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "cinder-450461e5-6856-4b26-97ca-556f3e1f5910-delete_volume" released by "delete_volume" :: held 1.139s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:03 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-3033f45f-7265-46f8-85ad-28de1d481db0 tempest-VolumesSnapshotTestJSON-1948679985 None] Acquiring lock "cinder-4c99ccbe-39f3-4371-aff2-5d9ef2dcce45-delete_snapshot" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:03 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-3033f45f-7265-46f8-85ad-28de1d481db0 tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "cinder-4c99ccbe-39f3-4371-aff2-5d9ef2dcce45-delete_snapshot" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:03 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-3033f45f-7265-46f8-85ad-28de1d481db0 tempest-VolumesSnapshotTestJSON-1948679985 None] Acquiring lock "cinder-quobyte-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:03 devstack sudo[101558]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bea888e6-6296-4493-8c55-7af84eb76f9a tempest-VolumesCloneNegativeTest-932935871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-477f87a0-ae22-48f4-94c1-af3f8a844502 2147483648" returned: 0 in 0.568s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:03 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-3033f45f-7265-46f8-85ad-28de1d481db0 tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "cinder-quobyte-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:03 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-3033f45f-7265-46f8-85ad-28de1d481db0 tempest-VolumesSnapshotTestJSON-1948679985 None] Acquiring lock "cinder-quobyte-4c99ccbe-39f3-4371-aff2-5d9ef2dcce45" by "_delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:03 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-3033f45f-7265-46f8-85ad-28de1d481db0 tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "cinder-quobyte-4c99ccbe-39f3-4371-aff2-5d9ef2dcce45" acquired by "_delete_snapshot" :: waited 0.021s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-3033f45f-7265-46f8-85ad-28de1d481db0 tempest-VolumesSnapshotTestJSON-1948679985 None] Deleting offline snapshot 4c99ccbe-39f3-4371-aff2-5d9ef2dcce45 of volume 380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:33:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-3033f45f-7265-46f8-85ad-28de1d481db0 tempest-VolumesSnapshotTestJSON-1948679985 None] snapshot_file for this snap is: volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45.4c99ccbe-39f3-4371-aff2-5d9ef2dcce45 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:33:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bea888e6-6296-4493-8c55-7af84eb76f9a tempest-VolumesCloneNegativeTest-932935871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-477f87a0-ae22-48f4-94c1-af3f8a844502 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:03 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8a5a67b-403a-46ff-85d4-9d68542cfa62]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3033f45f-7265-46f8-85ad-28de1d481db0 tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45.4c99ccbe-39f3-4371-aff2-5d9ef2dcce45 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:03 devstack sudo[101567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-477f87a0-ae22-48f4-94c1-af3f8a844502 Nov 01 12:33:03 devstack sudo[101567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:03 devstack sudo[101568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45.4c99ccbe-39f3-4371-aff2-5d9ef2dcce45 Nov 01 12:33:03 devstack sudo[101568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:03 devstack sudo[101567]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bea888e6-6296-4493-8c55-7af84eb76f9a tempest-VolumesCloneNegativeTest-932935871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-477f87a0-ae22-48f4-94c1-af3f8a844502" returned: 0 in 0.254s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-bea888e6-6296-4493-8c55-7af84eb76f9a tempest-VolumesCloneNegativeTest-932935871 None] <== create_volume: return (904ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:33:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-bea888e6-6296-4493-8c55-7af84eb76f9a tempest-VolumesCloneNegativeTest-932935871 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.908s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-bea888e6-6296-4493-8c55-7af84eb76f9a tempest-VolumesCloneNegativeTest-932935871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3ffc42e5-6761-43e6-b384-b47ae5cacb6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-477f87a0-ae22-48f4-94c1-af3f8a844502', 'volume_size': 2}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-bea888e6-6296-4493-8c55-7af84eb76f9a tempest-VolumesCloneNegativeTest-932935871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b9ca950-9b69-4063-aff8-18b846d826b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:03 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-bea888e6-6296-4493-8c55-7af84eb76f9a tempest-VolumesCloneNegativeTest-932935871 None] Volume volume-477f87a0-ae22-48f4-94c1-af3f8a844502 (477f87a0-ae22-48f4-94c1-af3f8a844502): created successfully Nov 01 12:33:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-bea888e6-6296-4493-8c55-7af84eb76f9a tempest-VolumesCloneNegativeTest-932935871 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b9ca950-9b69-4063-aff8-18b846d826b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-bea888e6-6296-4493-8c55-7af84eb76f9a tempest-VolumesCloneNegativeTest-932935871 None] Flow 'volume_create_manager' (53a7973f-dbdd-4d9d-b219-a5f3de034766) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:33:03 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-bea888e6-6296-4493-8c55-7af84eb76f9a tempest-VolumesCloneNegativeTest-932935871 None] Created volume successfully. Nov 01 12:33:03 devstack sudo[101568]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3033f45f-7265-46f8-85ad-28de1d481db0 tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45.4c99ccbe-39f3-4371-aff2-5d9ef2dcce45" returned: 0 in 0.408s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-3033f45f-7265-46f8-85ad-28de1d481db0 tempest-VolumesSnapshotTestJSON-1948679985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:33:03 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[cc4951dc-5c37-4732-994d-fff7c62cb6d8]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3033f45f-7265-46f8-85ad-28de1d481db0 tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:04 devstack sudo[101576]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45 Nov 01 12:33:04 devstack sudo[101576]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:04 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:33:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] Flow 'volume_create_manager' (cb21c96b-7ffb-475b-a08a-23ef68b148a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:33:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f34c9e36-3a00-438e-b7dd-38aa2fda51fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f34c9e36-3a00-438e-b7dd-38aa2fda51fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:33:04Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f7c8e7d2-6bb1-4e92-92f3-5aaf767b72d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='de693726bb694975920322096220bb7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:33:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=3422853e-a457-4130-a63b-aec5bf192673,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:33:04Z,use_quota=True,user_id='5abe3d18f5f14185b2c5be72c250cd5e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e661b05a-dce9-4f50-af90-e49ad182bf07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e661b05a-dce9-4f50-af90-e49ad182bf07) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f415780-054a-4b55-8b9a-74c2ce8c9730) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9f415780-054a-4b55-8b9a-74c2ce8c9730) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'f7c8e7d2-6bb1-4e92-92f3-5aaf767b72d2', 'volume_name': 'volume-f7c8e7d2-6bb1-4e92-92f3-5aaf767b72d2', 'volume_size': 1, 'snapshot_id': '3422853e-a457-4130-a63b-aec5bf192673'}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ecf4677-0427-416b-a6f3-7c4a88cec7f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ecf4677-0427-416b-a6f3-7c4a88cec7f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d43baffc-71d7-4b38-ab61-7aabd721a87b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:04 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] Volume f7c8e7d2-6bb1-4e92-92f3-5aaf767b72d2: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-f7c8e7d2-6bb1-4e92-92f3-5aaf767b72d2', 'volume_size': 1, 'snapshot_id': '3422853e-a457-4130-a63b-aec5bf192673'} Nov 01 12:33:04 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-8077a48b-3bc0-48c6-a1cd-6f660910d5e0 tempest-VolumesCloneNegativeTest-932935871 None] Acquiring lock "cinder-477f87a0-ae22-48f4-94c1-af3f8a844502-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:04 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] Acquiring lock "cinder-quobyte-3422853e-a457-4130-a63b-aec5bf192673-f7c8e7d2-6bb1-4e92-92f3-5aaf767b72d2" by "_create_volume_from_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:04 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] Lock "cinder-quobyte-3422853e-a457-4130-a63b-aec5bf192673-f7c8e7d2-6bb1-4e92-92f3-5aaf767b72d2" acquired by "_create_volume_from_snapshot" :: waited 0.020s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:04 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] Creating volume f7c8e7d2-6bb1-4e92-92f3-5aaf767b72d2 from snapshot 3422853e-a457-4130-a63b-aec5bf192673 {{(pid=86574) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 01 12:33:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:04 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:33:04 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:33:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:04 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:33:04 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] Acquiring lock "cinder-quobyte-f7c8e7d2-6bb1-4e92-92f3-5aaf767b72d2" by "_copy_volume_from_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:04 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-8077a48b-3bc0-48c6-a1cd-6f660910d5e0 tempest-VolumesCloneNegativeTest-932935871 None] Lock "cinder-477f87a0-ae22-48f4-94c1-af3f8a844502-delete_volume" acquired by "delete_volume" :: waited 0.047s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:04 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] Lock "cinder-quobyte-f7c8e7d2-6bb1-4e92-92f3-5aaf767b72d2" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:04 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] snapshot: 3422853e-a457-4130-a63b-aec5bf192673, volume: f7c8e7d2-6bb1-4e92-92f3-5aaf767b72d2, {{(pid=86574) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 01 12:33:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:04 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:33:04 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:33:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:04 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-8077a48b-3bc0-48c6-a1cd-6f660910d5e0 tempest-VolumesCloneNegativeTest-932935871 None] Acquiring lock "cinder-quobyte-477f87a0-ae22-48f4-94c1-af3f8a844502" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:04 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-8077a48b-3bc0-48c6-a1cd-6f660910d5e0 tempest-VolumesCloneNegativeTest-932935871 None] Lock "cinder-quobyte-477f87a0-ae22-48f4-94c1-af3f8a844502" acquired by "delete_volume" :: waited 0.015s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:04 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[bff395fe-5fd5-4696-a351-36737adae44d]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0.3422853e-a457-4130-a63b-aec5bf192673 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:04 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[2b2456a1-6889-4366-8b90-85bba2c3d97c]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8077a48b-3bc0-48c6-a1cd-6f660910d5e0 tempest-VolumesCloneNegativeTest-932935871 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-477f87a0-ae22-48f4-94c1-af3f8a844502 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:04 devstack sudo[101580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0.3422853e-a457-4130-a63b-aec5bf192673 Nov 01 12:33:04 devstack sudo[101580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:04 devstack sudo[101581]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-477f87a0-ae22-48f4-94c1-af3f8a844502 Nov 01 12:33:04 devstack sudo[101581]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:04 devstack sudo[101576]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3033f45f-7265-46f8-85ad-28de1d481db0 tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45" returned: 0 in 0.619s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3033f45f-7265-46f8-85ad-28de1d481db0 tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45.4c99ccbe-39f3-4371-aff2-5d9ef2dcce45 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:04 devstack sudo[101585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45.4c99ccbe-39f3-4371-aff2-5d9ef2dcce45 Nov 01 12:33:04 devstack sudo[101585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:04 devstack sudo[101580]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0.3422853e-a457-4130-a63b-aec5bf192673" returned: 0 in 0.403s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:04 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57b5882e-b660-4dbc-9dae-7446d6382ad0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:33:04 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[92a62010-c7e1-47a0-911a-2b154085ed03]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:04 devstack sudo[101581]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8077a48b-3bc0-48c6-a1cd-6f660910d5e0 tempest-VolumesCloneNegativeTest-932935871 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-477f87a0-ae22-48f4-94c1-af3f8a844502" returned: 0 in 0.421s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8077a48b-3bc0-48c6-a1cd-6f660910d5e0 tempest-VolumesCloneNegativeTest-932935871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-477f87a0-ae22-48f4-94c1-af3f8a844502 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:04 devstack sudo[101597]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-477f87a0-ae22-48f4-94c1-af3f8a844502 Nov 01 12:33:04 devstack sudo[101597]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:04 devstack sudo[101594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0 Nov 01 12:33:04 devstack sudo[101594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:04 devstack sudo[101585]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3033f45f-7265-46f8-85ad-28de1d481db0 tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45.4c99ccbe-39f3-4371-aff2-5d9ef2dcce45" returned: 0 in 0.387s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3033f45f-7265-46f8-85ad-28de1d481db0 tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45.4c99ccbe-39f3-4371-aff2-5d9ef2dcce45 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:05 devstack sudo[101601]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45.4c99ccbe-39f3-4371-aff2-5d9ef2dcce45 Nov 01 12:33:05 devstack sudo[101601]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:05 devstack sudo[101597]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8077a48b-3bc0-48c6-a1cd-6f660910d5e0 tempest-VolumesCloneNegativeTest-932935871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-477f87a0-ae22-48f4-94c1-af3f8a844502" returned: 0 in 0.291s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:05 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-8077a48b-3bc0-48c6-a1cd-6f660910d5e0 tempest-VolumesCloneNegativeTest-932935871 None] Lock "cinder-quobyte-477f87a0-ae22-48f4-94c1-af3f8a844502" released by "delete_volume" :: held 0.760s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:05 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-8077a48b-3bc0-48c6-a1cd-6f660910d5e0 tempest-VolumesCloneNegativeTest-932935871 None] Created reservations ['96fe8f5a-b4e1-4dca-862a-fc4095718659', '63077c38-6345-4257-913b-9777a8006931', 'eaa2c0a9-5c3c-4a70-b5c2-194239ad37dc', '896f710d-b061-4661-90c3-6402598371bc'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:33:05 devstack sudo[101594]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0" returned: 0 in 0.440s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:05 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0 {{(pid=86574) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 01 12:33:05 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] Creating direct copy from snapshot {{(pid=86574) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 01 12:33:05 devstack cinder-volume[86574]: DEBUG cinder.utils [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] Path /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f7c8e7d2-6bb1-4e92-92f3-5aaf767b72d2 not found in is_blk_device check {{(pid=86574) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 01 12:33:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f7c8e7d2-6bb1-4e92-92f3-5aaf767b72d2 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:05 devstack sudo[101601]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3033f45f-7265-46f8-85ad-28de1d481db0 tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45.4c99ccbe-39f3-4371-aff2-5d9ef2dcce45" returned: 0 in 0.292s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:05 devstack sudo[101609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f7c8e7d2-6bb1-4e92-92f3-5aaf767b72d2 Nov 01 12:33:05 devstack sudo[101609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8077a48b-3bc0-48c6-a1cd-6f660910d5e0 tempest-VolumesCloneNegativeTest-932935871 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8077a48b-3bc0-48c6-a1cd-6f660910d5e0 tempest-VolumesCloneNegativeTest-932935871 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:05 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-8077a48b-3bc0-48c6-a1cd-6f660910d5e0 tempest-VolumesCloneNegativeTest-932935871 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:33:05 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-8077a48b-3bc0-48c6-a1cd-6f660910d5e0 tempest-VolumesCloneNegativeTest-932935871 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:33:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8077a48b-3bc0-48c6-a1cd-6f660910d5e0 tempest-VolumesCloneNegativeTest-932935871 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8077a48b-3bc0-48c6-a1cd-6f660910d5e0 tempest-VolumesCloneNegativeTest-932935871 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:05 devstack sudo[101611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:33:05 devstack sudo[101611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:05 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-3033f45f-7265-46f8-85ad-28de1d481db0 tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "cinder-quobyte-4c99ccbe-39f3-4371-aff2-5d9ef2dcce45" released by "_delete_snapshot" :: held 1.898s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:05 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-3033f45f-7265-46f8-85ad-28de1d481db0 tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "cinder-quobyte-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45" released by "delete_snapshot" :: held 1.936s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:05 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-3033f45f-7265-46f8-85ad-28de1d481db0 tempest-VolumesSnapshotTestJSON-1948679985 None] Created reservations ['d3a5f941-3cb6-4906-adc4-c192d61307f5', '9013acfa-9ec8-4086-8d72-5510bc7d3247', 'b4c5bb95-66bd-409e-b28f-129a18c1f09f', '7905d1c1-b672-4b15-9c39-a92aadc1157e'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:33:05 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-3033f45f-7265-46f8-85ad-28de1d481db0 tempest-VolumesSnapshotTestJSON-1948679985 None] Delete snapshot completed successfully. Nov 01 12:33:05 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-3033f45f-7265-46f8-85ad-28de1d481db0 tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "cinder-4c99ccbe-39f3-4371-aff2-5d9ef2dcce45-delete_snapshot" released by "delete_snapshot" :: held 2.140s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:05 devstack sudo[101611]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8077a48b-3bc0-48c6-a1cd-6f660910d5e0 tempest-VolumesCloneNegativeTest-932935871 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.320s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:05 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-8077a48b-3bc0-48c6-a1cd-6f660910d5e0 tempest-VolumesCloneNegativeTest-932935871 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:33:05 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-8077a48b-3bc0-48c6-a1cd-6f660910d5e0 tempest-VolumesCloneNegativeTest-932935871 None] Deleted volume successfully. Nov 01 12:33:05 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-8077a48b-3bc0-48c6-a1cd-6f660910d5e0 tempest-VolumesCloneNegativeTest-932935871 None] Lock "cinder-477f87a0-ae22-48f4-94c1-af3f8a844502-delete_volume" released by "delete_volume" :: held 1.374s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:05 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b69645f3-9816-4468-8328-7af2934735ac tempest-VolumesSnapshotTestJSON-1948679985 None] Acquiring lock "cinder-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:05 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b69645f3-9816-4468-8328-7af2934735ac tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "cinder-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:05 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b69645f3-9816-4468-8328-7af2934735ac tempest-VolumesSnapshotTestJSON-1948679985 None] Acquiring lock "cinder-quobyte-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:05 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b69645f3-9816-4468-8328-7af2934735ac tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "cinder-quobyte-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45" acquired by "delete_volume" :: waited 0.020s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:05 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b6b976f-3cc8-426b-8222-7c0db81d7808]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b69645f3-9816-4468-8328-7af2934735ac tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:06 devstack sudo[101618]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45 Nov 01 12:33:06 devstack sudo[101618]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:06 devstack sudo[101618]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b69645f3-9816-4468-8328-7af2934735ac tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45" returned: 0 in 0.974s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b69645f3-9816-4468-8328-7af2934735ac tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:06 devstack sudo[101632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45 Nov 01 12:33:06 devstack sudo[101632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:07 devstack sudo[101632]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b69645f3-9816-4468-8328-7af2934735ac tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45" returned: 0 in 0.456s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:07 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b69645f3-9816-4468-8328-7af2934735ac tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "cinder-quobyte-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45" released by "delete_volume" :: held 1.527s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:07 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-b69645f3-9816-4468-8328-7af2934735ac tempest-VolumesSnapshotTestJSON-1948679985 None] Created reservations ['a5e854de-5168-4941-9599-eb3a3f897eb9', '94ddea0a-c0fe-4958-bce8-105d5581a5fe', '13596443-cd66-4dc0-9a5b-57a996b4a9b4', '64ee0192-4e8e-4211-96b4-6ddb4b7a0a13'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:33:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b69645f3-9816-4468-8328-7af2934735ac tempest-VolumesSnapshotTestJSON-1948679985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b69645f3-9816-4468-8328-7af2934735ac tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:07 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-b69645f3-9816-4468-8328-7af2934735ac tempest-VolumesSnapshotTestJSON-1948679985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:33:07 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-b69645f3-9816-4468-8328-7af2934735ac tempest-VolumesSnapshotTestJSON-1948679985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:33:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b69645f3-9816-4468-8328-7af2934735ac tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b69645f3-9816-4468-8328-7af2934735ac tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:07 devstack sudo[101635]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:33:07 devstack sudo[101635]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:08 devstack sudo[101635]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b69645f3-9816-4468-8328-7af2934735ac tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.528s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:08 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-b69645f3-9816-4468-8328-7af2934735ac tempest-VolumesSnapshotTestJSON-1948679985 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:33:08 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-b69645f3-9816-4468-8328-7af2934735ac tempest-VolumesSnapshotTestJSON-1948679985 None] Deleted volume successfully. Nov 01 12:33:08 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b69645f3-9816-4468-8328-7af2934735ac tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "cinder-380fa0a1-2268-4ecd-86e9-9ffaeb4d7f45-delete_volume" released by "delete_volume" :: held 2.516s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:09 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-25304609-6364-4e48-9abc-36e748dd19fa tempest-VolumesSnapshotTestJSON-1948679985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:33:09 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-25304609-6364-4e48-9abc-36e748dd19fa tempest-VolumesSnapshotTestJSON-1948679985 None] Flow 'volume_create_manager' (56b3d6d5-f049-4f0b-9358-c76e1c54f08e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:33:09 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-25304609-6364-4e48-9abc-36e748dd19fa tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (203f843c-8284-45ef-91ee-83b5a95a3573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:09 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-25304609-6364-4e48-9abc-36e748dd19fa tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (203f843c-8284-45ef-91ee-83b5a95a3573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:33:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-804559502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fece07e5-8d28-4a78-b317-f0f01a1a674d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91bd3d6227a3427c99d886af727c7024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:33:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:33:09Z,use_quota=True,user_id='a5b1003031114b029ede968cb9c9a409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:09 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-25304609-6364-4e48-9abc-36e748dd19fa tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23ac48d8-980d-451e-bc88-243625103348) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:09 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-25304609-6364-4e48-9abc-36e748dd19fa tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (23ac48d8-980d-451e-bc88-243625103348) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:09 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-25304609-6364-4e48-9abc-36e748dd19fa tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88e8203b-b006-4c00-8c7f-b1fd0ccbf27f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:09 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-25304609-6364-4e48-9abc-36e748dd19fa tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (88e8203b-b006-4c00-8c7f-b1fd0ccbf27f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fece07e5-8d28-4a78-b317-f0f01a1a674d', 'volume_name': 'volume-fece07e5-8d28-4a78-b317-f0f01a1a674d', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:09 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-25304609-6364-4e48-9abc-36e748dd19fa tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (632075b6-c10f-4b68-abc7-baf2a4e8b24b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:09 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-25304609-6364-4e48-9abc-36e748dd19fa tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (632075b6-c10f-4b68-abc7-baf2a4e8b24b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:09 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-25304609-6364-4e48-9abc-36e748dd19fa tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77e0f69c-c2ae-406e-ba5d-62ed346b3390) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:09 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-25304609-6364-4e48-9abc-36e748dd19fa tempest-VolumesSnapshotTestJSON-1948679985 None] Volume fece07e5-8d28-4a78-b317-f0f01a1a674d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fece07e5-8d28-4a78-b317-f0f01a1a674d', 'volume_size': 1} Nov 01 12:33:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-25304609-6364-4e48-9abc-36e748dd19fa tempest-VolumesSnapshotTestJSON-1948679985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-d868b2f5-32e3-492e-9a3b-e05c7f801b17 req-69afaadb-0eca-4dfd-b09b-4d5e6bd7491d tempest-TestStampPattern-399521859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:13 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-4998e14a-cb4e-43c2-b457-3835d2b977bb tempest-VolumesListTestJSON-2088181280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:33:13 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4998e14a-cb4e-43c2-b457-3835d2b977bb tempest-VolumesListTestJSON-2088181280 None] Flow 'volume_create_manager' (3d242c81-51cf-4de7-bc96-73fd03e425f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:33:13 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4998e14a-cb4e-43c2-b457-3835d2b977bb tempest-VolumesListTestJSON-2088181280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da99017e-9982-4924-a6f4-ef1544494ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:13 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4998e14a-cb4e-43c2-b457-3835d2b977bb tempest-VolumesListTestJSON-2088181280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (da99017e-9982-4924-a6f4-ef1544494ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:33:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1504934903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5141be7-8209-4cf8-b2a6-7091f1020334,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='369a1aba7a454268bd9ca9d0f3cd425d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:33:14Z,use_quota=True,user_id='49d88865634f403d96f64de10c6e3a2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:13 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4998e14a-cb4e-43c2-b457-3835d2b977bb tempest-VolumesListTestJSON-2088181280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7448d9e2-84e5-437e-bd09-073295c58b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:13 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4998e14a-cb4e-43c2-b457-3835d2b977bb tempest-VolumesListTestJSON-2088181280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7448d9e2-84e5-437e-bd09-073295c58b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:13 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4998e14a-cb4e-43c2-b457-3835d2b977bb tempest-VolumesListTestJSON-2088181280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20daf63d-f110-4509-9a9f-b49177ca743f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:13 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4998e14a-cb4e-43c2-b457-3835d2b977bb tempest-VolumesListTestJSON-2088181280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (20daf63d-f110-4509-9a9f-b49177ca743f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c5141be7-8209-4cf8-b2a6-7091f1020334', 'volume_name': 'volume-c5141be7-8209-4cf8-b2a6-7091f1020334', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:13 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4998e14a-cb4e-43c2-b457-3835d2b977bb tempest-VolumesListTestJSON-2088181280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (686dcc87-148b-4946-8af5-26ab8f159a85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:13 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4998e14a-cb4e-43c2-b457-3835d2b977bb tempest-VolumesListTestJSON-2088181280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (686dcc87-148b-4946-8af5-26ab8f159a85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:13 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4998e14a-cb4e-43c2-b457-3835d2b977bb tempest-VolumesListTestJSON-2088181280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34ef822f-c018-4f65-91a9-ff18fce50e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:13 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-4998e14a-cb4e-43c2-b457-3835d2b977bb tempest-VolumesListTestJSON-2088181280 None] Volume c5141be7-8209-4cf8-b2a6-7091f1020334: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c5141be7-8209-4cf8-b2a6-7091f1020334', 'volume_size': 1} Nov 01 12:33:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4998e14a-cb4e-43c2-b457-3835d2b977bb tempest-VolumesListTestJSON-2088181280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:14 devstack sudo[101609]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:14 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f7c8e7d2-6bb1-4e92-92f3-5aaf767b72d2" returned: 0 in 8.774s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:14 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] Image conversion details: src /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0, size 1024.00 MB, duration 8.77 sec, destination /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f7c8e7d2-6bb1-4e92-92f3-5aaf767b72d2 {{(pid=86574) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 12:33:14 devstack cinder-volume[86574]: INFO cinder.image.image_utils [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] Converted 1024.00 MB image at 116.70 MB/s Nov 01 12:33:14 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f7c8e7d2-6bb1-4e92-92f3-5aaf767b72d2 is being set with open permissions: ugo+rw Nov 01 12:33:14 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f7c8e7d2-6bb1-4e92-92f3-5aaf767b72d2 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:14 devstack sudo[101664]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f7c8e7d2-6bb1-4e92-92f3-5aaf767b72d2 Nov 01 12:33:14 devstack sudo[101664]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:14 devstack sudo[101664]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:14 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f7c8e7d2-6bb1-4e92-92f3-5aaf767b72d2" returned: 0 in 0.249s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:14 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] Lock "cinder-quobyte-f7c8e7d2-6bb1-4e92-92f3-5aaf767b72d2" released by "_copy_volume_from_snapshot" :: held 9.992s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:14 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] Lock "cinder-quobyte-3422853e-a457-4130-a63b-aec5bf192673-f7c8e7d2-6bb1-4e92-92f3-5aaf767b72d2" released by "_create_volume_from_snapshot" :: held 10.065s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:14 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 10.086s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:14 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-25304609-6364-4e48-9abc-36e748dd19fa tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.727s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:14 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-25304609-6364-4e48-9abc-36e748dd19fa tempest-VolumesSnapshotTestJSON-1948679985 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:33:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-804559502',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fece07e5-8d28-4a78-b317-f0f01a1a674d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91bd3d6227a3427c99d886af727c7024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:33:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:33:09Z,use_quota=True,user_id='a5b1003031114b029ede968cb9c9a409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:33:14 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-25304609-6364-4e48-9abc-36e748dd19fa tempest-VolumesSnapshotTestJSON-1948679985 None] Creating volume fece07e5-8d28-4a78-b317-f0f01a1a674d {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:33:14 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-25304609-6364-4e48-9abc-36e748dd19fa tempest-VolumesSnapshotTestJSON-1948679985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:14 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-25304609-6364-4e48-9abc-36e748dd19fa tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:14 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-25304609-6364-4e48-9abc-36e748dd19fa tempest-VolumesSnapshotTestJSON-1948679985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:33:14 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-25304609-6364-4e48-9abc-36e748dd19fa tempest-VolumesSnapshotTestJSON-1948679985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:33:14 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-25304609-6364-4e48-9abc-36e748dd19fa tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:14 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-25304609-6364-4e48-9abc-36e748dd19fa tempest-VolumesSnapshotTestJSON-1948679985 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:33:14 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-25304609-6364-4e48-9abc-36e748dd19fa tempest-VolumesSnapshotTestJSON-1948679985 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:33:14 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-25304609-6364-4e48-9abc-36e748dd19fa tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:14 devstack sudo[101667]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d 1073741824 Nov 01 12:33:14 devstack sudo[101667]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:14 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d43baffc-71d7-4b38-ab61-7aabd721a87b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f7c8e7d2-6bb1-4e92-92f3-5aaf767b72d2', 'volume_size': 1, 'snapshot_id': '3422853e-a457-4130-a63b-aec5bf192673'}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:14 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef54f405-1bf7-4f58-a617-ad90b8947cf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:14 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] Volume volume-f7c8e7d2-6bb1-4e92-92f3-5aaf767b72d2 (f7c8e7d2-6bb1-4e92-92f3-5aaf767b72d2): created successfully Nov 01 12:33:14 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef54f405-1bf7-4f58-a617-ad90b8947cf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:14 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] Flow 'volume_create_manager' (cb21c96b-7ffb-475b-a08a-23ef68b148a1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:33:14 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-a8a70e52-2822-4d92-9a32-ee0ed836d648 tempest-SnapshotDependencyTests-692331658 None] Created volume successfully. Nov 01 12:33:14 devstack sudo[101667]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:14 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-25304609-6364-4e48-9abc-36e748dd19fa tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d 1073741824" returned: 0 in 0.407s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:14 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-25304609-6364-4e48-9abc-36e748dd19fa tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:14 devstack sudo[101672]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d Nov 01 12:33:14 devstack sudo[101672]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:15 devstack sudo[101672]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-25304609-6364-4e48-9abc-36e748dd19fa tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d" returned: 0 in 0.243s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:15 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-25304609-6364-4e48-9abc-36e748dd19fa tempest-VolumesSnapshotTestJSON-1948679985 None] <== create_volume: return (686ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:33:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-25304609-6364-4e48-9abc-36e748dd19fa tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-d868b2f5-32e3-492e-9a3b-e05c7f801b17 req-69afaadb-0eca-4dfd-b09b-4d5e6bd7491d tempest-TestStampPattern-399521859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 1.769s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:15 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-25304609-6364-4e48-9abc-36e748dd19fa tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77e0f69c-c2ae-406e-ba5d-62ed346b3390) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fece07e5-8d28-4a78-b317-f0f01a1a674d', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:15 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-25304609-6364-4e48-9abc-36e748dd19fa tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8c0c216-bf52-47ac-8f04-bfbe40228f0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-d868b2f5-32e3-492e-9a3b-e05c7f801b17 req-69afaadb-0eca-4dfd-b09b-4d5e6bd7491d tempest-TestStampPattern-399521859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.025s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4998e14a-cb4e-43c2-b457-3835d2b977bb tempest-VolumesListTestJSON-2088181280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.305s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:15 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-4998e14a-cb4e-43c2-b457-3835d2b977bb tempest-VolumesListTestJSON-2088181280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:33:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1504934903',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c5141be7-8209-4cf8-b2a6-7091f1020334,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='369a1aba7a454268bd9ca9d0f3cd425d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:33:14Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:33:14Z,use_quota=True,user_id='49d88865634f403d96f64de10c6e3a2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:33:15 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-4998e14a-cb4e-43c2-b457-3835d2b977bb tempest-VolumesListTestJSON-2088181280 None] Creating volume c5141be7-8209-4cf8-b2a6-7091f1020334 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:33:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4998e14a-cb4e-43c2-b457-3835d2b977bb tempest-VolumesListTestJSON-2088181280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4998e14a-cb4e-43c2-b457-3835d2b977bb tempest-VolumesListTestJSON-2088181280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:15 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-4998e14a-cb4e-43c2-b457-3835d2b977bb tempest-VolumesListTestJSON-2088181280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:33:15 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-4998e14a-cb4e-43c2-b457-3835d2b977bb tempest-VolumesListTestJSON-2088181280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:33:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4998e14a-cb4e-43c2-b457-3835d2b977bb tempest-VolumesListTestJSON-2088181280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:15 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-4998e14a-cb4e-43c2-b457-3835d2b977bb tempest-VolumesListTestJSON-2088181280 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:33:15 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-4998e14a-cb4e-43c2-b457-3835d2b977bb tempest-VolumesListTestJSON-2088181280 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:33:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4998e14a-cb4e-43c2-b457-3835d2b977bb tempest-VolumesListTestJSON-2088181280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c5141be7-8209-4cf8-b2a6-7091f1020334 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:15 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-25304609-6364-4e48-9abc-36e748dd19fa tempest-VolumesSnapshotTestJSON-1948679985 None] Volume volume-fece07e5-8d28-4a78-b317-f0f01a1a674d (fece07e5-8d28-4a78-b317-f0f01a1a674d): created successfully Nov 01 12:33:15 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-25304609-6364-4e48-9abc-36e748dd19fa tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a8c0c216-bf52-47ac-8f04-bfbe40228f0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:15 devstack sudo[101675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c5141be7-8209-4cf8-b2a6-7091f1020334 1073741824 Nov 01 12:33:15 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-25304609-6364-4e48-9abc-36e748dd19fa tempest-VolumesSnapshotTestJSON-1948679985 None] Flow 'volume_create_manager' (56b3d6d5-f049-4f0b-9358-c76e1c54f08e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:33:15 devstack sudo[101675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:15 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-25304609-6364-4e48-9abc-36e748dd19fa tempest-VolumesSnapshotTestJSON-1948679985 None] Created volume successfully. Nov 01 12:33:15 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-d868b2f5-32e3-492e-9a3b-e05c7f801b17 req-69afaadb-0eca-4dfd-b09b-4d5e6bd7491d tempest-TestStampPattern-399521859 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb', 'name': 'volume-3bee0113-3ffb-4a91-8376-422bef6e15db', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '16553b36-fcb0-4061-a034-46b73c60a4e8', 'enforce_multipath': True} {{(pid=86574) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 12:33:15 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-d868b2f5-32e3-492e-9a3b-e05c7f801b17 req-69afaadb-0eca-4dfd-b09b-4d5e6bd7491d tempest-TestStampPattern-399521859 None] attachment_update completed successfully. Nov 01 12:33:15 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f68ed306-4b38-4e93-93a1-c117b3105003 tempest-SnapshotDependencyTests-692331658 None] Acquiring lock "cinder-3422853e-a457-4130-a63b-aec5bf192673-delete_snapshot" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:15 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f68ed306-4b38-4e93-93a1-c117b3105003 tempest-SnapshotDependencyTests-692331658 None] Lock "cinder-3422853e-a457-4130-a63b-aec5bf192673-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:15 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f68ed306-4b38-4e93-93a1-c117b3105003 tempest-SnapshotDependencyTests-692331658 None] Acquiring lock "cinder-quobyte-57b5882e-b660-4dbc-9dae-7446d6382ad0" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:15 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f68ed306-4b38-4e93-93a1-c117b3105003 tempest-SnapshotDependencyTests-692331658 None] Lock "cinder-quobyte-57b5882e-b660-4dbc-9dae-7446d6382ad0" acquired by "delete_snapshot" :: waited 0.019s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:15 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f68ed306-4b38-4e93-93a1-c117b3105003 tempest-SnapshotDependencyTests-692331658 None] Acquiring lock "cinder-quobyte-3422853e-a457-4130-a63b-aec5bf192673" by "_delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:15 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f68ed306-4b38-4e93-93a1-c117b3105003 tempest-SnapshotDependencyTests-692331658 None] Lock "cinder-quobyte-3422853e-a457-4130-a63b-aec5bf192673" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:15 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-f68ed306-4b38-4e93-93a1-c117b3105003 tempest-SnapshotDependencyTests-692331658 None] Deleting offline snapshot 3422853e-a457-4130-a63b-aec5bf192673 of volume 57b5882e-b660-4dbc-9dae-7446d6382ad0 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:33:15 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-f68ed306-4b38-4e93-93a1-c117b3105003 tempest-SnapshotDependencyTests-692331658 None] snapshot_file for this snap is: volume-57b5882e-b660-4dbc-9dae-7446d6382ad0.3422853e-a457-4130-a63b-aec5bf192673 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:33:15 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[69aeaed4-fcd0-4aaf-8a0f-e80aa73e3433]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f68ed306-4b38-4e93-93a1-c117b3105003 tempest-SnapshotDependencyTests-692331658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0.3422853e-a457-4130-a63b-aec5bf192673 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:15 devstack sudo[101705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0.3422853e-a457-4130-a63b-aec5bf192673 Nov 01 12:33:15 devstack sudo[101705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:15 devstack sudo[101675]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4998e14a-cb4e-43c2-b457-3835d2b977bb tempest-VolumesListTestJSON-2088181280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c5141be7-8209-4cf8-b2a6-7091f1020334 1073741824" returned: 0 in 0.546s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4998e14a-cb4e-43c2-b457-3835d2b977bb tempest-VolumesListTestJSON-2088181280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c5141be7-8209-4cf8-b2a6-7091f1020334 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:15 devstack sudo[102097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c5141be7-8209-4cf8-b2a6-7091f1020334 Nov 01 12:33:15 devstack sudo[102097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:15 devstack sudo[101705]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f68ed306-4b38-4e93-93a1-c117b3105003 tempest-SnapshotDependencyTests-692331658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0.3422853e-a457-4130-a63b-aec5bf192673" returned: 0 in 0.444s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:15 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-f68ed306-4b38-4e93-93a1-c117b3105003 tempest-SnapshotDependencyTests-692331658 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-57b5882e-b660-4dbc-9dae-7446d6382ad0(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:33:15 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f1c7a51-63c7-441b-8287-943726d5a10a]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f68ed306-4b38-4e93-93a1-c117b3105003 tempest-SnapshotDependencyTests-692331658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:16 devstack sudo[102097]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:16 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4998e14a-cb4e-43c2-b457-3835d2b977bb tempest-VolumesListTestJSON-2088181280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c5141be7-8209-4cf8-b2a6-7091f1020334" returned: 0 in 0.370s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:16 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-4998e14a-cb4e-43c2-b457-3835d2b977bb tempest-VolumesListTestJSON-2088181280 None] <== create_volume: return (961ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:33:16 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4998e14a-cb4e-43c2-b457-3835d2b977bb tempest-VolumesListTestJSON-2088181280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.965s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:16 devstack sudo[102103]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0 Nov 01 12:33:16 devstack sudo[102103]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:16 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4998e14a-cb4e-43c2-b457-3835d2b977bb tempest-VolumesListTestJSON-2088181280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34ef822f-c018-4f65-91a9-ff18fce50e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c5141be7-8209-4cf8-b2a6-7091f1020334', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:16 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4998e14a-cb4e-43c2-b457-3835d2b977bb tempest-VolumesListTestJSON-2088181280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (172ec529-c908-4c13-a7d6-22e05b55b480) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:16 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-4998e14a-cb4e-43c2-b457-3835d2b977bb tempest-VolumesListTestJSON-2088181280 None] Volume volume-c5141be7-8209-4cf8-b2a6-7091f1020334 (c5141be7-8209-4cf8-b2a6-7091f1020334): created successfully Nov 01 12:33:16 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4998e14a-cb4e-43c2-b457-3835d2b977bb tempest-VolumesListTestJSON-2088181280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (172ec529-c908-4c13-a7d6-22e05b55b480) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:16 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4998e14a-cb4e-43c2-b457-3835d2b977bb tempest-VolumesListTestJSON-2088181280 None] Flow 'volume_create_manager' (3d242c81-51cf-4de7-bc96-73fd03e425f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:33:16 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-4998e14a-cb4e-43c2-b457-3835d2b977bb tempest-VolumesListTestJSON-2088181280 None] Created volume successfully. Nov 01 12:33:16 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-7cfcc657-9ea1-444f-a638-8ed11ba81da6 tempest-VolumesSnapshotTestJSON-1948679985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:16 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-7cfcc657-9ea1-444f-a638-8ed11ba81da6 tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:16 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-7cfcc657-9ea1-444f-a638-8ed11ba81da6 tempest-VolumesSnapshotTestJSON-1948679985 None] Creating offline snapshot 4437f29f-bde7-4ce7-9cf0-bfdf847a79c4 of volume fece07e5-8d28-4a78-b317-f0f01a1a674d {{(pid=86574) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:33:16 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd6db7e8-3675-4cd5-ac40-c7f70f95fd99]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:16 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7cfcc657-9ea1-444f-a638-8ed11ba81da6 tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:16 devstack sudo[102108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d Nov 01 12:33:16 devstack sudo[102108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:16 devstack sudo[102103]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:16 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f68ed306-4b38-4e93-93a1-c117b3105003 tempest-SnapshotDependencyTests-692331658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0" returned: 0 in 0.656s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:16 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f68ed306-4b38-4e93-93a1-c117b3105003 tempest-SnapshotDependencyTests-692331658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0.3422853e-a457-4130-a63b-aec5bf192673 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:16 devstack sudo[102111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0.3422853e-a457-4130-a63b-aec5bf192673 Nov 01 12:33:16 devstack sudo[102111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:16 devstack sudo[102108]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:16 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7cfcc657-9ea1-444f-a638-8ed11ba81da6 tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d" returned: 0 in 0.401s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:16 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7cfcc657-9ea1-444f-a638-8ed11ba81da6 tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d.4437f29f-bde7-4ce7-9cf0-bfdf847a79c4 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:16 devstack sudo[102116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d.4437f29f-bde7-4ce7-9cf0-bfdf847a79c4 1G Nov 01 12:33:16 devstack sudo[102116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:16 devstack sudo[102111]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:16 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f68ed306-4b38-4e93-93a1-c117b3105003 tempest-SnapshotDependencyTests-692331658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0.3422853e-a457-4130-a63b-aec5bf192673" returned: 0 in 0.365s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:16 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f68ed306-4b38-4e93-93a1-c117b3105003 tempest-SnapshotDependencyTests-692331658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0.3422853e-a457-4130-a63b-aec5bf192673 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:16 devstack sudo[102123]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0.3422853e-a457-4130-a63b-aec5bf192673 Nov 01 12:33:16 devstack sudo[102123]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:17 devstack sudo[102123]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:17 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f68ed306-4b38-4e93-93a1-c117b3105003 tempest-SnapshotDependencyTests-692331658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0.3422853e-a457-4130-a63b-aec5bf192673" returned: 0 in 0.295s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:17 devstack sudo[102116]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:17 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7cfcc657-9ea1-444f-a638-8ed11ba81da6 tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d.4437f29f-bde7-4ce7-9cf0-bfdf847a79c4 1G" returned: 0 in 0.577s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:17 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7cfcc657-9ea1-444f-a638-8ed11ba81da6 tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fece07e5-8d28-4a78-b317-f0f01a1a674d -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d.4437f29f-bde7-4ce7-9cf0-bfdf847a79c4 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:17 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f68ed306-4b38-4e93-93a1-c117b3105003 tempest-SnapshotDependencyTests-692331658 None] Lock "cinder-quobyte-3422853e-a457-4130-a63b-aec5bf192673" released by "_delete_snapshot" :: held 1.924s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:17 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f68ed306-4b38-4e93-93a1-c117b3105003 tempest-SnapshotDependencyTests-692331658 None] Lock "cinder-quobyte-57b5882e-b660-4dbc-9dae-7446d6382ad0" released by "delete_snapshot" :: held 1.963s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:17 devstack sudo[102130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fece07e5-8d28-4a78-b317-f0f01a1a674d -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d.4437f29f-bde7-4ce7-9cf0-bfdf847a79c4 Nov 01 12:33:17 devstack sudo[102130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:17 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-59ded96b-9754-4421-9bdd-752cb4a9cd64 tempest-VolumesListTestJSON-2088181280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:33:17 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-59ded96b-9754-4421-9bdd-752cb4a9cd64 tempest-VolumesListTestJSON-2088181280 None] Flow 'volume_create_manager' (8b796738-1f02-4281-b11d-314d43858d54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:33:17 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-59ded96b-9754-4421-9bdd-752cb4a9cd64 tempest-VolumesListTestJSON-2088181280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f88331d-743f-41d7-b429-f05a3850db96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:17 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-59ded96b-9754-4421-9bdd-752cb4a9cd64 tempest-VolumesListTestJSON-2088181280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9f88331d-743f-41d7-b429-f05a3850db96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:33:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-622381947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb11de02-cb60-4bec-b9ad-bb49b62219e6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='369a1aba7a454268bd9ca9d0f3cd425d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:33:17Z,use_quota=True,user_id='49d88865634f403d96f64de10c6e3a2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:17 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-59ded96b-9754-4421-9bdd-752cb4a9cd64 tempest-VolumesListTestJSON-2088181280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5a7c3cf-09c6-49b2-8f0a-9f1d719b2737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:17 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-59ded96b-9754-4421-9bdd-752cb4a9cd64 tempest-VolumesListTestJSON-2088181280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a5a7c3cf-09c6-49b2-8f0a-9f1d719b2737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:17 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-59ded96b-9754-4421-9bdd-752cb4a9cd64 tempest-VolumesListTestJSON-2088181280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (493c0c5d-7e1f-46bd-82cc-600c852c0284) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:17 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-59ded96b-9754-4421-9bdd-752cb4a9cd64 tempest-VolumesListTestJSON-2088181280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (493c0c5d-7e1f-46bd-82cc-600c852c0284) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eb11de02-cb60-4bec-b9ad-bb49b62219e6', 'volume_name': 'volume-eb11de02-cb60-4bec-b9ad-bb49b62219e6', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:17 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-59ded96b-9754-4421-9bdd-752cb4a9cd64 tempest-VolumesListTestJSON-2088181280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (595a48e9-337e-4245-9944-569954b861be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:17 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-59ded96b-9754-4421-9bdd-752cb4a9cd64 tempest-VolumesListTestJSON-2088181280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (595a48e9-337e-4245-9944-569954b861be) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:17 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-59ded96b-9754-4421-9bdd-752cb4a9cd64 tempest-VolumesListTestJSON-2088181280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (617b9999-b1bb-4103-a0bd-6cb341b67455) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:17 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-59ded96b-9754-4421-9bdd-752cb4a9cd64 tempest-VolumesListTestJSON-2088181280 None] Volume eb11de02-cb60-4bec-b9ad-bb49b62219e6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eb11de02-cb60-4bec-b9ad-bb49b62219e6', 'volume_size': 1} Nov 01 12:33:17 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-59ded96b-9754-4421-9bdd-752cb4a9cd64 tempest-VolumesListTestJSON-2088181280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:17 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-f68ed306-4b38-4e93-93a1-c117b3105003 tempest-SnapshotDependencyTests-692331658 None] Created reservations ['3359edbb-4af9-4f99-a59b-651cc5158903', '3e7b1945-bd6c-4f13-b123-78b70b001bc9', '1c42ffed-551e-4548-8393-e53ce6333573', 'b37fdc91-7b65-4609-bcf9-7101f8fb516a'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:33:17 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-f68ed306-4b38-4e93-93a1-c117b3105003 tempest-SnapshotDependencyTests-692331658 None] Delete snapshot completed successfully. Nov 01 12:33:17 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f68ed306-4b38-4e93-93a1-c117b3105003 tempest-SnapshotDependencyTests-692331658 None] Lock "cinder-3422853e-a457-4130-a63b-aec5bf192673-delete_snapshot" released by "delete_snapshot" :: held 2.213s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:17 devstack sudo[102130]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:17 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7cfcc657-9ea1-444f-a638-8ed11ba81da6 tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fece07e5-8d28-4a78-b317-f0f01a1a674d -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d.4437f29f-bde7-4ce7-9cf0-bfdf847a79c4" returned: 0 in 0.318s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:17 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-7cfcc657-9ea1-444f-a638-8ed11ba81da6 tempest-VolumesSnapshotTestJSON-1948679985 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d.4437f29f-bde7-4ce7-9cf0-bfdf847a79c4 is being set with open permissions: ugo+rw Nov 01 12:33:17 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7cfcc657-9ea1-444f-a638-8ed11ba81da6 tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d.4437f29f-bde7-4ce7-9cf0-bfdf847a79c4 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:17 devstack sudo[102144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d.4437f29f-bde7-4ce7-9cf0-bfdf847a79c4 Nov 01 12:33:17 devstack sudo[102144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:17 devstack sudo[102144]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:17 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7cfcc657-9ea1-444f-a638-8ed11ba81da6 tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d.4437f29f-bde7-4ce7-9cf0-bfdf847a79c4" returned: 0 in 0.266s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:17 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7cfcc657-9ea1-444f-a638-8ed11ba81da6 tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:17 devstack sudo[102147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d.info Nov 01 12:33:17 devstack sudo[102147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:18 devstack sudo[102147]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:18 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7cfcc657-9ea1-444f-a638-8ed11ba81da6 tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d.info" returned: 0 in 0.269s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:18 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-7cfcc657-9ea1-444f-a638-8ed11ba81da6 tempest-VolumesSnapshotTestJSON-1948679985 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d.info is being set with open permissions: ugo+rw Nov 01 12:33:18 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7cfcc657-9ea1-444f-a638-8ed11ba81da6 tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:18 devstack sudo[102150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d.info Nov 01 12:33:18 devstack sudo[102150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:18 devstack sudo[102150]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:18 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7cfcc657-9ea1-444f-a638-8ed11ba81da6 tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d.info" returned: 0 in 0.291s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:18 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-7cfcc657-9ea1-444f-a638-8ed11ba81da6 tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.232s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:18 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-59ded96b-9754-4421-9bdd-752cb4a9cd64 tempest-VolumesListTestJSON-2088181280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.040s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:18 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-59ded96b-9754-4421-9bdd-752cb4a9cd64 tempest-VolumesListTestJSON-2088181280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:33:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-622381947',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eb11de02-cb60-4bec-b9ad-bb49b62219e6,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='369a1aba7a454268bd9ca9d0f3cd425d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:33:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:33:17Z,use_quota=True,user_id='49d88865634f403d96f64de10c6e3a2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:33:18 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-59ded96b-9754-4421-9bdd-752cb4a9cd64 tempest-VolumesListTestJSON-2088181280 None] Creating volume eb11de02-cb60-4bec-b9ad-bb49b62219e6 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:33:18 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-59ded96b-9754-4421-9bdd-752cb4a9cd64 tempest-VolumesListTestJSON-2088181280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:18 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-59ded96b-9754-4421-9bdd-752cb4a9cd64 tempest-VolumesListTestJSON-2088181280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:18 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-59ded96b-9754-4421-9bdd-752cb4a9cd64 tempest-VolumesListTestJSON-2088181280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:33:18 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-59ded96b-9754-4421-9bdd-752cb4a9cd64 tempest-VolumesListTestJSON-2088181280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:33:18 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-59ded96b-9754-4421-9bdd-752cb4a9cd64 tempest-VolumesListTestJSON-2088181280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:18 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-59ded96b-9754-4421-9bdd-752cb4a9cd64 tempest-VolumesListTestJSON-2088181280 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:33:18 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-59ded96b-9754-4421-9bdd-752cb4a9cd64 tempest-VolumesListTestJSON-2088181280 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:33:18 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-59ded96b-9754-4421-9bdd-752cb4a9cd64 tempest-VolumesListTestJSON-2088181280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-eb11de02-cb60-4bec-b9ad-bb49b62219e6 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:18 devstack sudo[102154]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-eb11de02-cb60-4bec-b9ad-bb49b62219e6 1073741824 Nov 01 12:33:18 devstack sudo[102154]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:18 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-7cfcc657-9ea1-444f-a638-8ed11ba81da6 tempest-VolumesSnapshotTestJSON-1948679985 None] Create snapshot completed successfully Nov 01 12:33:18 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-7018fb9f-1a10-42c1-9df8-bef2a21c6eba tempest-SnapshotDependencyTests-692331658 None] Acquiring lock "cinder-57b5882e-b660-4dbc-9dae-7446d6382ad0-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:18 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-7018fb9f-1a10-42c1-9df8-bef2a21c6eba tempest-SnapshotDependencyTests-692331658 None] Lock "cinder-57b5882e-b660-4dbc-9dae-7446d6382ad0-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:18 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-7018fb9f-1a10-42c1-9df8-bef2a21c6eba tempest-SnapshotDependencyTests-692331658 None] Acquiring lock "cinder-quobyte-57b5882e-b660-4dbc-9dae-7446d6382ad0" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:18 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-7018fb9f-1a10-42c1-9df8-bef2a21c6eba tempest-SnapshotDependencyTests-692331658 None] Lock "cinder-quobyte-57b5882e-b660-4dbc-9dae-7446d6382ad0" acquired by "delete_volume" :: waited 0.017s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:18 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8f6b5be-aec1-43ef-b49d-942f8c04d4da]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:18 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7018fb9f-1a10-42c1-9df8-bef2a21c6eba tempest-SnapshotDependencyTests-692331658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:18 devstack sudo[102156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0 Nov 01 12:33:18 devstack sudo[102156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:18 devstack sudo[102154]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:18 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-59ded96b-9754-4421-9bdd-752cb4a9cd64 tempest-VolumesListTestJSON-2088181280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-eb11de02-cb60-4bec-b9ad-bb49b62219e6 1073741824" returned: 0 in 0.501s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:18 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-59ded96b-9754-4421-9bdd-752cb4a9cd64 tempest-VolumesListTestJSON-2088181280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-eb11de02-cb60-4bec-b9ad-bb49b62219e6 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:19 devstack sudo[102164]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-eb11de02-cb60-4bec-b9ad-bb49b62219e6 Nov 01 12:33:19 devstack sudo[102164]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:19 devstack sudo[102156]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:19 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7018fb9f-1a10-42c1-9df8-bef2a21c6eba tempest-SnapshotDependencyTests-692331658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0" returned: 0 in 0.411s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:19 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7018fb9f-1a10-42c1-9df8-bef2a21c6eba tempest-SnapshotDependencyTests-692331658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:19 devstack sudo[102166]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0 Nov 01 12:33:19 devstack sudo[102166]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:19 devstack sudo[102164]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:19 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-59ded96b-9754-4421-9bdd-752cb4a9cd64 tempest-VolumesListTestJSON-2088181280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-eb11de02-cb60-4bec-b9ad-bb49b62219e6" returned: 0 in 0.295s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:19 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-59ded96b-9754-4421-9bdd-752cb4a9cd64 tempest-VolumesListTestJSON-2088181280 None] <== create_volume: return (854ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:33:19 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-59ded96b-9754-4421-9bdd-752cb4a9cd64 tempest-VolumesListTestJSON-2088181280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.858s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:19 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-59ded96b-9754-4421-9bdd-752cb4a9cd64 tempest-VolumesListTestJSON-2088181280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (617b9999-b1bb-4103-a0bd-6cb341b67455) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eb11de02-cb60-4bec-b9ad-bb49b62219e6', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:19 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-59ded96b-9754-4421-9bdd-752cb4a9cd64 tempest-VolumesListTestJSON-2088181280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3de87516-cf72-4d4f-b868-42a60915dabd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:19 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-59ded96b-9754-4421-9bdd-752cb4a9cd64 tempest-VolumesListTestJSON-2088181280 None] Volume volume-eb11de02-cb60-4bec-b9ad-bb49b62219e6 (eb11de02-cb60-4bec-b9ad-bb49b62219e6): created successfully Nov 01 12:33:19 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-59ded96b-9754-4421-9bdd-752cb4a9cd64 tempest-VolumesListTestJSON-2088181280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3de87516-cf72-4d4f-b868-42a60915dabd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:19 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-59ded96b-9754-4421-9bdd-752cb4a9cd64 tempest-VolumesListTestJSON-2088181280 None] Flow 'volume_create_manager' (8b796738-1f02-4281-b11d-314d43858d54) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:33:19 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-59ded96b-9754-4421-9bdd-752cb4a9cd64 tempest-VolumesListTestJSON-2088181280 None] Created volume successfully. Nov 01 12:33:19 devstack sudo[102166]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:19 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7018fb9f-1a10-42c1-9df8-bef2a21c6eba tempest-SnapshotDependencyTests-692331658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-57b5882e-b660-4dbc-9dae-7446d6382ad0" returned: 0 in 0.349s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:19 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-7018fb9f-1a10-42c1-9df8-bef2a21c6eba tempest-SnapshotDependencyTests-692331658 None] Lock "cinder-quobyte-57b5882e-b660-4dbc-9dae-7446d6382ad0" released by "delete_volume" :: held 0.838s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:19 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-7018fb9f-1a10-42c1-9df8-bef2a21c6eba tempest-SnapshotDependencyTests-692331658 None] Created reservations ['cfddd400-ab7f-4e26-9cea-1022c1a724be', 'ad39477a-810d-4d3b-b6fe-b3c7917f4c0a', '70877ab0-3246-4336-9816-2df453c24353', '862f1449-ad47-40b6-8d87-80d0b5986f53'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:33:19 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-7018fb9f-1a10-42c1-9df8-bef2a21c6eba tempest-SnapshotDependencyTests-692331658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:19 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-7018fb9f-1a10-42c1-9df8-bef2a21c6eba tempest-SnapshotDependencyTests-692331658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:19 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-7018fb9f-1a10-42c1-9df8-bef2a21c6eba tempest-SnapshotDependencyTests-692331658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:33:19 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-7018fb9f-1a10-42c1-9df8-bef2a21c6eba tempest-SnapshotDependencyTests-692331658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:33:19 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-7018fb9f-1a10-42c1-9df8-bef2a21c6eba tempest-SnapshotDependencyTests-692331658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:19 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7018fb9f-1a10-42c1-9df8-bef2a21c6eba tempest-SnapshotDependencyTests-692331658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:19 devstack sudo[102174]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:33:19 devstack sudo[102174]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:19 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-21ef3906-eac1-4a36-9181-26e714630241 tempest-SnapshotDependencyTests-692331658 None] Acquiring lock "cinder-f7c8e7d2-6bb1-4e92-92f3-5aaf767b72d2-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:19 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-21ef3906-eac1-4a36-9181-26e714630241 tempest-SnapshotDependencyTests-692331658 None] Lock "cinder-f7c8e7d2-6bb1-4e92-92f3-5aaf767b72d2-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:19 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-21ef3906-eac1-4a36-9181-26e714630241 tempest-SnapshotDependencyTests-692331658 None] Acquiring lock "cinder-quobyte-f7c8e7d2-6bb1-4e92-92f3-5aaf767b72d2" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:19 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-21ef3906-eac1-4a36-9181-26e714630241 tempest-SnapshotDependencyTests-692331658 None] Lock "cinder-quobyte-f7c8e7d2-6bb1-4e92-92f3-5aaf767b72d2" acquired by "delete_volume" :: waited 0.026s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:19 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e196276-a27e-4c66-8b7e-ea2d917ae372]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:19 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-21ef3906-eac1-4a36-9181-26e714630241 tempest-SnapshotDependencyTests-692331658 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f7c8e7d2-6bb1-4e92-92f3-5aaf767b72d2 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:19 devstack sudo[102174]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:19 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7018fb9f-1a10-42c1-9df8-bef2a21c6eba tempest-SnapshotDependencyTests-692331658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.384s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:19 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-7018fb9f-1a10-42c1-9df8-bef2a21c6eba tempest-SnapshotDependencyTests-692331658 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:33:19 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-7018fb9f-1a10-42c1-9df8-bef2a21c6eba tempest-SnapshotDependencyTests-692331658 None] Deleted volume successfully. Nov 01 12:33:20 devstack sudo[102180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f7c8e7d2-6bb1-4e92-92f3-5aaf767b72d2 Nov 01 12:33:20 devstack sudo[102180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:20 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-7018fb9f-1a10-42c1-9df8-bef2a21c6eba tempest-SnapshotDependencyTests-692331658 None] Lock "cinder-57b5882e-b660-4dbc-9dae-7446d6382ad0-delete_volume" released by "delete_volume" :: held 1.498s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:20 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:33:20 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] Flow 'volume_create_manager' (1a5b51e0-e776-485e-ac28-4f3ad360cbeb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:33:20 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9589c45-7ed3-4c00-b3c7-f7154be36a44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:20 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f9589c45-7ed3-4c00-b3c7-f7154be36a44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:33:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotTestJSON-Volume-1629495698',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=740783e9-fa30-4762-9bc3-f16b30a625d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91bd3d6227a3427c99d886af727c7024',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:33:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4437f29f-bde7-4ce7-9cf0-bfdf847a79c4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:33:20Z,use_quota=True,user_id='a5b1003031114b029ede968cb9c9a409',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:20 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b860c95-34d5-4095-9810-38d4f9dfc0c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:20 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b860c95-34d5-4095-9810-38d4f9dfc0c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:20 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (448930be-9e1d-43ef-9858-274d4dfc504a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:20 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (448930be-9e1d-43ef-9858-274d4dfc504a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '740783e9-fa30-4762-9bc3-f16b30a625d9', 'volume_name': 'volume-740783e9-fa30-4762-9bc3-f16b30a625d9', 'volume_size': 1, 'snapshot_id': '4437f29f-bde7-4ce7-9cf0-bfdf847a79c4'}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:20 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d75588f-a175-47ea-bbc1-f62531155243) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:20 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5d75588f-a175-47ea-bbc1-f62531155243) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:20 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bf51b4b-387b-4d9e-9dcd-dd4b887e33a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:20 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] Volume 740783e9-fa30-4762-9bc3-f16b30a625d9: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-740783e9-fa30-4762-9bc3-f16b30a625d9', 'volume_size': 1, 'snapshot_id': '4437f29f-bde7-4ce7-9cf0-bfdf847a79c4'} Nov 01 12:33:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:20 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] Acquiring lock "cinder-quobyte-4437f29f-bde7-4ce7-9cf0-bfdf847a79c4-740783e9-fa30-4762-9bc3-f16b30a625d9" by "_create_volume_from_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:20 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "cinder-quobyte-4437f29f-bde7-4ce7-9cf0-bfdf847a79c4-740783e9-fa30-4762-9bc3-f16b30a625d9" acquired by "_create_volume_from_snapshot" :: waited 0.023s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:20 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] Creating volume 740783e9-fa30-4762-9bc3-f16b30a625d9 from snapshot 4437f29f-bde7-4ce7-9cf0-bfdf847a79c4 {{(pid=86574) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 01 12:33:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:20 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:33:20 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:33:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:20 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:33:20 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] Acquiring lock "cinder-quobyte-740783e9-fa30-4762-9bc3-f16b30a625d9" by "_copy_volume_from_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:20 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "cinder-quobyte-740783e9-fa30-4762-9bc3-f16b30a625d9" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:20 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] snapshot: 4437f29f-bde7-4ce7-9cf0-bfdf847a79c4, volume: 740783e9-fa30-4762-9bc3-f16b30a625d9, {{(pid=86574) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 01 12:33:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:20 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:33:20 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:33:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:20 devstack sudo[102180]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-21ef3906-eac1-4a36-9181-26e714630241 tempest-SnapshotDependencyTests-692331658 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f7c8e7d2-6bb1-4e92-92f3-5aaf767b72d2" returned: 0 in 0.456s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-21ef3906-eac1-4a36-9181-26e714630241 tempest-SnapshotDependencyTests-692331658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f7c8e7d2-6bb1-4e92-92f3-5aaf767b72d2 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:20 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[834ad679-06bf-4dcf-b393-297871710884]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d.4437f29f-bde7-4ce7-9cf0-bfdf847a79c4 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:20 devstack sudo[102190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f7c8e7d2-6bb1-4e92-92f3-5aaf767b72d2 Nov 01 12:33:20 devstack sudo[102190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:20 devstack sudo[102191]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d.4437f29f-bde7-4ce7-9cf0-bfdf847a79c4 Nov 01 12:33:20 devstack sudo[102191]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:20 devstack sudo[102190]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-21ef3906-eac1-4a36-9181-26e714630241 tempest-SnapshotDependencyTests-692331658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f7c8e7d2-6bb1-4e92-92f3-5aaf767b72d2" returned: 0 in 0.384s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:20 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-21ef3906-eac1-4a36-9181-26e714630241 tempest-SnapshotDependencyTests-692331658 None] Lock "cinder-quobyte-f7c8e7d2-6bb1-4e92-92f3-5aaf767b72d2" released by "delete_volume" :: held 0.916s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:20 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-21ef3906-eac1-4a36-9181-26e714630241 tempest-SnapshotDependencyTests-692331658 None] Created reservations ['92fa7864-e744-4ada-b9fd-e2ae95bb506a', 'f3ae3847-e21d-4baf-aeb0-21936f6bfabc', 'b8799e73-8d37-4bb1-bfd3-a6d6b100820d', 'b1ee6e17-6752-4cf3-907a-1950df023ad7'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:33:20 devstack sudo[102191]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d.4437f29f-bde7-4ce7-9cf0-bfdf847a79c4" returned: 0 in 0.464s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:20 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fece07e5-8d28-4a78-b317-f0f01a1a674d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:33:20 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[a091d88b-10e9-4af6-94e2-a944ad4d1ce3]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-21ef3906-eac1-4a36-9181-26e714630241 tempest-SnapshotDependencyTests-692331658 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-21ef3906-eac1-4a36-9181-26e714630241 tempest-SnapshotDependencyTests-692331658 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:20 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-21ef3906-eac1-4a36-9181-26e714630241 tempest-SnapshotDependencyTests-692331658 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:33:20 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-21ef3906-eac1-4a36-9181-26e714630241 tempest-SnapshotDependencyTests-692331658 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:33:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-21ef3906-eac1-4a36-9181-26e714630241 tempest-SnapshotDependencyTests-692331658 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-21ef3906-eac1-4a36-9181-26e714630241 tempest-SnapshotDependencyTests-692331658 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:21 devstack sudo[102202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:33:21 devstack sudo[102202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:21 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-8d47d39c-beba-47d4-9f57-e14d926acaeb req-3caebd7c-bcf5-4952-b205-189207e2c0d2 tempest-TestStampPattern-399521859 None] Terminate volume connection completed successfully. Nov 01 12:33:21 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-8d47d39c-beba-47d4-9f57-e14d926acaeb req-3caebd7c-bcf5-4952-b205-189207e2c0d2 tempest-TestStampPattern-399521859 None] Deleting attachment 16553b36-fcb0-4061-a034-46b73c60a4e8. {{(pid=86574) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 12:33:21 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-d34146ae-1358-4a85-b6fb-65f974f8ffa3 tempest-VolumesListTestJSON-2088181280 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:33:21 devstack sudo[102200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d Nov 01 12:33:21 devstack sudo[102200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:21 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d34146ae-1358-4a85-b6fb-65f974f8ffa3 tempest-VolumesListTestJSON-2088181280 None] Flow 'volume_create_manager' (0346a341-c8b9-42c2-894d-efd7c056bd2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:33:21 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d34146ae-1358-4a85-b6fb-65f974f8ffa3 tempest-VolumesListTestJSON-2088181280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36d0fec7-3d73-415b-9ae6-77850ab7c54e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:21 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d34146ae-1358-4a85-b6fb-65f974f8ffa3 tempest-VolumesListTestJSON-2088181280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36d0fec7-3d73-415b-9ae6-77850ab7c54e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-407337598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a4dc4ca-a88d-43b3-af61-1a6750f736b7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='369a1aba7a454268bd9ca9d0f3cd425d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:33:21Z,use_quota=True,user_id='49d88865634f403d96f64de10c6e3a2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:21 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d34146ae-1358-4a85-b6fb-65f974f8ffa3 tempest-VolumesListTestJSON-2088181280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce8e999c-b6a8-4bdf-a21f-1beda0946239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:21 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d34146ae-1358-4a85-b6fb-65f974f8ffa3 tempest-VolumesListTestJSON-2088181280 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce8e999c-b6a8-4bdf-a21f-1beda0946239) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:21 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d34146ae-1358-4a85-b6fb-65f974f8ffa3 tempest-VolumesListTestJSON-2088181280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0485b2d-d805-4b70-8a33-7d1be38e5cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:21 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d34146ae-1358-4a85-b6fb-65f974f8ffa3 tempest-VolumesListTestJSON-2088181280 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e0485b2d-d805-4b70-8a33-7d1be38e5cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7a4dc4ca-a88d-43b3-af61-1a6750f736b7', 'volume_name': 'volume-7a4dc4ca-a88d-43b3-af61-1a6750f736b7', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:21 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d34146ae-1358-4a85-b6fb-65f974f8ffa3 tempest-VolumesListTestJSON-2088181280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b07e035-80ee-4c19-a120-8fa014da32c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:21 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d34146ae-1358-4a85-b6fb-65f974f8ffa3 tempest-VolumesListTestJSON-2088181280 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7b07e035-80ee-4c19-a120-8fa014da32c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:21 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d34146ae-1358-4a85-b6fb-65f974f8ffa3 tempest-VolumesListTestJSON-2088181280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84095990-cb4f-4194-9f85-ac84f760a2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:21 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-d34146ae-1358-4a85-b6fb-65f974f8ffa3 tempest-VolumesListTestJSON-2088181280 None] Volume 7a4dc4ca-a88d-43b3-af61-1a6750f736b7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7a4dc4ca-a88d-43b3-af61-1a6750f736b7', 'volume_size': 1} Nov 01 12:33:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d34146ae-1358-4a85-b6fb-65f974f8ffa3 tempest-VolumesListTestJSON-2088181280 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:21 devstack sudo[102202]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-21ef3906-eac1-4a36-9181-26e714630241 tempest-SnapshotDependencyTests-692331658 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.367s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:21 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-21ef3906-eac1-4a36-9181-26e714630241 tempest-SnapshotDependencyTests-692331658 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:33:21 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-21ef3906-eac1-4a36-9181-26e714630241 tempest-SnapshotDependencyTests-692331658 None] Deleted volume successfully. Nov 01 12:33:21 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-21ef3906-eac1-4a36-9181-26e714630241 tempest-SnapshotDependencyTests-692331658 None] Lock "cinder-f7c8e7d2-6bb1-4e92-92f3-5aaf767b72d2-delete_volume" released by "delete_volume" :: held 1.633s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:21 devstack sudo[102200]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d" returned: 0 in 0.627s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:21 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d {{(pid=86574) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 01 12:33:21 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] Creating direct copy from snapshot {{(pid=86574) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 01 12:33:21 devstack cinder-volume[86574]: DEBUG cinder.utils [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] Path /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-740783e9-fa30-4762-9bc3-f16b30a625d9 not found in is_blk_device check {{(pid=86574) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 01 12:33:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-740783e9-fa30-4762-9bc3-f16b30a625d9 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:21 devstack sudo[102235]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-740783e9-fa30-4762-9bc3-f16b30a625d9 Nov 01 12:33:21 devstack sudo[102235]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5b0ba876-d14c-4c1e-bd66-4711e9e2617e tempest-TestStampPattern-399521859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:28 devstack sudo[102235]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-740783e9-fa30-4762-9bc3-f16b30a625d9" returned: 0 in 7.014s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:28 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] Image conversion details: src /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d, size 1024.00 MB, duration 7.02 sec, destination /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-740783e9-fa30-4762-9bc3-f16b30a625d9 {{(pid=86574) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 12:33:28 devstack cinder-volume[86574]: INFO cinder.image.image_utils [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] Converted 1024.00 MB image at 145.95 MB/s Nov 01 12:33:28 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-740783e9-fa30-4762-9bc3-f16b30a625d9 is being set with open permissions: ugo+rw Nov 01 12:33:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-740783e9-fa30-4762-9bc3-f16b30a625d9 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:28 devstack sudo[102250]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-740783e9-fa30-4762-9bc3-f16b30a625d9 Nov 01 12:33:28 devstack sudo[102250]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:28 devstack sudo[102250]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-740783e9-fa30-4762-9bc3-f16b30a625d9" returned: 0 in 0.297s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:28 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "cinder-quobyte-740783e9-fa30-4762-9bc3-f16b30a625d9" released by "_copy_volume_from_snapshot" :: held 8.558s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:28 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "cinder-quobyte-4437f29f-bde7-4ce7-9cf0-bfdf847a79c4-740783e9-fa30-4762-9bc3-f16b30a625d9" released by "_create_volume_from_snapshot" :: held 8.633s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.658s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d34146ae-1358-4a85-b6fb-65f974f8ffa3 tempest-VolumesListTestJSON-2088181280 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 7.572s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:28 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d34146ae-1358-4a85-b6fb-65f974f8ffa3 tempest-VolumesListTestJSON-2088181280 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:33:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-407337598',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7a4dc4ca-a88d-43b3-af61-1a6750f736b7,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='369a1aba7a454268bd9ca9d0f3cd425d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:33:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:33:21Z,use_quota=True,user_id='49d88865634f403d96f64de10c6e3a2b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:33:28 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-d34146ae-1358-4a85-b6fb-65f974f8ffa3 tempest-VolumesListTestJSON-2088181280 None] Creating volume 7a4dc4ca-a88d-43b3-af61-1a6750f736b7 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:33:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d34146ae-1358-4a85-b6fb-65f974f8ffa3 tempest-VolumesListTestJSON-2088181280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d34146ae-1358-4a85-b6fb-65f974f8ffa3 tempest-VolumesListTestJSON-2088181280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:28 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d34146ae-1358-4a85-b6fb-65f974f8ffa3 tempest-VolumesListTestJSON-2088181280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:33:28 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d34146ae-1358-4a85-b6fb-65f974f8ffa3 tempest-VolumesListTestJSON-2088181280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:33:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d34146ae-1358-4a85-b6fb-65f974f8ffa3 tempest-VolumesListTestJSON-2088181280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:28 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d34146ae-1358-4a85-b6fb-65f974f8ffa3 tempest-VolumesListTestJSON-2088181280 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:33:28 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-d34146ae-1358-4a85-b6fb-65f974f8ffa3 tempest-VolumesListTestJSON-2088181280 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:33:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d34146ae-1358-4a85-b6fb-65f974f8ffa3 tempest-VolumesListTestJSON-2088181280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7a4dc4ca-a88d-43b3-af61-1a6750f736b7 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:28 devstack sudo[102254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7a4dc4ca-a88d-43b3-af61-1a6750f736b7 1073741824 Nov 01 12:33:28 devstack sudo[102254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bf51b4b-387b-4d9e-9dcd-dd4b887e33a3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-740783e9-fa30-4762-9bc3-f16b30a625d9', 'volume_size': 1, 'snapshot_id': '4437f29f-bde7-4ce7-9cf0-bfdf847a79c4'}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fb04920-c12a-4856-a20a-36c83d6f2836) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:28 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] Volume volume-740783e9-fa30-4762-9bc3-f16b30a625d9 (740783e9-fa30-4762-9bc3-f16b30a625d9): created successfully Nov 01 12:33:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6fb04920-c12a-4856-a20a-36c83d6f2836) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] Flow 'volume_create_manager' (1a5b51e0-e776-485e-ac28-4f3ad360cbeb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:33:28 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-4a48a27d-71d9-4f10-b509-08847789fa0f tempest-VolumesSnapshotTestJSON-1948679985 None] Created volume successfully. Nov 01 12:33:29 devstack sudo[102254]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d34146ae-1358-4a85-b6fb-65f974f8ffa3 tempest-VolumesListTestJSON-2088181280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7a4dc4ca-a88d-43b3-af61-1a6750f736b7 1073741824" returned: 0 in 0.431s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d34146ae-1358-4a85-b6fb-65f974f8ffa3 tempest-VolumesListTestJSON-2088181280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7a4dc4ca-a88d-43b3-af61-1a6750f736b7 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:29 devstack sudo[102259]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7a4dc4ca-a88d-43b3-af61-1a6750f736b7 Nov 01 12:33:29 devstack sudo[102259]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:29 devstack sudo[102259]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d34146ae-1358-4a85-b6fb-65f974f8ffa3 tempest-VolumesListTestJSON-2088181280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7a4dc4ca-a88d-43b3-af61-1a6750f736b7" returned: 0 in 0.252s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:29 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d34146ae-1358-4a85-b6fb-65f974f8ffa3 tempest-VolumesListTestJSON-2088181280 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:33:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d34146ae-1358-4a85-b6fb-65f974f8ffa3 tempest-VolumesListTestJSON-2088181280 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5b0ba876-d14c-4c1e-bd66-4711e9e2617e tempest-TestStampPattern-399521859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 7.721s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d34146ae-1358-4a85-b6fb-65f974f8ffa3 tempest-VolumesListTestJSON-2088181280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84095990-cb4f-4194-9f85-ac84f760a2a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7a4dc4ca-a88d-43b3-af61-1a6750f736b7', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d34146ae-1358-4a85-b6fb-65f974f8ffa3 tempest-VolumesListTestJSON-2088181280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a554c00e-471e-4112-9421-dd4486c8d7c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:29 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-5b0ba876-d14c-4c1e-bd66-4711e9e2617e tempest-TestStampPattern-399521859 None] Creating offline snapshot 62344888-06a1-4b5f-a6b7-9757c7105a16 of volume 3bee0113-3ffb-4a91-8376-422bef6e15db {{(pid=86574) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:33:29 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-d34146ae-1358-4a85-b6fb-65f974f8ffa3 tempest-VolumesListTestJSON-2088181280 None] Volume volume-7a4dc4ca-a88d-43b3-af61-1a6750f736b7 (7a4dc4ca-a88d-43b3-af61-1a6750f736b7): created successfully Nov 01 12:33:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d34146ae-1358-4a85-b6fb-65f974f8ffa3 tempest-VolumesListTestJSON-2088181280 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a554c00e-471e-4112-9421-dd4486c8d7c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d34146ae-1358-4a85-b6fb-65f974f8ffa3 tempest-VolumesListTestJSON-2088181280 None] Flow 'volume_create_manager' (0346a341-c8b9-42c2-894d-efd7c056bd2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:33:29 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[1a9b210d-894b-4275-94a3-848f30cb7dfa]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5b0ba876-d14c-4c1e-bd66-4711e9e2617e tempest-TestStampPattern-399521859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:29 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-d34146ae-1358-4a85-b6fb-65f974f8ffa3 tempest-VolumesListTestJSON-2088181280 None] Created volume successfully. Nov 01 12:33:29 devstack sudo[102262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db Nov 01 12:33:29 devstack sudo[102262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:30 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b03c243c-f535-4dc4-b564-00ebea038b07 tempest-VolumesSnapshotTestJSON-1948679985 None] Acquiring lock "cinder-740783e9-fa30-4762-9bc3-f16b30a625d9-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:30 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b03c243c-f535-4dc4-b564-00ebea038b07 tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "cinder-740783e9-fa30-4762-9bc3-f16b30a625d9-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:30 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b03c243c-f535-4dc4-b564-00ebea038b07 tempest-VolumesSnapshotTestJSON-1948679985 None] Acquiring lock "cinder-quobyte-740783e9-fa30-4762-9bc3-f16b30a625d9" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:30 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b03c243c-f535-4dc4-b564-00ebea038b07 tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "cinder-quobyte-740783e9-fa30-4762-9bc3-f16b30a625d9" acquired by "delete_volume" :: waited 0.024s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:30 devstack sudo[102262]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5b0ba876-d14c-4c1e-bd66-4711e9e2617e tempest-TestStampPattern-399521859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db" returned: 0 in 0.473s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5b0ba876-d14c-4c1e-bd66-4711e9e2617e tempest-TestStampPattern-399521859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db.62344888-06a1-4b5f-a6b7-9757c7105a16 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:30 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9a2c15f-c398-406a-ad90-beb5c60b0dfc]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b03c243c-f535-4dc4-b564-00ebea038b07 tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-740783e9-fa30-4762-9bc3-f16b30a625d9 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:30 devstack sudo[102267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db.62344888-06a1-4b5f-a6b7-9757c7105a16 1G Nov 01 12:33:30 devstack sudo[102267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:30 devstack sudo[102268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-740783e9-fa30-4762-9bc3-f16b30a625d9 Nov 01 12:33:30 devstack sudo[102268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:30 devstack sudo[102268]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b03c243c-f535-4dc4-b564-00ebea038b07 tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-740783e9-fa30-4762-9bc3-f16b30a625d9" returned: 0 in 0.457s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b03c243c-f535-4dc4-b564-00ebea038b07 tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-740783e9-fa30-4762-9bc3-f16b30a625d9 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:30 devstack sudo[102267]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:30 devstack sudo[102280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-740783e9-fa30-4762-9bc3-f16b30a625d9 Nov 01 12:33:30 devstack sudo[102280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5b0ba876-d14c-4c1e-bd66-4711e9e2617e tempest-TestStampPattern-399521859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db.62344888-06a1-4b5f-a6b7-9757c7105a16 1G" returned: 0 in 0.507s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5b0ba876-d14c-4c1e-bd66-4711e9e2617e tempest-TestStampPattern-399521859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bee0113-3ffb-4a91-8376-422bef6e15db -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db.62344888-06a1-4b5f-a6b7-9757c7105a16 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:30 devstack sudo[102282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bee0113-3ffb-4a91-8376-422bef6e15db -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db.62344888-06a1-4b5f-a6b7-9757c7105a16 Nov 01 12:33:30 devstack sudo[102282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:30 devstack sudo[102280]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b03c243c-f535-4dc4-b564-00ebea038b07 tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-740783e9-fa30-4762-9bc3-f16b30a625d9" returned: 0 in 0.317s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:30 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b03c243c-f535-4dc4-b564-00ebea038b07 tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "cinder-quobyte-740783e9-fa30-4762-9bc3-f16b30a625d9" released by "delete_volume" :: held 0.838s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:31 devstack sudo[102282]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5b0ba876-d14c-4c1e-bd66-4711e9e2617e tempest-TestStampPattern-399521859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-3bee0113-3ffb-4a91-8376-422bef6e15db -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db.62344888-06a1-4b5f-a6b7-9757c7105a16" returned: 0 in 0.345s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:31 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-5b0ba876-d14c-4c1e-bd66-4711e9e2617e tempest-TestStampPattern-399521859 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db.62344888-06a1-4b5f-a6b7-9757c7105a16 is being set with open permissions: ugo+rw Nov 01 12:33:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5b0ba876-d14c-4c1e-bd66-4711e9e2617e tempest-TestStampPattern-399521859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db.62344888-06a1-4b5f-a6b7-9757c7105a16 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:31 devstack sudo[102288]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db.62344888-06a1-4b5f-a6b7-9757c7105a16 Nov 01 12:33:31 devstack sudo[102288]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:31 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-b03c243c-f535-4dc4-b564-00ebea038b07 tempest-VolumesSnapshotTestJSON-1948679985 None] Created reservations ['8c127d65-b918-4e90-ad05-b1ae83066635', '2376a3a2-a3c0-40e6-8ccc-08c118ba14be', '0a95ca60-4515-4305-8f96-b479b5c1d9b2', 'e93a1e7b-7836-4715-a255-ebdece3d8ee2'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:33:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b03c243c-f535-4dc4-b564-00ebea038b07 tempest-VolumesSnapshotTestJSON-1948679985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b03c243c-f535-4dc4-b564-00ebea038b07 tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:31 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-b03c243c-f535-4dc4-b564-00ebea038b07 tempest-VolumesSnapshotTestJSON-1948679985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:33:31 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-b03c243c-f535-4dc4-b564-00ebea038b07 tempest-VolumesSnapshotTestJSON-1948679985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:33:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b03c243c-f535-4dc4-b564-00ebea038b07 tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b03c243c-f535-4dc4-b564-00ebea038b07 tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:31 devstack sudo[102290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:33:31 devstack sudo[102290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:31 devstack sudo[102288]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5b0ba876-d14c-4c1e-bd66-4711e9e2617e tempest-TestStampPattern-399521859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db.62344888-06a1-4b5f-a6b7-9757c7105a16" returned: 0 in 0.306s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5b0ba876-d14c-4c1e-bd66-4711e9e2617e tempest-TestStampPattern-399521859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:31 devstack sudo[102293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db.info Nov 01 12:33:31 devstack sudo[102293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:31 devstack sudo[102290]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b03c243c-f535-4dc4-b564-00ebea038b07 tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.365s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:31 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-b03c243c-f535-4dc4-b564-00ebea038b07 tempest-VolumesSnapshotTestJSON-1948679985 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:33:31 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-b03c243c-f535-4dc4-b564-00ebea038b07 tempest-VolumesSnapshotTestJSON-1948679985 None] Deleted volume successfully. Nov 01 12:33:31 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b03c243c-f535-4dc4-b564-00ebea038b07 tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "cinder-740783e9-fa30-4762-9bc3-f16b30a625d9-delete_volume" released by "delete_volume" :: held 1.593s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:31 devstack sudo[102293]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5b0ba876-d14c-4c1e-bd66-4711e9e2617e tempest-TestStampPattern-399521859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db.info" returned: 0 in 0.313s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:31 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-5b0ba876-d14c-4c1e-bd66-4711e9e2617e tempest-TestStampPattern-399521859 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db.info is being set with open permissions: ugo+rw Nov 01 12:33:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5b0ba876-d14c-4c1e-bd66-4711e9e2617e tempest-TestStampPattern-399521859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:31 devstack sudo[102297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db.info Nov 01 12:33:31 devstack sudo[102297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:31 devstack sudo[102297]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5b0ba876-d14c-4c1e-bd66-4711e9e2617e tempest-TestStampPattern-399521859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db.info" returned: 0 in 0.259s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5b0ba876-d14c-4c1e-bd66-4711e9e2617e tempest-TestStampPattern-399521859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.351s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:31 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-5b0ba876-d14c-4c1e-bd66-4711e9e2617e tempest-TestStampPattern-399521859 None] Create snapshot completed successfully Nov 01 12:33:32 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e4e585a6-d6df-4b2f-a54c-de04fecfca49 tempest-VolumesSnapshotTestJSON-1948679985 None] Acquiring lock "cinder-4437f29f-bde7-4ce7-9cf0-bfdf847a79c4-delete_snapshot" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:32 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e4e585a6-d6df-4b2f-a54c-de04fecfca49 tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "cinder-4437f29f-bde7-4ce7-9cf0-bfdf847a79c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:32 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e4e585a6-d6df-4b2f-a54c-de04fecfca49 tempest-VolumesSnapshotTestJSON-1948679985 None] Acquiring lock "cinder-quobyte-fece07e5-8d28-4a78-b317-f0f01a1a674d" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:32 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e4e585a6-d6df-4b2f-a54c-de04fecfca49 tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "cinder-quobyte-fece07e5-8d28-4a78-b317-f0f01a1a674d" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:32 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e4e585a6-d6df-4b2f-a54c-de04fecfca49 tempest-VolumesSnapshotTestJSON-1948679985 None] Acquiring lock "cinder-quobyte-4437f29f-bde7-4ce7-9cf0-bfdf847a79c4" by "_delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:32 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e4e585a6-d6df-4b2f-a54c-de04fecfca49 tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "cinder-quobyte-4437f29f-bde7-4ce7-9cf0-bfdf847a79c4" acquired by "_delete_snapshot" :: waited 0.026s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:32 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-e4e585a6-d6df-4b2f-a54c-de04fecfca49 tempest-VolumesSnapshotTestJSON-1948679985 None] Deleting offline snapshot 4437f29f-bde7-4ce7-9cf0-bfdf847a79c4 of volume fece07e5-8d28-4a78-b317-f0f01a1a674d {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:33:32 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-e4e585a6-d6df-4b2f-a54c-de04fecfca49 tempest-VolumesSnapshotTestJSON-1948679985 None] snapshot_file for this snap is: volume-fece07e5-8d28-4a78-b317-f0f01a1a674d.4437f29f-bde7-4ce7-9cf0-bfdf847a79c4 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:33:32 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cd3a0b9-2acb-4e3f-84a1-3a85a13441d7]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e4e585a6-d6df-4b2f-a54c-de04fecfca49 tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d.4437f29f-bde7-4ce7-9cf0-bfdf847a79c4 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:32 devstack sudo[102300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d.4437f29f-bde7-4ce7-9cf0-bfdf847a79c4 Nov 01 12:33:32 devstack sudo[102300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:32 devstack sudo[102300]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e4e585a6-d6df-4b2f-a54c-de04fecfca49 tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d.4437f29f-bde7-4ce7-9cf0-bfdf847a79c4" returned: 0 in 0.432s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:32 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-e4e585a6-d6df-4b2f-a54c-de04fecfca49 tempest-VolumesSnapshotTestJSON-1948679985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fece07e5-8d28-4a78-b317-f0f01a1a674d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:33:32 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[84b9c7d2-ee44-4315-944f-6f871ac82ccc]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e4e585a6-d6df-4b2f-a54c-de04fecfca49 tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:33 devstack sudo[102306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d Nov 01 12:33:33 devstack sudo[102306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:33 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-33947b29-1208-4d40-b449-ca720b0194d3 tempest-VolumesListTestJSON-2088181280 None] Acquiring lock "cinder-7a4dc4ca-a88d-43b3-af61-1a6750f736b7-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:33 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-33947b29-1208-4d40-b449-ca720b0194d3 tempest-VolumesListTestJSON-2088181280 None] Lock "cinder-7a4dc4ca-a88d-43b3-af61-1a6750f736b7-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:33 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-33947b29-1208-4d40-b449-ca720b0194d3 tempest-VolumesListTestJSON-2088181280 None] Acquiring lock "cinder-quobyte-7a4dc4ca-a88d-43b3-af61-1a6750f736b7" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:33 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-33947b29-1208-4d40-b449-ca720b0194d3 tempest-VolumesListTestJSON-2088181280 None] Lock "cinder-quobyte-7a4dc4ca-a88d-43b3-af61-1a6750f736b7" acquired by "delete_volume" :: waited 0.030s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:33 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[62791563-ae7b-42ce-8ae1-8e22a17969c1]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-33947b29-1208-4d40-b449-ca720b0194d3 tempest-VolumesListTestJSON-2088181280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7a4dc4ca-a88d-43b3-af61-1a6750f736b7 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:33 devstack sudo[102310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7a4dc4ca-a88d-43b3-af61-1a6750f736b7 Nov 01 12:33:33 devstack sudo[102310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:33 devstack sudo[102306]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e4e585a6-d6df-4b2f-a54c-de04fecfca49 tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d" returned: 0 in 0.848s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e4e585a6-d6df-4b2f-a54c-de04fecfca49 tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d.4437f29f-bde7-4ce7-9cf0-bfdf847a79c4 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:33 devstack sudo[102313]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d.4437f29f-bde7-4ce7-9cf0-bfdf847a79c4 Nov 01 12:33:33 devstack sudo[102313]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:34 devstack sudo[102310]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-33947b29-1208-4d40-b449-ca720b0194d3 tempest-VolumesListTestJSON-2088181280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7a4dc4ca-a88d-43b3-af61-1a6750f736b7" returned: 0 in 0.535s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-33947b29-1208-4d40-b449-ca720b0194d3 tempest-VolumesListTestJSON-2088181280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7a4dc4ca-a88d-43b3-af61-1a6750f736b7 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:34 devstack sudo[102321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7a4dc4ca-a88d-43b3-af61-1a6750f736b7 Nov 01 12:33:34 devstack sudo[102321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:34 devstack sudo[102313]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e4e585a6-d6df-4b2f-a54c-de04fecfca49 tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d.4437f29f-bde7-4ce7-9cf0-bfdf847a79c4" returned: 0 in 0.546s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e4e585a6-d6df-4b2f-a54c-de04fecfca49 tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d.4437f29f-bde7-4ce7-9cf0-bfdf847a79c4 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:34 devstack sudo[102324]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d.4437f29f-bde7-4ce7-9cf0-bfdf847a79c4 Nov 01 12:33:34 devstack sudo[102324]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:34 devstack sudo[102321]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-33947b29-1208-4d40-b449-ca720b0194d3 tempest-VolumesListTestJSON-2088181280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7a4dc4ca-a88d-43b3-af61-1a6750f736b7" returned: 0 in 0.375s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:34 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-33947b29-1208-4d40-b449-ca720b0194d3 tempest-VolumesListTestJSON-2088181280 None] Lock "cinder-quobyte-7a4dc4ca-a88d-43b3-af61-1a6750f736b7" released by "delete_volume" :: held 0.991s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:34 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-33947b29-1208-4d40-b449-ca720b0194d3 tempest-VolumesListTestJSON-2088181280 None] Created reservations ['3ae537b1-877e-4dc5-8063-fd7be9fd0ea0', '71242181-1d33-4e71-b014-49ff4134dcc1', '94935a8c-b799-48f0-a9ee-d4bbbaeb9340', '87047be4-1a9c-4821-a5f2-e7110fffa760'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:33:34 devstack sudo[102324]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e4e585a6-d6df-4b2f-a54c-de04fecfca49 tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d.4437f29f-bde7-4ce7-9cf0-bfdf847a79c4" returned: 0 in 0.362s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:34 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e4e585a6-d6df-4b2f-a54c-de04fecfca49 tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "cinder-quobyte-4437f29f-bde7-4ce7-9cf0-bfdf847a79c4" released by "_delete_snapshot" :: held 2.357s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:34 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e4e585a6-d6df-4b2f-a54c-de04fecfca49 tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "cinder-quobyte-fece07e5-8d28-4a78-b317-f0f01a1a674d" released by "delete_snapshot" :: held 2.394s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-33947b29-1208-4d40-b449-ca720b0194d3 tempest-VolumesListTestJSON-2088181280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-33947b29-1208-4d40-b449-ca720b0194d3 tempest-VolumesListTestJSON-2088181280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:34 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-33947b29-1208-4d40-b449-ca720b0194d3 tempest-VolumesListTestJSON-2088181280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:33:34 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-33947b29-1208-4d40-b449-ca720b0194d3 tempest-VolumesListTestJSON-2088181280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:33:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-33947b29-1208-4d40-b449-ca720b0194d3 tempest-VolumesListTestJSON-2088181280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-33947b29-1208-4d40-b449-ca720b0194d3 tempest-VolumesListTestJSON-2088181280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:34 devstack sudo[102334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:33:34 devstack sudo[102334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:34 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-e4e585a6-d6df-4b2f-a54c-de04fecfca49 tempest-VolumesSnapshotTestJSON-1948679985 None] Created reservations ['f394e12f-a4f7-4806-836d-d2aa4489567b', '9e45810a-a979-46d4-b263-3d763e19ae7e', '19a80da9-2c32-4046-8618-e12e8b10775d', 'f3049f77-6983-4cda-b29f-0745a347fc06'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:33:34 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-e4e585a6-d6df-4b2f-a54c-de04fecfca49 tempest-VolumesSnapshotTestJSON-1948679985 None] Delete snapshot completed successfully. Nov 01 12:33:34 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e4e585a6-d6df-4b2f-a54c-de04fecfca49 tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "cinder-4437f29f-bde7-4ce7-9cf0-bfdf847a79c4-delete_snapshot" released by "delete_snapshot" :: held 2.608s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:35 devstack sudo[102334]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-33947b29-1208-4d40-b449-ca720b0194d3 tempest-VolumesListTestJSON-2088181280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.294s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:35 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-33947b29-1208-4d40-b449-ca720b0194d3 tempest-VolumesListTestJSON-2088181280 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:33:35 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-33947b29-1208-4d40-b449-ca720b0194d3 tempest-VolumesListTestJSON-2088181280 None] Deleted volume successfully. Nov 01 12:33:35 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-33947b29-1208-4d40-b449-ca720b0194d3 tempest-VolumesListTestJSON-2088181280 None] Lock "cinder-7a4dc4ca-a88d-43b3-af61-1a6750f736b7-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:35 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-470a654d-2bbc-43cd-94e2-caa8dc5c1f28 tempest-VolumesSnapshotTestJSON-1948679985 None] Acquiring lock "cinder-fece07e5-8d28-4a78-b317-f0f01a1a674d-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:35 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-470a654d-2bbc-43cd-94e2-caa8dc5c1f28 tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "cinder-fece07e5-8d28-4a78-b317-f0f01a1a674d-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:35 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-470a654d-2bbc-43cd-94e2-caa8dc5c1f28 tempest-VolumesSnapshotTestJSON-1948679985 None] Acquiring lock "cinder-quobyte-fece07e5-8d28-4a78-b317-f0f01a1a674d" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:35 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-4db72fad-f15a-4ee9-b61f-07655dd32d1d tempest-VolumesListTestJSON-2088181280 None] Acquiring lock "cinder-eb11de02-cb60-4bec-b9ad-bb49b62219e6-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:35 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-470a654d-2bbc-43cd-94e2-caa8dc5c1f28 tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "cinder-quobyte-fece07e5-8d28-4a78-b317-f0f01a1a674d" acquired by "delete_volume" :: waited 0.030s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:35 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-4db72fad-f15a-4ee9-b61f-07655dd32d1d tempest-VolumesListTestJSON-2088181280 None] Lock "cinder-eb11de02-cb60-4bec-b9ad-bb49b62219e6-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:35 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0d903d5-3b7b-4e88-bcc9-ae0a8849138a]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-470a654d-2bbc-43cd-94e2-caa8dc5c1f28 tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:35 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-4db72fad-f15a-4ee9-b61f-07655dd32d1d tempest-VolumesListTestJSON-2088181280 None] Acquiring lock "cinder-quobyte-eb11de02-cb60-4bec-b9ad-bb49b62219e6" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:35 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-4db72fad-f15a-4ee9-b61f-07655dd32d1d tempest-VolumesListTestJSON-2088181280 None] Lock "cinder-quobyte-eb11de02-cb60-4bec-b9ad-bb49b62219e6" acquired by "delete_volume" :: waited 0.024s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:35 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceae9c2e-39af-45cd-a4dc-1e3c7e1177fa]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4db72fad-f15a-4ee9-b61f-07655dd32d1d tempest-VolumesListTestJSON-2088181280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-eb11de02-cb60-4bec-b9ad-bb49b62219e6 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:36 devstack sudo[102364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d Nov 01 12:33:36 devstack sudo[102364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:36 devstack sudo[102375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-eb11de02-cb60-4bec-b9ad-bb49b62219e6 Nov 01 12:33:36 devstack sudo[102375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:36 devstack sudo[102364]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-470a654d-2bbc-43cd-94e2-caa8dc5c1f28 tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d" returned: 0 in 0.517s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-470a654d-2bbc-43cd-94e2-caa8dc5c1f28 tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:36 devstack sudo[102381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d Nov 01 12:33:36 devstack sudo[102381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:36 devstack sudo[102375]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4db72fad-f15a-4ee9-b61f-07655dd32d1d tempest-VolumesListTestJSON-2088181280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-eb11de02-cb60-4bec-b9ad-bb49b62219e6" returned: 0 in 0.539s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4db72fad-f15a-4ee9-b61f-07655dd32d1d tempest-VolumesListTestJSON-2088181280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-eb11de02-cb60-4bec-b9ad-bb49b62219e6 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:36 devstack sudo[102387]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-eb11de02-cb60-4bec-b9ad-bb49b62219e6 Nov 01 12:33:36 devstack sudo[102387]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-470a654d-2bbc-43cd-94e2-caa8dc5c1f28 tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fece07e5-8d28-4a78-b317-f0f01a1a674d" returned: 0 in 0.318s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:36 devstack sudo[102381]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:36 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-470a654d-2bbc-43cd-94e2-caa8dc5c1f28 tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "cinder-quobyte-fece07e5-8d28-4a78-b317-f0f01a1a674d" released by "delete_volume" :: held 0.974s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:36 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-470a654d-2bbc-43cd-94e2-caa8dc5c1f28 tempest-VolumesSnapshotTestJSON-1948679985 None] Created reservations ['18a7d28c-ab28-4c54-ab1a-084b1cede6ad', '85bf4da3-1578-450a-8815-43eabe4b0d7f', '4d6c2b19-4331-4bb9-adbe-c0d1a35f40c2', 'fe28c607-3143-4a6c-99b6-40e9e4a8f691'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:33:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-470a654d-2bbc-43cd-94e2-caa8dc5c1f28 tempest-VolumesSnapshotTestJSON-1948679985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-470a654d-2bbc-43cd-94e2-caa8dc5c1f28 tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:36 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-470a654d-2bbc-43cd-94e2-caa8dc5c1f28 tempest-VolumesSnapshotTestJSON-1948679985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:33:36 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-470a654d-2bbc-43cd-94e2-caa8dc5c1f28 tempest-VolumesSnapshotTestJSON-1948679985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:33:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-470a654d-2bbc-43cd-94e2-caa8dc5c1f28 tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-470a654d-2bbc-43cd-94e2-caa8dc5c1f28 tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:36 devstack sudo[102391]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:33:36 devstack sudo[102391]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:36 devstack sudo[102387]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4db72fad-f15a-4ee9-b61f-07655dd32d1d tempest-VolumesListTestJSON-2088181280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-eb11de02-cb60-4bec-b9ad-bb49b62219e6" returned: 0 in 0.469s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:37 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-4db72fad-f15a-4ee9-b61f-07655dd32d1d tempest-VolumesListTestJSON-2088181280 None] Lock "cinder-quobyte-eb11de02-cb60-4bec-b9ad-bb49b62219e6" released by "delete_volume" :: held 1.079s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:37 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-76130726-b2c3-4c86-9213-a8948ae58e2f tempest-VolumesSnapshotTestJSON-1948679985 None] Acquiring lock "cinder-59df17bc-f404-460c-8aec-55196af2645d-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:37 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-76130726-b2c3-4c86-9213-a8948ae58e2f tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "cinder-59df17bc-f404-460c-8aec-55196af2645d-delete_volume" acquired by "delete_volume" :: waited 0.068s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:37 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-4db72fad-f15a-4ee9-b61f-07655dd32d1d tempest-VolumesListTestJSON-2088181280 None] Created reservations ['748f4f3a-2fe7-4cd7-a79f-a3cfbecaebd5', '960b103f-dca9-4371-a321-cd2d4e30002c', '0cdfc1a5-449e-4ed4-887c-a601876e6735', 'e678460e-0c1a-4b37-a1f3-45751127d58c'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:33:37 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-76130726-b2c3-4c86-9213-a8948ae58e2f tempest-VolumesSnapshotTestJSON-1948679985 None] Acquiring lock "cinder-quobyte-59df17bc-f404-460c-8aec-55196af2645d" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:37 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-76130726-b2c3-4c86-9213-a8948ae58e2f tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "cinder-quobyte-59df17bc-f404-460c-8aec-55196af2645d" acquired by "delete_volume" :: waited 0.035s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:37 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff368442-5946-4d6a-b1b6-45a24df23de0]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-76130726-b2c3-4c86-9213-a8948ae58e2f tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-59df17bc-f404-460c-8aec-55196af2645d {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:37 devstack sudo[102391]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4db72fad-f15a-4ee9-b61f-07655dd32d1d tempest-VolumesListTestJSON-2088181280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4db72fad-f15a-4ee9-b61f-07655dd32d1d tempest-VolumesListTestJSON-2088181280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:37 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-4db72fad-f15a-4ee9-b61f-07655dd32d1d tempest-VolumesListTestJSON-2088181280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:33:37 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-4db72fad-f15a-4ee9-b61f-07655dd32d1d tempest-VolumesListTestJSON-2088181280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:33:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4db72fad-f15a-4ee9-b61f-07655dd32d1d tempest-VolumesListTestJSON-2088181280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4db72fad-f15a-4ee9-b61f-07655dd32d1d tempest-VolumesListTestJSON-2088181280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-470a654d-2bbc-43cd-94e2-caa8dc5c1f28 tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.536s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:37 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-470a654d-2bbc-43cd-94e2-caa8dc5c1f28 tempest-VolumesSnapshotTestJSON-1948679985 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:33:37 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-470a654d-2bbc-43cd-94e2-caa8dc5c1f28 tempest-VolumesSnapshotTestJSON-1948679985 None] Deleted volume successfully. Nov 01 12:33:37 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-470a654d-2bbc-43cd-94e2-caa8dc5c1f28 tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "cinder-fece07e5-8d28-4a78-b317-f0f01a1a674d-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:37 devstack sudo[102395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:33:37 devstack sudo[102395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:37 devstack sudo[102394]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-59df17bc-f404-460c-8aec-55196af2645d Nov 01 12:33:37 devstack sudo[102394]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:37 devstack sudo[102395]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4db72fad-f15a-4ee9-b61f-07655dd32d1d tempest-VolumesListTestJSON-2088181280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.316s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:37 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-4db72fad-f15a-4ee9-b61f-07655dd32d1d tempest-VolumesListTestJSON-2088181280 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:33:37 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-4db72fad-f15a-4ee9-b61f-07655dd32d1d tempest-VolumesListTestJSON-2088181280 None] Deleted volume successfully. Nov 01 12:33:37 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-4db72fad-f15a-4ee9-b61f-07655dd32d1d tempest-VolumesListTestJSON-2088181280 None] Lock "cinder-eb11de02-cb60-4bec-b9ad-bb49b62219e6-delete_volume" released by "delete_volume" :: held 1.898s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:37 devstack sudo[102394]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-76130726-b2c3-4c86-9213-a8948ae58e2f tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-59df17bc-f404-460c-8aec-55196af2645d" returned: 0 in 0.446s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-76130726-b2c3-4c86-9213-a8948ae58e2f tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-59df17bc-f404-460c-8aec-55196af2645d {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:37 devstack sudo[102402]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-59df17bc-f404-460c-8aec-55196af2645d Nov 01 12:33:37 devstack sudo[102402]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:38 devstack sudo[102402]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-76130726-b2c3-4c86-9213-a8948ae58e2f tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-59df17bc-f404-460c-8aec-55196af2645d" returned: 0 in 0.273s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:38 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-76130726-b2c3-4c86-9213-a8948ae58e2f tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "cinder-quobyte-59df17bc-f404-460c-8aec-55196af2645d" released by "delete_volume" :: held 0.815s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:38 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-76130726-b2c3-4c86-9213-a8948ae58e2f tempest-VolumesSnapshotTestJSON-1948679985 None] Created reservations ['faa2c542-b8d3-468b-b4db-5d42822aed15', '440abaff-f541-498e-9591-acb7af14c266', '62302586-5ecc-4765-acca-0a96eb1b028b', 'c0b07e07-bfdf-4f23-b25d-bbea0c9f9faf'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:33:38 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-237377bd-43b7-4f3b-ad63-a10613a28ec8 tempest-VolumesListTestJSON-2088181280 None] Acquiring lock "cinder-c5141be7-8209-4cf8-b2a6-7091f1020334-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:38 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-237377bd-43b7-4f3b-ad63-a10613a28ec8 tempest-VolumesListTestJSON-2088181280 None] Lock "cinder-c5141be7-8209-4cf8-b2a6-7091f1020334-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:38 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-237377bd-43b7-4f3b-ad63-a10613a28ec8 tempest-VolumesListTestJSON-2088181280 None] Acquiring lock "cinder-quobyte-c5141be7-8209-4cf8-b2a6-7091f1020334" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-76130726-b2c3-4c86-9213-a8948ae58e2f tempest-VolumesSnapshotTestJSON-1948679985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-76130726-b2c3-4c86-9213-a8948ae58e2f tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:38 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-76130726-b2c3-4c86-9213-a8948ae58e2f tempest-VolumesSnapshotTestJSON-1948679985 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:33:38 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-76130726-b2c3-4c86-9213-a8948ae58e2f tempest-VolumesSnapshotTestJSON-1948679985 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:33:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-76130726-b2c3-4c86-9213-a8948ae58e2f tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-76130726-b2c3-4c86-9213-a8948ae58e2f tempest-VolumesSnapshotTestJSON-1948679985 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:38 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-237377bd-43b7-4f3b-ad63-a10613a28ec8 tempest-VolumesListTestJSON-2088181280 None] Lock "cinder-quobyte-c5141be7-8209-4cf8-b2a6-7091f1020334" acquired by "delete_volume" :: waited 0.044s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:38 devstack sudo[102406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:33:38 devstack sudo[102406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:38 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[8eac8e3a-2be8-47b6-88d0-802a8d6ae219]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-237377bd-43b7-4f3b-ad63-a10613a28ec8 tempest-VolumesListTestJSON-2088181280 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c5141be7-8209-4cf8-b2a6-7091f1020334 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:38 devstack sudo[102408]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c5141be7-8209-4cf8-b2a6-7091f1020334 Nov 01 12:33:38 devstack sudo[102408]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:38 devstack sudo[102406]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-76130726-b2c3-4c86-9213-a8948ae58e2f tempest-VolumesSnapshotTestJSON-1948679985 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.354s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:38 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-76130726-b2c3-4c86-9213-a8948ae58e2f tempest-VolumesSnapshotTestJSON-1948679985 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:33:38 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-76130726-b2c3-4c86-9213-a8948ae58e2f tempest-VolumesSnapshotTestJSON-1948679985 None] Deleted volume successfully. Nov 01 12:33:38 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-76130726-b2c3-4c86-9213-a8948ae58e2f tempest-VolumesSnapshotTestJSON-1948679985 None] Lock "cinder-59df17bc-f404-460c-8aec-55196af2645d-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:38 devstack sudo[102408]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-237377bd-43b7-4f3b-ad63-a10613a28ec8 tempest-VolumesListTestJSON-2088181280 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c5141be7-8209-4cf8-b2a6-7091f1020334" returned: 0 in 0.432s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-237377bd-43b7-4f3b-ad63-a10613a28ec8 tempest-VolumesListTestJSON-2088181280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c5141be7-8209-4cf8-b2a6-7091f1020334 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:38 devstack sudo[102415]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c5141be7-8209-4cf8-b2a6-7091f1020334 Nov 01 12:33:38 devstack sudo[102415]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:39 devstack sudo[102415]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-237377bd-43b7-4f3b-ad63-a10613a28ec8 tempest-VolumesListTestJSON-2088181280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c5141be7-8209-4cf8-b2a6-7091f1020334" returned: 0 in 0.405s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:39 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-237377bd-43b7-4f3b-ad63-a10613a28ec8 tempest-VolumesListTestJSON-2088181280 None] Lock "cinder-quobyte-c5141be7-8209-4cf8-b2a6-7091f1020334" released by "delete_volume" :: held 0.901s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:39 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-237377bd-43b7-4f3b-ad63-a10613a28ec8 tempest-VolumesListTestJSON-2088181280 None] Created reservations ['ece19204-eedf-42bc-aba9-aef0edf4b0b4', '83b4c622-bef1-4ef1-8c85-1c1f937d0ed9', '342fe3d8-78a7-4555-887a-be73e05f76e5', '8ce78045-810d-465e-8482-56b639d5b5f9'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:33:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-237377bd-43b7-4f3b-ad63-a10613a28ec8 tempest-VolumesListTestJSON-2088181280 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-237377bd-43b7-4f3b-ad63-a10613a28ec8 tempest-VolumesListTestJSON-2088181280 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-237377bd-43b7-4f3b-ad63-a10613a28ec8 tempest-VolumesListTestJSON-2088181280 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:33:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-237377bd-43b7-4f3b-ad63-a10613a28ec8 tempest-VolumesListTestJSON-2088181280 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:33:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-237377bd-43b7-4f3b-ad63-a10613a28ec8 tempest-VolumesListTestJSON-2088181280 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-237377bd-43b7-4f3b-ad63-a10613a28ec8 tempest-VolumesListTestJSON-2088181280 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:39 devstack sudo[102418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:33:39 devstack sudo[102418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:39 devstack sudo[102418]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-237377bd-43b7-4f3b-ad63-a10613a28ec8 tempest-VolumesListTestJSON-2088181280 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.276s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:39 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-237377bd-43b7-4f3b-ad63-a10613a28ec8 tempest-VolumesListTestJSON-2088181280 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:33:39 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-237377bd-43b7-4f3b-ad63-a10613a28ec8 tempest-VolumesListTestJSON-2088181280 None] Deleted volume successfully. Nov 01 12:33:39 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-237377bd-43b7-4f3b-ad63-a10613a28ec8 tempest-VolumesListTestJSON-2088181280 None] Lock "cinder-c5141be7-8209-4cf8-b2a6-7091f1020334-delete_volume" released by "delete_volume" :: held 1.537s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:39 devstack cinder-volume[86574]: DEBUG oslo_service.periodic_task [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86574) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:33:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:33:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:33:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:39 devstack sudo[102421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:33:39 devstack sudo[102421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:40 devstack sudo[102421]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.302s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:40 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:33:40 devstack cinder-volume[86574]: DEBUG oslo_service.periodic_task [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running periodic task VolumeManager._thread_info {{(pid=86574) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:33:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] thread count: 28 {{(pid=86574) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 12:33:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] thread info: [<_MainThread(MainThread, started 131331184930944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86574) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 12:33:40 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:33:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] Flow 'volume_create_manager' (7b1b5574-cb76-4380-ab26-dc7dd3735e17) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:33:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a63f4b6f-b552-4d7a-a5c0-08a24e7129e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a63f4b6f-b552-4d7a-a5c0-08a24e7129e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestStampPattern-volume-1497148169',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed68edf5-798e-4d2a-9da3-429e604a3d0f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7434afa1297e4ee4bad1a159b695131e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=62344888-06a1-4b5f-a6b7-9757c7105a16,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:33:41Z,use_quota=True,user_id='65258bf8c21b48319350ce6c5b404a03',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c88166f4-6d0b-4b8b-a7ce-287ca9735916) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c88166f4-6d0b-4b8b-a7ce-287ca9735916) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (423352fb-f3e9-40f6-affc-f9471bd64316) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (423352fb-f3e9-40f6-affc-f9471bd64316) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'ed68edf5-798e-4d2a-9da3-429e604a3d0f', 'volume_name': 'volume-ed68edf5-798e-4d2a-9da3-429e604a3d0f', 'volume_size': 1, 'snapshot_id': '62344888-06a1-4b5f-a6b7-9757c7105a16'}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (599324f0-d670-454f-a4c6-8b6f03a927a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (599324f0-d670-454f-a4c6-8b6f03a927a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83b02b6f-eaa6-4173-a966-c27179eace52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:41 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] Volume ed68edf5-798e-4d2a-9da3-429e604a3d0f: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-ed68edf5-798e-4d2a-9da3-429e604a3d0f', 'volume_size': 1, 'snapshot_id': '62344888-06a1-4b5f-a6b7-9757c7105a16'} Nov 01 12:33:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:41 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] Acquiring lock "cinder-quobyte-62344888-06a1-4b5f-a6b7-9757c7105a16-ed68edf5-798e-4d2a-9da3-429e604a3d0f" by "_create_volume_from_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:41 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] Lock "cinder-quobyte-62344888-06a1-4b5f-a6b7-9757c7105a16-ed68edf5-798e-4d2a-9da3-429e604a3d0f" acquired by "_create_volume_from_snapshot" :: waited 0.026s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:41 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] Creating volume ed68edf5-798e-4d2a-9da3-429e604a3d0f from snapshot 62344888-06a1-4b5f-a6b7-9757c7105a16 {{(pid=86574) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 01 12:33:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:41 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:33:41 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:33:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:41 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:33:41 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] Acquiring lock "cinder-quobyte-ed68edf5-798e-4d2a-9da3-429e604a3d0f" by "_copy_volume_from_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:33:41 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] Lock "cinder-quobyte-ed68edf5-798e-4d2a-9da3-429e604a3d0f" acquired by "_copy_volume_from_snapshot" :: waited 0.027s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:33:41 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] snapshot: 62344888-06a1-4b5f-a6b7-9757c7105a16, volume: ed68edf5-798e-4d2a-9da3-429e604a3d0f, {{(pid=86574) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 01 12:33:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:41 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:33:41 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:33:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:41 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[943a76d7-6cd2-4b21-bba2-11a0b6437b91]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db.62344888-06a1-4b5f-a6b7-9757c7105a16 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:41 devstack sudo[102465]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db.62344888-06a1-4b5f-a6b7-9757c7105a16 Nov 01 12:33:41 devstack sudo[102465]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:41 devstack sudo[102465]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db.62344888-06a1-4b5f-a6b7-9757c7105a16" returned: 0 in 0.431s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:41 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3bee0113-3ffb-4a91-8376-422bef6e15db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:33:41 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[3cf1b452-213d-4da7-b284-e3b17dc8c99d]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:41 devstack sudo[102472]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db Nov 01 12:33:41 devstack sudo[102472]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:42 devstack sudo[102472]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db" returned: 0 in 0.480s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:42 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db {{(pid=86574) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 01 12:33:42 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] Creating direct copy from snapshot {{(pid=86574) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 01 12:33:42 devstack cinder-volume[86574]: DEBUG cinder.utils [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] Path /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed68edf5-798e-4d2a-9da3-429e604a3d0f not found in is_blk_device check {{(pid=86574) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 01 12:33:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed68edf5-798e-4d2a-9da3-429e604a3d0f {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:42 devstack sudo[102477]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed68edf5-798e-4d2a-9da3-429e604a3d0f Nov 01 12:33:42 devstack sudo[102477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:48 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-d3a02894-a132-4bcf-b205-4208f695d348 tempest-VolumesSnapshotListTestJSON-519112216 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:33:48 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d3a02894-a132-4bcf-b205-4208f695d348 tempest-VolumesSnapshotListTestJSON-519112216 None] Flow 'volume_create_manager' (784753c4-6fe9-4191-882a-fbe9a53802b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:33:48 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d3a02894-a132-4bcf-b205-4208f695d348 tempest-VolumesSnapshotListTestJSON-519112216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1a1d378-f0ed-4ac3-aa95-ebb7f2e64141) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:48 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d3a02894-a132-4bcf-b205-4208f695d348 tempest-VolumesSnapshotListTestJSON-519112216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c1a1d378-f0ed-4ac3-aa95-ebb7f2e64141) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-729957082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a5d2af4-9ee3-4449-a040-95aa72a89a82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b40553a1d62f40a8b201736aba42c99c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:33:48Z,use_quota=True,user_id='3c677860cdcb4757b4d887699b6fa229',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:48 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d3a02894-a132-4bcf-b205-4208f695d348 tempest-VolumesSnapshotListTestJSON-519112216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a0ad19-3991-4b75-b76a-0e940a7b1319) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:48 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d3a02894-a132-4bcf-b205-4208f695d348 tempest-VolumesSnapshotListTestJSON-519112216 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (40a0ad19-3991-4b75-b76a-0e940a7b1319) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:48 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d3a02894-a132-4bcf-b205-4208f695d348 tempest-VolumesSnapshotListTestJSON-519112216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ed79b68-e9b7-40dc-928c-ed766175c0f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:48 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d3a02894-a132-4bcf-b205-4208f695d348 tempest-VolumesSnapshotListTestJSON-519112216 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5ed79b68-e9b7-40dc-928c-ed766175c0f5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0a5d2af4-9ee3-4449-a040-95aa72a89a82', 'volume_name': 'volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:48 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d3a02894-a132-4bcf-b205-4208f695d348 tempest-VolumesSnapshotListTestJSON-519112216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cd89c73-9713-4c97-a908-4a3151d45fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:48 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d3a02894-a132-4bcf-b205-4208f695d348 tempest-VolumesSnapshotListTestJSON-519112216 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9cd89c73-9713-4c97-a908-4a3151d45fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:48 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d3a02894-a132-4bcf-b205-4208f695d348 tempest-VolumesSnapshotListTestJSON-519112216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (590c661c-baba-419b-938f-a2295bd8529f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:48 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-d3a02894-a132-4bcf-b205-4208f695d348 tempest-VolumesSnapshotListTestJSON-519112216 None] Volume 0a5d2af4-9ee3-4449-a040-95aa72a89a82: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82', 'volume_size': 1} Nov 01 12:33:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d3a02894-a132-4bcf-b205-4208f695d348 tempest-VolumesSnapshotListTestJSON-519112216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:52 devstack sudo[102477]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed68edf5-798e-4d2a-9da3-429e604a3d0f" returned: 0 in 9.839s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:52 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] Image conversion details: src /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db, size 1024.00 MB, duration 9.84 sec, destination /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed68edf5-798e-4d2a-9da3-429e604a3d0f {{(pid=86574) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 12:33:52 devstack cinder-volume[86574]: INFO cinder.image.image_utils [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] Converted 1024.00 MB image at 104.05 MB/s Nov 01 12:33:52 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed68edf5-798e-4d2a-9da3-429e604a3d0f is being set with open permissions: ugo+rw Nov 01 12:33:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed68edf5-798e-4d2a-9da3-429e604a3d0f {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:52 devstack sudo[102523]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed68edf5-798e-4d2a-9da3-429e604a3d0f Nov 01 12:33:52 devstack sudo[102523]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:52 devstack sudo[102523]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed68edf5-798e-4d2a-9da3-429e604a3d0f" returned: 0 in 0.367s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:52 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] Lock "cinder-quobyte-ed68edf5-798e-4d2a-9da3-429e604a3d0f" released by "_copy_volume_from_snapshot" :: held 11.305s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:52 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] Lock "cinder-quobyte-62344888-06a1-4b5f-a6b7-9757c7105a16-ed68edf5-798e-4d2a-9da3-429e604a3d0f" released by "_create_volume_from_snapshot" :: held 11.403s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:33:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 11.433s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d3a02894-a132-4bcf-b205-4208f695d348 tempest-VolumesSnapshotListTestJSON-519112216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.331s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:52 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d3a02894-a132-4bcf-b205-4208f695d348 tempest-VolumesSnapshotListTestJSON-519112216 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:33:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-729957082',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0a5d2af4-9ee3-4449-a040-95aa72a89a82,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b40553a1d62f40a8b201736aba42c99c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:33:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:33:48Z,use_quota=True,user_id='3c677860cdcb4757b4d887699b6fa229',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:33:52 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-d3a02894-a132-4bcf-b205-4208f695d348 tempest-VolumesSnapshotListTestJSON-519112216 None] Creating volume 0a5d2af4-9ee3-4449-a040-95aa72a89a82 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:33:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d3a02894-a132-4bcf-b205-4208f695d348 tempest-VolumesSnapshotListTestJSON-519112216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d3a02894-a132-4bcf-b205-4208f695d348 tempest-VolumesSnapshotListTestJSON-519112216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:52 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d3a02894-a132-4bcf-b205-4208f695d348 tempest-VolumesSnapshotListTestJSON-519112216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:33:52 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d3a02894-a132-4bcf-b205-4208f695d348 tempest-VolumesSnapshotListTestJSON-519112216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:33:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d3a02894-a132-4bcf-b205-4208f695d348 tempest-VolumesSnapshotListTestJSON-519112216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:52 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d3a02894-a132-4bcf-b205-4208f695d348 tempest-VolumesSnapshotListTestJSON-519112216 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:33:52 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-d3a02894-a132-4bcf-b205-4208f695d348 tempest-VolumesSnapshotListTestJSON-519112216 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:33:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d3a02894-a132-4bcf-b205-4208f695d348 tempest-VolumesSnapshotListTestJSON-519112216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:52 devstack sudo[102527]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82 1073741824 Nov 01 12:33:52 devstack sudo[102527]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (83b02b6f-eaa6-4173-a966-c27179eace52) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed68edf5-798e-4d2a-9da3-429e604a3d0f', 'volume_size': 1, 'snapshot_id': '62344888-06a1-4b5f-a6b7-9757c7105a16'}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d399755-fb2d-4bf4-bc7e-8cb5ac7d99b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:52 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] Volume volume-ed68edf5-798e-4d2a-9da3-429e604a3d0f (ed68edf5-798e-4d2a-9da3-429e604a3d0f): created successfully Nov 01 12:33:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d399755-fb2d-4bf4-bc7e-8cb5ac7d99b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] Flow 'volume_create_manager' (7b1b5574-cb76-4380-ab26-dc7dd3735e17) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:33:52 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-c33dd3de-79b5-48c7-87f9-389f71e18420 tempest-TestStampPattern-399521859 None] Created volume successfully. Nov 01 12:33:53 devstack sudo[102527]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d3a02894-a132-4bcf-b205-4208f695d348 tempest-VolumesSnapshotListTestJSON-519112216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82 1073741824" returned: 0 in 0.681s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d3a02894-a132-4bcf-b205-4208f695d348 tempest-VolumesSnapshotListTestJSON-519112216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:53 devstack sudo[102546]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82 Nov 01 12:33:53 devstack sudo[102546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:53 devstack sudo[102546]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d3a02894-a132-4bcf-b205-4208f695d348 tempest-VolumesSnapshotListTestJSON-519112216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82" returned: 0 in 0.405s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:53 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d3a02894-a132-4bcf-b205-4208f695d348 tempest-VolumesSnapshotListTestJSON-519112216 None] <== create_volume: return (1169ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:33:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d3a02894-a132-4bcf-b205-4208f695d348 tempest-VolumesSnapshotListTestJSON-519112216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.171s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d3a02894-a132-4bcf-b205-4208f695d348 tempest-VolumesSnapshotListTestJSON-519112216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (590c661c-baba-419b-938f-a2295bd8529f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d3a02894-a132-4bcf-b205-4208f695d348 tempest-VolumesSnapshotListTestJSON-519112216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70b5f0ec-b923-43c2-9939-e9766dfe954c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:33:53 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-d3a02894-a132-4bcf-b205-4208f695d348 tempest-VolumesSnapshotListTestJSON-519112216 None] Volume volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82 (0a5d2af4-9ee3-4449-a040-95aa72a89a82): created successfully Nov 01 12:33:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d3a02894-a132-4bcf-b205-4208f695d348 tempest-VolumesSnapshotListTestJSON-519112216 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (70b5f0ec-b923-43c2-9939-e9766dfe954c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:33:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d3a02894-a132-4bcf-b205-4208f695d348 tempest-VolumesSnapshotListTestJSON-519112216 None] Flow 'volume_create_manager' (784753c4-6fe9-4191-882a-fbe9a53802b3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:33:53 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-d3a02894-a132-4bcf-b205-4208f695d348 tempest-VolumesSnapshotListTestJSON-519112216 None] Created volume successfully. Nov 01 12:33:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-3aebdccf-4ecd-417e-971c-c17c48f4d0d8 tempest-VolumesSnapshotListTestJSON-519112216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-3aebdccf-4ecd-417e-971c-c17c48f4d0d8 tempest-VolumesSnapshotListTestJSON-519112216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:54 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-3aebdccf-4ecd-417e-971c-c17c48f4d0d8 tempest-VolumesSnapshotListTestJSON-519112216 None] Creating offline snapshot 1e31b32d-abf8-46e7-93fa-ea2e07611c1e of volume 0a5d2af4-9ee3-4449-a040-95aa72a89a82 {{(pid=86574) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:33:54 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[3930fb03-63ab-4435-841c-a049581d495a]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3aebdccf-4ecd-417e-971c-c17c48f4d0d8 tempest-VolumesSnapshotListTestJSON-519112216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:55 devstack sudo[102578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82 Nov 01 12:33:55 devstack sudo[102578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:55 devstack sudo[102578]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3aebdccf-4ecd-417e-971c-c17c48f4d0d8 tempest-VolumesSnapshotListTestJSON-519112216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82" returned: 0 in 0.461s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3aebdccf-4ecd-417e-971c-c17c48f4d0d8 tempest-VolumesSnapshotListTestJSON-519112216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.1e31b32d-abf8-46e7-93fa-ea2e07611c1e 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:55 devstack sudo[102583]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.1e31b32d-abf8-46e7-93fa-ea2e07611c1e 1G Nov 01 12:33:55 devstack sudo[102583]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:56 devstack sudo[102583]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3aebdccf-4ecd-417e-971c-c17c48f4d0d8 tempest-VolumesSnapshotListTestJSON-519112216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.1e31b32d-abf8-46e7-93fa-ea2e07611c1e 1G" returned: 0 in 0.653s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3aebdccf-4ecd-417e-971c-c17c48f4d0d8 tempest-VolumesSnapshotListTestJSON-519112216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.1e31b32d-abf8-46e7-93fa-ea2e07611c1e {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:56 devstack sudo[102588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.1e31b32d-abf8-46e7-93fa-ea2e07611c1e Nov 01 12:33:56 devstack sudo[102588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:56 devstack sudo[102588]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3aebdccf-4ecd-417e-971c-c17c48f4d0d8 tempest-VolumesSnapshotListTestJSON-519112216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.1e31b32d-abf8-46e7-93fa-ea2e07611c1e" returned: 0 in 0.443s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:56 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-3aebdccf-4ecd-417e-971c-c17c48f4d0d8 tempest-VolumesSnapshotListTestJSON-519112216 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.1e31b32d-abf8-46e7-93fa-ea2e07611c1e is being set with open permissions: ugo+rw Nov 01 12:33:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3aebdccf-4ecd-417e-971c-c17c48f4d0d8 tempest-VolumesSnapshotListTestJSON-519112216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.1e31b32d-abf8-46e7-93fa-ea2e07611c1e {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:56 devstack sudo[102593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.1e31b32d-abf8-46e7-93fa-ea2e07611c1e Nov 01 12:33:56 devstack sudo[102593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:56 devstack sudo[102593]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3aebdccf-4ecd-417e-971c-c17c48f4d0d8 tempest-VolumesSnapshotListTestJSON-519112216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.1e31b32d-abf8-46e7-93fa-ea2e07611c1e" returned: 0 in 0.356s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3aebdccf-4ecd-417e-971c-c17c48f4d0d8 tempest-VolumesSnapshotListTestJSON-519112216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:56 devstack sudo[102596]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.info Nov 01 12:33:56 devstack sudo[102596]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:57 devstack sudo[102596]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3aebdccf-4ecd-417e-971c-c17c48f4d0d8 tempest-VolumesSnapshotListTestJSON-519112216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.info" returned: 0 in 0.369s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:57 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-3aebdccf-4ecd-417e-971c-c17c48f4d0d8 tempest-VolumesSnapshotListTestJSON-519112216 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.info is being set with open permissions: ugo+rw Nov 01 12:33:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3aebdccf-4ecd-417e-971c-c17c48f4d0d8 tempest-VolumesSnapshotListTestJSON-519112216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:57 devstack sudo[102599]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.info Nov 01 12:33:57 devstack sudo[102599]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:57 devstack sudo[102599]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3aebdccf-4ecd-417e-971c-c17c48f4d0d8 tempest-VolumesSnapshotListTestJSON-519112216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.info" returned: 0 in 0.315s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-3aebdccf-4ecd-417e-971c-c17c48f4d0d8 tempest-VolumesSnapshotListTestJSON-519112216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.765s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:33:57 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-3aebdccf-4ecd-417e-971c-c17c48f4d0d8 tempest-VolumesSnapshotListTestJSON-519112216 None] Create snapshot completed successfully Nov 01 12:33:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-665228b5-5e55-4e2d-a287-287cf2c5d602 tempest-VolumesSnapshotListTestJSON-519112216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:33:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-665228b5-5e55-4e2d-a287-287cf2c5d602 tempest-VolumesSnapshotListTestJSON-519112216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:33:58 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-665228b5-5e55-4e2d-a287-287cf2c5d602 tempest-VolumesSnapshotListTestJSON-519112216 None] Creating offline snapshot 013ae234-f2c1-4d20-adcd-4082a8eafe09 of volume 0a5d2af4-9ee3-4449-a040-95aa72a89a82 {{(pid=86574) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:33:58 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab9a8a33-5d88-42b2-b964-bab7fc00d690]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:33:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-665228b5-5e55-4e2d-a287-287cf2c5d602 tempest-VolumesSnapshotListTestJSON-519112216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.1e31b32d-abf8-46e7-93fa-ea2e07611c1e {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:58 devstack sudo[102603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.1e31b32d-abf8-46e7-93fa-ea2e07611c1e Nov 01 12:33:58 devstack sudo[102603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:59 devstack sudo[102603]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-665228b5-5e55-4e2d-a287-287cf2c5d602 tempest-VolumesSnapshotListTestJSON-519112216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.1e31b32d-abf8-46e7-93fa-ea2e07611c1e" returned: 0 in 0.600s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:59 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-665228b5-5e55-4e2d-a287-287cf2c5d602 tempest-VolumesSnapshotListTestJSON-519112216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:33:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-665228b5-5e55-4e2d-a287-287cf2c5d602 tempest-VolumesSnapshotListTestJSON-519112216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.1e31b32d-abf8-46e7-93fa-ea2e07611c1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.013ae234-f2c1-4d20-adcd-4082a8eafe09 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:59 devstack sudo[102609]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.1e31b32d-abf8-46e7-93fa-ea2e07611c1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.013ae234-f2c1-4d20-adcd-4082a8eafe09 1G Nov 01 12:33:59 devstack sudo[102609]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:33:59 devstack sudo[102609]: pam_unix(sudo:session): session closed for user root Nov 01 12:33:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-665228b5-5e55-4e2d-a287-287cf2c5d602 tempest-VolumesSnapshotListTestJSON-519112216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.1e31b32d-abf8-46e7-93fa-ea2e07611c1e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.013ae234-f2c1-4d20-adcd-4082a8eafe09 1G" returned: 0 in 0.595s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:33:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-665228b5-5e55-4e2d-a287-287cf2c5d602 tempest-VolumesSnapshotListTestJSON-519112216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.1e31b32d-abf8-46e7-93fa-ea2e07611c1e -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.013ae234-f2c1-4d20-adcd-4082a8eafe09 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:33:59 devstack sudo[102615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.1e31b32d-abf8-46e7-93fa-ea2e07611c1e -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.013ae234-f2c1-4d20-adcd-4082a8eafe09 Nov 01 12:33:59 devstack sudo[102615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:00 devstack sudo[102615]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-665228b5-5e55-4e2d-a287-287cf2c5d602 tempest-VolumesSnapshotListTestJSON-519112216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.1e31b32d-abf8-46e7-93fa-ea2e07611c1e -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.013ae234-f2c1-4d20-adcd-4082a8eafe09" returned: 0 in 0.356s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:00 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-665228b5-5e55-4e2d-a287-287cf2c5d602 tempest-VolumesSnapshotListTestJSON-519112216 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.013ae234-f2c1-4d20-adcd-4082a8eafe09 is being set with open permissions: ugo+rw Nov 01 12:34:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-665228b5-5e55-4e2d-a287-287cf2c5d602 tempest-VolumesSnapshotListTestJSON-519112216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.013ae234-f2c1-4d20-adcd-4082a8eafe09 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:00 devstack sudo[102620]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.013ae234-f2c1-4d20-adcd-4082a8eafe09 Nov 01 12:34:00 devstack sudo[102620]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:00 devstack sudo[102620]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-665228b5-5e55-4e2d-a287-287cf2c5d602 tempest-VolumesSnapshotListTestJSON-519112216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.013ae234-f2c1-4d20-adcd-4082a8eafe09" returned: 0 in 0.290s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:00 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:SELECT=107,cinder:UPDATE=140,cinder:INSERT=38,cinder:DELETE=17 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:34:00 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:SELECT=131,cinder:UPDATE=144,cinder:DELETE=8,cinder:INSERT=32 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:34:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-665228b5-5e55-4e2d-a287-287cf2c5d602 tempest-VolumesSnapshotListTestJSON-519112216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.030s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:34:00 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-665228b5-5e55-4e2d-a287-287cf2c5d602 tempest-VolumesSnapshotListTestJSON-519112216 None] Create snapshot completed successfully Nov 01 12:34:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-1cba3401-2d33-4974-80a3-d20ff41b967e tempest-VolumesSnapshotListTestJSON-519112216 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:34:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-1cba3401-2d33-4974-80a3-d20ff41b967e tempest-VolumesSnapshotListTestJSON-519112216 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:34:00 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-1cba3401-2d33-4974-80a3-d20ff41b967e tempest-VolumesSnapshotListTestJSON-519112216 None] Creating offline snapshot d0f7afae-f290-45f8-bcc1-2617126df5d5 of volume 0a5d2af4-9ee3-4449-a040-95aa72a89a82 {{(pid=86574) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:34:01 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[95ed7d13-bcde-4ec6-9208-e321b9e8157f]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:34:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1cba3401-2d33-4974-80a3-d20ff41b967e tempest-VolumesSnapshotListTestJSON-519112216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.013ae234-f2c1-4d20-adcd-4082a8eafe09 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:01 devstack sudo[102623]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.013ae234-f2c1-4d20-adcd-4082a8eafe09 Nov 01 12:34:01 devstack sudo[102623]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:01 devstack sudo[102623]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1cba3401-2d33-4974-80a3-d20ff41b967e tempest-VolumesSnapshotListTestJSON-519112216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.013ae234-f2c1-4d20-adcd-4082a8eafe09" returned: 0 in 0.503s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:01 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-1cba3401-2d33-4974-80a3-d20ff41b967e tempest-VolumesSnapshotListTestJSON-519112216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:34:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1cba3401-2d33-4974-80a3-d20ff41b967e tempest-VolumesSnapshotListTestJSON-519112216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.013ae234-f2c1-4d20-adcd-4082a8eafe09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.d0f7afae-f290-45f8-bcc1-2617126df5d5 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:01 devstack sudo[102629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.013ae234-f2c1-4d20-adcd-4082a8eafe09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.d0f7afae-f290-45f8-bcc1-2617126df5d5 1G Nov 01 12:34:01 devstack sudo[102629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:02 devstack sudo[102629]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1cba3401-2d33-4974-80a3-d20ff41b967e tempest-VolumesSnapshotListTestJSON-519112216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.013ae234-f2c1-4d20-adcd-4082a8eafe09,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.d0f7afae-f290-45f8-bcc1-2617126df5d5 1G" returned: 0 in 0.539s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1cba3401-2d33-4974-80a3-d20ff41b967e tempest-VolumesSnapshotListTestJSON-519112216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.013ae234-f2c1-4d20-adcd-4082a8eafe09 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.d0f7afae-f290-45f8-bcc1-2617126df5d5 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:02 devstack sudo[102636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.013ae234-f2c1-4d20-adcd-4082a8eafe09 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.d0f7afae-f290-45f8-bcc1-2617126df5d5 Nov 01 12:34:02 devstack sudo[102636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:02 devstack sudo[102636]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1cba3401-2d33-4974-80a3-d20ff41b967e tempest-VolumesSnapshotListTestJSON-519112216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.013ae234-f2c1-4d20-adcd-4082a8eafe09 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.d0f7afae-f290-45f8-bcc1-2617126df5d5" returned: 0 in 0.297s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:02 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-1cba3401-2d33-4974-80a3-d20ff41b967e tempest-VolumesSnapshotListTestJSON-519112216 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.d0f7afae-f290-45f8-bcc1-2617126df5d5 is being set with open permissions: ugo+rw Nov 01 12:34:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1cba3401-2d33-4974-80a3-d20ff41b967e tempest-VolumesSnapshotListTestJSON-519112216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.d0f7afae-f290-45f8-bcc1-2617126df5d5 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:02 devstack sudo[102642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.d0f7afae-f290-45f8-bcc1-2617126df5d5 Nov 01 12:34:02 devstack sudo[102642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:02 devstack sudo[102642]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1cba3401-2d33-4974-80a3-d20ff41b967e tempest-VolumesSnapshotListTestJSON-519112216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.d0f7afae-f290-45f8-bcc1-2617126df5d5" returned: 0 in 0.291s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-1cba3401-2d33-4974-80a3-d20ff41b967e tempest-VolumesSnapshotListTestJSON-519112216 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.768s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:34:02 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-1cba3401-2d33-4974-80a3-d20ff41b967e tempest-VolumesSnapshotListTestJSON-519112216 None] Create snapshot completed successfully Nov 01 12:34:04 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-09fb4d26-3362-49f8-bca7-a1e3007232df tempest-VolumesSnapshotListTestJSON-519112216 None] Acquiring lock "cinder-d0f7afae-f290-45f8-bcc1-2617126df5d5-delete_snapshot" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:34:04 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-09fb4d26-3362-49f8-bca7-a1e3007232df tempest-VolumesSnapshotListTestJSON-519112216 None] Lock "cinder-d0f7afae-f290-45f8-bcc1-2617126df5d5-delete_snapshot" acquired by "delete_snapshot" :: waited 0.034s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:34:04 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-09fb4d26-3362-49f8-bca7-a1e3007232df tempest-VolumesSnapshotListTestJSON-519112216 None] Acquiring lock "cinder-quobyte-0a5d2af4-9ee3-4449-a040-95aa72a89a82" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:34:04 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-09fb4d26-3362-49f8-bca7-a1e3007232df tempest-VolumesSnapshotListTestJSON-519112216 None] Lock "cinder-quobyte-0a5d2af4-9ee3-4449-a040-95aa72a89a82" acquired by "delete_snapshot" :: waited 0.024s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:34:04 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-09fb4d26-3362-49f8-bca7-a1e3007232df tempest-VolumesSnapshotListTestJSON-519112216 None] Acquiring lock "cinder-quobyte-d0f7afae-f290-45f8-bcc1-2617126df5d5" by "_delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:34:04 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-09fb4d26-3362-49f8-bca7-a1e3007232df tempest-VolumesSnapshotListTestJSON-519112216 None] Lock "cinder-quobyte-d0f7afae-f290-45f8-bcc1-2617126df5d5" acquired by "_delete_snapshot" :: waited 0.027s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:34:04 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-09fb4d26-3362-49f8-bca7-a1e3007232df tempest-VolumesSnapshotListTestJSON-519112216 None] Deleting offline snapshot d0f7afae-f290-45f8-bcc1-2617126df5d5 of volume 0a5d2af4-9ee3-4449-a040-95aa72a89a82 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:34:04 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-09fb4d26-3362-49f8-bca7-a1e3007232df tempest-VolumesSnapshotListTestJSON-519112216 None] snapshot_file for this snap is: volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.d0f7afae-f290-45f8-bcc1-2617126df5d5 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:34:04 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[d5017fb2-990d-4294-aa3e-655cc7dffeac]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:34:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-09fb4d26-3362-49f8-bca7-a1e3007232df tempest-VolumesSnapshotListTestJSON-519112216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.d0f7afae-f290-45f8-bcc1-2617126df5d5 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:04 devstack sudo[102646]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.d0f7afae-f290-45f8-bcc1-2617126df5d5 Nov 01 12:34:04 devstack sudo[102646]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:05 devstack sudo[102646]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-09fb4d26-3362-49f8-bca7-a1e3007232df tempest-VolumesSnapshotListTestJSON-519112216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.d0f7afae-f290-45f8-bcc1-2617126df5d5" returned: 0 in 0.635s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:05 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-09fb4d26-3362-49f8-bca7-a1e3007232df tempest-VolumesSnapshotListTestJSON-519112216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:34:05 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[160df48a-6c1e-4ca9-90e0-ac98951bb6ff]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:34:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-09fb4d26-3362-49f8-bca7-a1e3007232df tempest-VolumesSnapshotListTestJSON-519112216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.013ae234-f2c1-4d20-adcd-4082a8eafe09 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:05 devstack sudo[102651]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.013ae234-f2c1-4d20-adcd-4082a8eafe09 Nov 01 12:34:05 devstack sudo[102651]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:05 devstack sudo[102651]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-09fb4d26-3362-49f8-bca7-a1e3007232df tempest-VolumesSnapshotListTestJSON-519112216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.013ae234-f2c1-4d20-adcd-4082a8eafe09" returned: 0 in 0.417s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:05 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-09fb4d26-3362-49f8-bca7-a1e3007232df tempest-VolumesSnapshotListTestJSON-519112216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:34:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-09fb4d26-3362-49f8-bca7-a1e3007232df tempest-VolumesSnapshotListTestJSON-519112216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.d0f7afae-f290-45f8-bcc1-2617126df5d5 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:05 devstack sudo[102656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.d0f7afae-f290-45f8-bcc1-2617126df5d5 Nov 01 12:34:05 devstack sudo[102656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:06 devstack sudo[102656]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-09fb4d26-3362-49f8-bca7-a1e3007232df tempest-VolumesSnapshotListTestJSON-519112216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.d0f7afae-f290-45f8-bcc1-2617126df5d5" returned: 0 in 0.498s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-09fb4d26-3362-49f8-bca7-a1e3007232df tempest-VolumesSnapshotListTestJSON-519112216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.d0f7afae-f290-45f8-bcc1-2617126df5d5 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:06 devstack sudo[102662]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.d0f7afae-f290-45f8-bcc1-2617126df5d5 Nov 01 12:34:06 devstack sudo[102662]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:06 devstack sudo[102662]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-09fb4d26-3362-49f8-bca7-a1e3007232df tempest-VolumesSnapshotListTestJSON-519112216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.d0f7afae-f290-45f8-bcc1-2617126df5d5" returned: 0 in 0.269s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:06 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-09fb4d26-3362-49f8-bca7-a1e3007232df tempest-VolumesSnapshotListTestJSON-519112216 None] Lock "cinder-quobyte-d0f7afae-f290-45f8-bcc1-2617126df5d5" released by "_delete_snapshot" :: held 1.960s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:34:06 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-09fb4d26-3362-49f8-bca7-a1e3007232df tempest-VolumesSnapshotListTestJSON-519112216 None] Lock "cinder-quobyte-0a5d2af4-9ee3-4449-a040-95aa72a89a82" released by "delete_snapshot" :: held 2.004s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:34:06 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-09fb4d26-3362-49f8-bca7-a1e3007232df tempest-VolumesSnapshotListTestJSON-519112216 None] Created reservations ['f646f42e-b80f-483c-b9ae-6df082d78cd0', 'ee18dabe-004a-4cc7-8b39-21496e5e5955', 'b7cca118-634b-4297-aed0-81cdd9eca742', '036e502a-9c2d-4b4d-850e-7968f284653c'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:34:06 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-09fb4d26-3362-49f8-bca7-a1e3007232df tempest-VolumesSnapshotListTestJSON-519112216 None] Delete snapshot completed successfully. Nov 01 12:34:06 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-09fb4d26-3362-49f8-bca7-a1e3007232df tempest-VolumesSnapshotListTestJSON-519112216 None] Lock "cinder-d0f7afae-f290-45f8-bcc1-2617126df5d5-delete_snapshot" released by "delete_snapshot" :: held 2.194s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:34:07 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6d082aa9-fab2-443d-9713-d0c0cc7ba2b0 tempest-VolumesSnapshotListTestJSON-519112216 None] Acquiring lock "cinder-013ae234-f2c1-4d20-adcd-4082a8eafe09-delete_snapshot" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:34:07 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6d082aa9-fab2-443d-9713-d0c0cc7ba2b0 tempest-VolumesSnapshotListTestJSON-519112216 None] Lock "cinder-013ae234-f2c1-4d20-adcd-4082a8eafe09-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:34:07 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6d082aa9-fab2-443d-9713-d0c0cc7ba2b0 tempest-VolumesSnapshotListTestJSON-519112216 None] Acquiring lock "cinder-quobyte-0a5d2af4-9ee3-4449-a040-95aa72a89a82" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:34:07 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6d082aa9-fab2-443d-9713-d0c0cc7ba2b0 tempest-VolumesSnapshotListTestJSON-519112216 None] Lock "cinder-quobyte-0a5d2af4-9ee3-4449-a040-95aa72a89a82" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:34:07 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6d082aa9-fab2-443d-9713-d0c0cc7ba2b0 tempest-VolumesSnapshotListTestJSON-519112216 None] Acquiring lock "cinder-quobyte-013ae234-f2c1-4d20-adcd-4082a8eafe09" by "_delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:34:07 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6d082aa9-fab2-443d-9713-d0c0cc7ba2b0 tempest-VolumesSnapshotListTestJSON-519112216 None] Lock "cinder-quobyte-013ae234-f2c1-4d20-adcd-4082a8eafe09" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:34:07 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-6d082aa9-fab2-443d-9713-d0c0cc7ba2b0 tempest-VolumesSnapshotListTestJSON-519112216 None] Deleting offline snapshot 013ae234-f2c1-4d20-adcd-4082a8eafe09 of volume 0a5d2af4-9ee3-4449-a040-95aa72a89a82 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:34:07 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-6d082aa9-fab2-443d-9713-d0c0cc7ba2b0 tempest-VolumesSnapshotListTestJSON-519112216 None] snapshot_file for this snap is: volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.013ae234-f2c1-4d20-adcd-4082a8eafe09 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:34:07 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[c8b60788-7cbc-479d-8053-025fb866394b]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:34:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6d082aa9-fab2-443d-9713-d0c0cc7ba2b0 tempest-VolumesSnapshotListTestJSON-519112216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.013ae234-f2c1-4d20-adcd-4082a8eafe09 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:07 devstack sudo[102675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.013ae234-f2c1-4d20-adcd-4082a8eafe09 Nov 01 12:34:07 devstack sudo[102675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:08 devstack sudo[102675]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6d082aa9-fab2-443d-9713-d0c0cc7ba2b0 tempest-VolumesSnapshotListTestJSON-519112216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.013ae234-f2c1-4d20-adcd-4082a8eafe09" returned: 0 in 0.389s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:08 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-6d082aa9-fab2-443d-9713-d0c0cc7ba2b0 tempest-VolumesSnapshotListTestJSON-519112216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:34:08 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7aaeac8-934a-49cb-a0f7-79611934dbf5]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:34:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6d082aa9-fab2-443d-9713-d0c0cc7ba2b0 tempest-VolumesSnapshotListTestJSON-519112216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.1e31b32d-abf8-46e7-93fa-ea2e07611c1e {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:08 devstack sudo[102680]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.1e31b32d-abf8-46e7-93fa-ea2e07611c1e Nov 01 12:34:08 devstack sudo[102680]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:08 devstack sudo[102680]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6d082aa9-fab2-443d-9713-d0c0cc7ba2b0 tempest-VolumesSnapshotListTestJSON-519112216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.1e31b32d-abf8-46e7-93fa-ea2e07611c1e" returned: 0 in 0.379s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:08 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-6d082aa9-fab2-443d-9713-d0c0cc7ba2b0 tempest-VolumesSnapshotListTestJSON-519112216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:34:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6d082aa9-fab2-443d-9713-d0c0cc7ba2b0 tempest-VolumesSnapshotListTestJSON-519112216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.013ae234-f2c1-4d20-adcd-4082a8eafe09 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:08 devstack sudo[102686]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.013ae234-f2c1-4d20-adcd-4082a8eafe09 Nov 01 12:34:08 devstack sudo[102686]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:09 devstack sudo[102686]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6d082aa9-fab2-443d-9713-d0c0cc7ba2b0 tempest-VolumesSnapshotListTestJSON-519112216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.013ae234-f2c1-4d20-adcd-4082a8eafe09" returned: 0 in 0.390s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6d082aa9-fab2-443d-9713-d0c0cc7ba2b0 tempest-VolumesSnapshotListTestJSON-519112216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.013ae234-f2c1-4d20-adcd-4082a8eafe09 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:09 devstack sudo[102692]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.013ae234-f2c1-4d20-adcd-4082a8eafe09 Nov 01 12:34:09 devstack sudo[102692]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:09 devstack sudo[102692]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6d082aa9-fab2-443d-9713-d0c0cc7ba2b0 tempest-VolumesSnapshotListTestJSON-519112216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.013ae234-f2c1-4d20-adcd-4082a8eafe09" returned: 0 in 0.300s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:09 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6d082aa9-fab2-443d-9713-d0c0cc7ba2b0 tempest-VolumesSnapshotListTestJSON-519112216 None] Lock "cinder-quobyte-013ae234-f2c1-4d20-adcd-4082a8eafe09" released by "_delete_snapshot" :: held 1.603s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:34:09 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6d082aa9-fab2-443d-9713-d0c0cc7ba2b0 tempest-VolumesSnapshotListTestJSON-519112216 None] Lock "cinder-quobyte-0a5d2af4-9ee3-4449-a040-95aa72a89a82" released by "delete_snapshot" :: held 1.634s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:34:09 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-6d082aa9-fab2-443d-9713-d0c0cc7ba2b0 tempest-VolumesSnapshotListTestJSON-519112216 None] Created reservations ['b01e37ae-d76e-4749-bdc6-4250ca984395', '31789151-b4ca-4cc9-b528-b627a4f0f0cc', '4593b661-eea8-4ad0-ac6b-f39147144887', '497fac43-2d99-47b2-bc6d-50008d0db050'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:34:09 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-6d082aa9-fab2-443d-9713-d0c0cc7ba2b0 tempest-VolumesSnapshotListTestJSON-519112216 None] Delete snapshot completed successfully. Nov 01 12:34:09 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6d082aa9-fab2-443d-9713-d0c0cc7ba2b0 tempest-VolumesSnapshotListTestJSON-519112216 None] Lock "cinder-013ae234-f2c1-4d20-adcd-4082a8eafe09-delete_snapshot" released by "delete_snapshot" :: held 1.785s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:34:09 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0a6132f4-b084-473a-a666-af4ac33f01d0 tempest-VolumesSnapshotListTestJSON-519112216 None] Acquiring lock "cinder-1e31b32d-abf8-46e7-93fa-ea2e07611c1e-delete_snapshot" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:34:09 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0a6132f4-b084-473a-a666-af4ac33f01d0 tempest-VolumesSnapshotListTestJSON-519112216 None] Lock "cinder-1e31b32d-abf8-46e7-93fa-ea2e07611c1e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:34:09 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0a6132f4-b084-473a-a666-af4ac33f01d0 tempest-VolumesSnapshotListTestJSON-519112216 None] Acquiring lock "cinder-quobyte-0a5d2af4-9ee3-4449-a040-95aa72a89a82" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:34:09 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0a6132f4-b084-473a-a666-af4ac33f01d0 tempest-VolumesSnapshotListTestJSON-519112216 None] Lock "cinder-quobyte-0a5d2af4-9ee3-4449-a040-95aa72a89a82" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:34:09 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0a6132f4-b084-473a-a666-af4ac33f01d0 tempest-VolumesSnapshotListTestJSON-519112216 None] Acquiring lock "cinder-quobyte-1e31b32d-abf8-46e7-93fa-ea2e07611c1e" by "_delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:34:09 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0a6132f4-b084-473a-a666-af4ac33f01d0 tempest-VolumesSnapshotListTestJSON-519112216 None] Lock "cinder-quobyte-1e31b32d-abf8-46e7-93fa-ea2e07611c1e" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:34:09 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-0a6132f4-b084-473a-a666-af4ac33f01d0 tempest-VolumesSnapshotListTestJSON-519112216 None] Deleting offline snapshot 1e31b32d-abf8-46e7-93fa-ea2e07611c1e of volume 0a5d2af4-9ee3-4449-a040-95aa72a89a82 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:34:09 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-0a6132f4-b084-473a-a666-af4ac33f01d0 tempest-VolumesSnapshotListTestJSON-519112216 None] snapshot_file for this snap is: volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.1e31b32d-abf8-46e7-93fa-ea2e07611c1e {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:34:09 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[3e9c8eec-894c-4ce3-bddf-ed00e4ab6453]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:34:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0a6132f4-b084-473a-a666-af4ac33f01d0 tempest-VolumesSnapshotListTestJSON-519112216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.1e31b32d-abf8-46e7-93fa-ea2e07611c1e {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:10 devstack sudo[102695]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.1e31b32d-abf8-46e7-93fa-ea2e07611c1e Nov 01 12:34:10 devstack sudo[102695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:10 devstack sudo[102695]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0a6132f4-b084-473a-a666-af4ac33f01d0 tempest-VolumesSnapshotListTestJSON-519112216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.1e31b32d-abf8-46e7-93fa-ea2e07611c1e" returned: 0 in 0.370s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:10 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-0a6132f4-b084-473a-a666-af4ac33f01d0 tempest-VolumesSnapshotListTestJSON-519112216 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:34:10 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a6e765e-50ae-4a35-9279-76cbcd1ec5e3]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:34:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0a6132f4-b084-473a-a666-af4ac33f01d0 tempest-VolumesSnapshotListTestJSON-519112216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:10 devstack sudo[102700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82 Nov 01 12:34:10 devstack sudo[102700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:10 devstack sudo[102700]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0a6132f4-b084-473a-a666-af4ac33f01d0 tempest-VolumesSnapshotListTestJSON-519112216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82" returned: 0 in 0.461s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0a6132f4-b084-473a-a666-af4ac33f01d0 tempest-VolumesSnapshotListTestJSON-519112216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.1e31b32d-abf8-46e7-93fa-ea2e07611c1e {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:10 devstack sudo[102705]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.1e31b32d-abf8-46e7-93fa-ea2e07611c1e Nov 01 12:34:10 devstack sudo[102705]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:11 devstack sudo[102705]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0a6132f4-b084-473a-a666-af4ac33f01d0 tempest-VolumesSnapshotListTestJSON-519112216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.1e31b32d-abf8-46e7-93fa-ea2e07611c1e" returned: 0 in 0.387s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0a6132f4-b084-473a-a666-af4ac33f01d0 tempest-VolumesSnapshotListTestJSON-519112216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.1e31b32d-abf8-46e7-93fa-ea2e07611c1e {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:11 devstack sudo[102710]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.1e31b32d-abf8-46e7-93fa-ea2e07611c1e Nov 01 12:34:11 devstack sudo[102710]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:11 devstack sudo[102710]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0a6132f4-b084-473a-a666-af4ac33f01d0 tempest-VolumesSnapshotListTestJSON-519112216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82.1e31b32d-abf8-46e7-93fa-ea2e07611c1e" returned: 0 in 0.267s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:11 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0a6132f4-b084-473a-a666-af4ac33f01d0 tempest-VolumesSnapshotListTestJSON-519112216 None] Lock "cinder-quobyte-1e31b32d-abf8-46e7-93fa-ea2e07611c1e" released by "_delete_snapshot" :: held 1.616s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:34:11 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0a6132f4-b084-473a-a666-af4ac33f01d0 tempest-VolumesSnapshotListTestJSON-519112216 None] Lock "cinder-quobyte-0a5d2af4-9ee3-4449-a040-95aa72a89a82" released by "delete_snapshot" :: held 1.643s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:34:11 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-0a6132f4-b084-473a-a666-af4ac33f01d0 tempest-VolumesSnapshotListTestJSON-519112216 None] Created reservations ['96c14a81-fd97-435c-a734-7b875a03d323', '724b30df-3631-4313-8e9a-6be488bc719e', 'de4248d0-63d3-419d-a2c3-74c840b0a77b', 'cdfaec43-1a50-4550-99a1-895ced663760'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:34:11 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-0a6132f4-b084-473a-a666-af4ac33f01d0 tempest-VolumesSnapshotListTestJSON-519112216 None] Delete snapshot completed successfully. Nov 01 12:34:11 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0a6132f4-b084-473a-a666-af4ac33f01d0 tempest-VolumesSnapshotListTestJSON-519112216 None] Lock "cinder-1e31b32d-abf8-46e7-93fa-ea2e07611c1e-delete_snapshot" released by "delete_snapshot" :: held 1.801s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:34:12 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-abff35e4-e2ba-4abd-92b2-c7e0ac216881 tempest-VolumesSnapshotListTestJSON-519112216 None] Acquiring lock "cinder-0a5d2af4-9ee3-4449-a040-95aa72a89a82-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:34:12 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-abff35e4-e2ba-4abd-92b2-c7e0ac216881 tempest-VolumesSnapshotListTestJSON-519112216 None] Lock "cinder-0a5d2af4-9ee3-4449-a040-95aa72a89a82-delete_volume" acquired by "delete_volume" :: waited 0.043s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:34:12 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-abff35e4-e2ba-4abd-92b2-c7e0ac216881 tempest-VolumesSnapshotListTestJSON-519112216 None] Acquiring lock "cinder-quobyte-0a5d2af4-9ee3-4449-a040-95aa72a89a82" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:34:12 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-abff35e4-e2ba-4abd-92b2-c7e0ac216881 tempest-VolumesSnapshotListTestJSON-519112216 None] Lock "cinder-quobyte-0a5d2af4-9ee3-4449-a040-95aa72a89a82" acquired by "delete_volume" :: waited 0.020s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:34:12 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[df4845e8-4bd9-409b-bbc8-dfd52af9ab04]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:34:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-abff35e4-e2ba-4abd-92b2-c7e0ac216881 tempest-VolumesSnapshotListTestJSON-519112216 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:12 devstack sudo[102713]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82 Nov 01 12:34:12 devstack sudo[102713]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:12 devstack sudo[102713]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-abff35e4-e2ba-4abd-92b2-c7e0ac216881 tempest-VolumesSnapshotListTestJSON-519112216 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82" returned: 0 in 0.425s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-abff35e4-e2ba-4abd-92b2-c7e0ac216881 tempest-VolumesSnapshotListTestJSON-519112216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:12 devstack sudo[102718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82 Nov 01 12:34:12 devstack sudo[102718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:13 devstack sudo[102718]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-abff35e4-e2ba-4abd-92b2-c7e0ac216881 tempest-VolumesSnapshotListTestJSON-519112216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0a5d2af4-9ee3-4449-a040-95aa72a89a82" returned: 0 in 0.273s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:13 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-abff35e4-e2ba-4abd-92b2-c7e0ac216881 tempest-VolumesSnapshotListTestJSON-519112216 None] Lock "cinder-quobyte-0a5d2af4-9ee3-4449-a040-95aa72a89a82" released by "delete_volume" :: held 0.790s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:34:13 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-abff35e4-e2ba-4abd-92b2-c7e0ac216881 tempest-VolumesSnapshotListTestJSON-519112216 None] Created reservations ['25a7e068-6433-4851-8335-a59d130ca270', '9bb9032f-2aea-4277-b195-8f55be9710f7', 'e2b12ad8-59d9-4a7d-be39-5372ae7353ac', 'b19736f8-9c23-4e45-a050-92941f374ab6'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:34:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-abff35e4-e2ba-4abd-92b2-c7e0ac216881 tempest-VolumesSnapshotListTestJSON-519112216 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:34:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-abff35e4-e2ba-4abd-92b2-c7e0ac216881 tempest-VolumesSnapshotListTestJSON-519112216 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:34:13 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-abff35e4-e2ba-4abd-92b2-c7e0ac216881 tempest-VolumesSnapshotListTestJSON-519112216 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:34:13 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-abff35e4-e2ba-4abd-92b2-c7e0ac216881 tempest-VolumesSnapshotListTestJSON-519112216 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:34:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-abff35e4-e2ba-4abd-92b2-c7e0ac216881 tempest-VolumesSnapshotListTestJSON-519112216 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:34:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-abff35e4-e2ba-4abd-92b2-c7e0ac216881 tempest-VolumesSnapshotListTestJSON-519112216 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:13 devstack sudo[102721]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:34:13 devstack sudo[102721]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:13 devstack sudo[102721]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-abff35e4-e2ba-4abd-92b2-c7e0ac216881 tempest-VolumesSnapshotListTestJSON-519112216 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.267s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:13 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-abff35e4-e2ba-4abd-92b2-c7e0ac216881 tempest-VolumesSnapshotListTestJSON-519112216 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:34:13 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-abff35e4-e2ba-4abd-92b2-c7e0ac216881 tempest-VolumesSnapshotListTestJSON-519112216 None] Deleted volume successfully. Nov 01 12:34:13 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-abff35e4-e2ba-4abd-92b2-c7e0ac216881 tempest-VolumesSnapshotListTestJSON-519112216 None] Lock "cinder-0a5d2af4-9ee3-4449-a040-95aa72a89a82-delete_volume" released by "delete_volume" :: held 1.291s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:34:23 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:SELECT=20,cinder:UPDATE=25,cinder:DELETE=1,cinder:INSERT=8 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:34:23 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:SELECT=25,cinder:UPDATE=27,cinder:DELETE=2,cinder:INSERT=8 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:34:28 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-ae9909c9-391f-4d20-b521-bf13283fb22a tempest-TestMinimumBasicScenario-44221468 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:34:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ae9909c9-391f-4d20-b521-bf13283fb22a tempest-TestMinimumBasicScenario-44221468 None] Flow 'volume_create_manager' (e176cec3-0a1c-4443-b8d5-63ecd6ff97ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:34:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ae9909c9-391f-4d20-b521-bf13283fb22a tempest-TestMinimumBasicScenario-44221468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39bcb437-5358-4ad1-842a-3a05db03cb73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ae9909c9-391f-4d20-b521-bf13283fb22a tempest-TestMinimumBasicScenario-44221468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (39bcb437-5358-4ad1-842a-3a05db03cb73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-756072560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dd3cdc6-f381-4aa6-96d3-ab0aede37eed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86a67113b46449f699002da48f4fad20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:34:28Z,use_quota=True,user_id='32b2ca6d57fc446fb52534f695d0a883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ae9909c9-391f-4d20-b521-bf13283fb22a tempest-TestMinimumBasicScenario-44221468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c96dd7d2-5637-413c-ad98-7bb0c4a57063) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ae9909c9-391f-4d20-b521-bf13283fb22a tempest-TestMinimumBasicScenario-44221468 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c96dd7d2-5637-413c-ad98-7bb0c4a57063) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ae9909c9-391f-4d20-b521-bf13283fb22a tempest-TestMinimumBasicScenario-44221468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4e0b6fa-901c-429e-bbb0-78a5f25bf8fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ae9909c9-391f-4d20-b521-bf13283fb22a tempest-TestMinimumBasicScenario-44221468 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e4e0b6fa-901c-429e-bbb0-78a5f25bf8fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0dd3cdc6-f381-4aa6-96d3-ab0aede37eed', 'volume_name': 'volume-0dd3cdc6-f381-4aa6-96d3-ab0aede37eed', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ae9909c9-391f-4d20-b521-bf13283fb22a tempest-TestMinimumBasicScenario-44221468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4f26b80-4ac2-4479-a3df-aa507c203d43) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ae9909c9-391f-4d20-b521-bf13283fb22a tempest-TestMinimumBasicScenario-44221468 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4f26b80-4ac2-4479-a3df-aa507c203d43) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ae9909c9-391f-4d20-b521-bf13283fb22a tempest-TestMinimumBasicScenario-44221468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4454808d-0cc4-42c6-bc9d-dad42a529eb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:28 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-ae9909c9-391f-4d20-b521-bf13283fb22a tempest-TestMinimumBasicScenario-44221468 None] Volume 0dd3cdc6-f381-4aa6-96d3-ab0aede37eed: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0dd3cdc6-f381-4aa6-96d3-ab0aede37eed', 'volume_size': 1} Nov 01 12:34:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ae9909c9-391f-4d20-b521-bf13283fb22a tempest-TestMinimumBasicScenario-44221468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:34:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ae9909c9-391f-4d20-b521-bf13283fb22a tempest-TestMinimumBasicScenario-44221468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:34:28 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ae9909c9-391f-4d20-b521-bf13283fb22a tempest-TestMinimumBasicScenario-44221468 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:34:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-756072560',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0dd3cdc6-f381-4aa6-96d3-ab0aede37eed,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='86a67113b46449f699002da48f4fad20',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:34:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:34:28Z,use_quota=True,user_id='32b2ca6d57fc446fb52534f695d0a883',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:34:28 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-ae9909c9-391f-4d20-b521-bf13283fb22a tempest-TestMinimumBasicScenario-44221468 None] Creating volume 0dd3cdc6-f381-4aa6-96d3-ab0aede37eed {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:34:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ae9909c9-391f-4d20-b521-bf13283fb22a tempest-TestMinimumBasicScenario-44221468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:34:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ae9909c9-391f-4d20-b521-bf13283fb22a tempest-TestMinimumBasicScenario-44221468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:34:28 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ae9909c9-391f-4d20-b521-bf13283fb22a tempest-TestMinimumBasicScenario-44221468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:34:28 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ae9909c9-391f-4d20-b521-bf13283fb22a tempest-TestMinimumBasicScenario-44221468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:34:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ae9909c9-391f-4d20-b521-bf13283fb22a tempest-TestMinimumBasicScenario-44221468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:34:28 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ae9909c9-391f-4d20-b521-bf13283fb22a tempest-TestMinimumBasicScenario-44221468 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:34:28 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-ae9909c9-391f-4d20-b521-bf13283fb22a tempest-TestMinimumBasicScenario-44221468 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:34:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ae9909c9-391f-4d20-b521-bf13283fb22a tempest-TestMinimumBasicScenario-44221468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0dd3cdc6-f381-4aa6-96d3-ab0aede37eed 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:28 devstack sudo[102842]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0dd3cdc6-f381-4aa6-96d3-ab0aede37eed 1073741824 Nov 01 12:34:28 devstack sudo[102842]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:29 devstack sudo[102842]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ae9909c9-391f-4d20-b521-bf13283fb22a tempest-TestMinimumBasicScenario-44221468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0dd3cdc6-f381-4aa6-96d3-ab0aede37eed 1073741824" returned: 0 in 0.709s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ae9909c9-391f-4d20-b521-bf13283fb22a tempest-TestMinimumBasicScenario-44221468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0dd3cdc6-f381-4aa6-96d3-ab0aede37eed {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:29 devstack sudo[102848]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0dd3cdc6-f381-4aa6-96d3-ab0aede37eed Nov 01 12:34:29 devstack sudo[102848]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:29 devstack sudo[102848]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ae9909c9-391f-4d20-b521-bf13283fb22a tempest-TestMinimumBasicScenario-44221468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0dd3cdc6-f381-4aa6-96d3-ab0aede37eed" returned: 0 in 0.274s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:29 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ae9909c9-391f-4d20-b521-bf13283fb22a tempest-TestMinimumBasicScenario-44221468 None] <== create_volume: return (1083ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:34:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ae9909c9-391f-4d20-b521-bf13283fb22a tempest-TestMinimumBasicScenario-44221468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.086s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:34:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ae9909c9-391f-4d20-b521-bf13283fb22a tempest-TestMinimumBasicScenario-44221468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4454808d-0cc4-42c6-bc9d-dad42a529eb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0dd3cdc6-f381-4aa6-96d3-ab0aede37eed', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ae9909c9-391f-4d20-b521-bf13283fb22a tempest-TestMinimumBasicScenario-44221468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a87bbef-bf9c-4680-a7ef-bf260ba88544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:29 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-ae9909c9-391f-4d20-b521-bf13283fb22a tempest-TestMinimumBasicScenario-44221468 None] Volume volume-0dd3cdc6-f381-4aa6-96d3-ab0aede37eed (0dd3cdc6-f381-4aa6-96d3-ab0aede37eed): created successfully Nov 01 12:34:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ae9909c9-391f-4d20-b521-bf13283fb22a tempest-TestMinimumBasicScenario-44221468 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4a87bbef-bf9c-4680-a7ef-bf260ba88544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ae9909c9-391f-4d20-b521-bf13283fb22a tempest-TestMinimumBasicScenario-44221468 None] Flow 'volume_create_manager' (e176cec3-0a1c-4443-b8d5-63ecd6ff97ce) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:34:29 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-ae9909c9-391f-4d20-b521-bf13283fb22a tempest-TestMinimumBasicScenario-44221468 None] Created volume successfully. Nov 01 12:34:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-743aca73-4d42-4984-b5d3-2a53fea9ea02 req-dbc0acf3-1ecd-4126-b511-a2a68826ad03 tempest-TestMinimumBasicScenario-44221468 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:34:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-743aca73-4d42-4984-b5d3-2a53fea9ea02 req-dbc0acf3-1ecd-4126-b511-a2a68826ad03 tempest-TestMinimumBasicScenario-44221468 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:34:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-743aca73-4d42-4984-b5d3-2a53fea9ea02 req-dbc0acf3-1ecd-4126-b511-a2a68826ad03 tempest-TestMinimumBasicScenario-44221468 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.015s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:34:31 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-743aca73-4d42-4984-b5d3-2a53fea9ea02 req-dbc0acf3-1ecd-4126-b511-a2a68826ad03 tempest-TestMinimumBasicScenario-44221468 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb', 'name': 'volume-0dd3cdc6-f381-4aa6-96d3-ab0aede37eed', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7d64e4b6-8e96-4100-806b-5aee8f25c64d', 'enforce_multipath': True} {{(pid=86574) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 12:34:31 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-743aca73-4d42-4984-b5d3-2a53fea9ea02 req-dbc0acf3-1ecd-4126-b511-a2a68826ad03 tempest-TestMinimumBasicScenario-44221468 None] attachment_update completed successfully. Nov 01 12:34:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-052e7932-6e6e-46cc-8b4c-54fe41daa368 req-b6c42f7a-57ee-4148-bb9a-8b27d0f22e16 tempest-TestStampPattern-399521859 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:34:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-052e7932-6e6e-46cc-8b4c-54fe41daa368 req-b6c42f7a-57ee-4148-bb9a-8b27d0f22e16 tempest-TestStampPattern-399521859 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:34:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-052e7932-6e6e-46cc-8b4c-54fe41daa368 req-b6c42f7a-57ee-4148-bb9a-8b27d0f22e16 tempest-TestStampPattern-399521859 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.032s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:34:37 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-052e7932-6e6e-46cc-8b4c-54fe41daa368 req-b6c42f7a-57ee-4148-bb9a-8b27d0f22e16 tempest-TestStampPattern-399521859 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb', 'name': 'volume-ed68edf5-798e-4d2a-9da3-429e604a3d0f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '56a56384-0f89-4875-8513-076a3ce15838', 'enforce_multipath': True} {{(pid=86574) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 12:34:37 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-052e7932-6e6e-46cc-8b4c-54fe41daa368 req-b6c42f7a-57ee-4148-bb9a-8b27d0f22e16 tempest-TestStampPattern-399521859 None] attachment_update completed successfully. Nov 01 12:34:39 devstack cinder-volume[86574]: DEBUG oslo_service.periodic_task [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86574) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:34:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:34:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:34:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:34:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:34:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:34:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:39 devstack sudo[103339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:34:39 devstack sudo[103339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:40 devstack sudo[103339]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.399s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:40 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:34:40 devstack cinder-volume[86574]: DEBUG oslo_service.periodic_task [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running periodic task VolumeManager._thread_info {{(pid=86574) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:34:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] thread count: 28 {{(pid=86574) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 12:34:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] thread info: [<_MainThread(MainThread, started 131331184930944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86574) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 12:34:40 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-2acafd56-e889-4947-a488-3b9d8368002a req-9b58b9ef-36e4-4ae5-9bca-07973c372f44 tempest-TestStampPattern-399521859 None] Terminate volume connection completed successfully. Nov 01 12:34:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-2acafd56-e889-4947-a488-3b9d8368002a req-9b58b9ef-36e4-4ae5-9bca-07973c372f44 tempest-TestStampPattern-399521859 None] Deleting attachment 56a56384-0f89-4875-8513-076a3ce15838. {{(pid=86574) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 12:34:45 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-5a8e0346-6ba2-45f9-b265-3f5490465791 tempest-TestStampPattern-399521859 None] Acquiring lock "cinder-ed68edf5-798e-4d2a-9da3-429e604a3d0f-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:34:45 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-5a8e0346-6ba2-45f9-b265-3f5490465791 tempest-TestStampPattern-399521859 None] Lock "cinder-ed68edf5-798e-4d2a-9da3-429e604a3d0f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:34:45 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-5a8e0346-6ba2-45f9-b265-3f5490465791 tempest-TestStampPattern-399521859 None] Acquiring lock "cinder-quobyte-ed68edf5-798e-4d2a-9da3-429e604a3d0f" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:34:45 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-5a8e0346-6ba2-45f9-b265-3f5490465791 tempest-TestStampPattern-399521859 None] Lock "cinder-quobyte-ed68edf5-798e-4d2a-9da3-429e604a3d0f" acquired by "delete_volume" :: waited 0.013s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:34:45 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[75ba1c37-1ba4-476a-bb12-ac09852e06f3]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:34:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5a8e0346-6ba2-45f9-b265-3f5490465791 tempest-TestStampPattern-399521859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed68edf5-798e-4d2a-9da3-429e604a3d0f {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:45 devstack sudo[103414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed68edf5-798e-4d2a-9da3-429e604a3d0f Nov 01 12:34:45 devstack sudo[103414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:45 devstack sudo[103414]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5a8e0346-6ba2-45f9-b265-3f5490465791 tempest-TestStampPattern-399521859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed68edf5-798e-4d2a-9da3-429e604a3d0f" returned: 0 in 0.449s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5a8e0346-6ba2-45f9-b265-3f5490465791 tempest-TestStampPattern-399521859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed68edf5-798e-4d2a-9da3-429e604a3d0f {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:45 devstack sudo[103419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed68edf5-798e-4d2a-9da3-429e604a3d0f Nov 01 12:34:45 devstack sudo[103419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:46 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-093c74b6-168b-453c-adee-790d6d2a02c0 tempest-TestInstancesWithCinderVolumes-864439911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:34:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-093c74b6-168b-453c-adee-790d6d2a02c0 tempest-TestInstancesWithCinderVolumes-864439911 None] Flow 'volume_create_manager' (7d12acdc-eb7a-44db-b10d-fdbe46c7d534) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:34:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-093c74b6-168b-453c-adee-790d6d2a02c0 tempest-TestInstancesWithCinderVolumes-864439911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2898fa5d-372b-4b0e-b6e4-68159c1b7c64) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-093c74b6-168b-453c-adee-790d6d2a02c0 tempest-TestInstancesWithCinderVolumes-864439911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2898fa5d-372b-4b0e-b6e4-68159c1b7c64) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-679658008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5949383-d126-4b76-aad7-f5faf1ddb88e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='975202a2ff8f4154a8b4f4101f0fc7d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:34:46Z,use_quota=True,user_id='acca9d51b7354a5ebe86dc9bf387dbee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a27286ad-e23c-4ed5-aa43-cbad5d8d09ad),volume_type_id=a27286ad-e23c-4ed5-aa43-cbad5d8d09ad)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-093c74b6-168b-453c-adee-790d6d2a02c0 tempest-TestInstancesWithCinderVolumes-864439911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (416978da-11bc-450a-b9e9-de9526d787e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-093c74b6-168b-453c-adee-790d6d2a02c0 tempest-TestInstancesWithCinderVolumes-864439911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (416978da-11bc-450a-b9e9-de9526d787e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-093c74b6-168b-453c-adee-790d6d2a02c0 tempest-TestInstancesWithCinderVolumes-864439911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02467be3-8688-46b2-9fbe-715582507ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-093c74b6-168b-453c-adee-790d6d2a02c0 tempest-TestInstancesWithCinderVolumes-864439911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02467be3-8688-46b2-9fbe-715582507ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5949383-d126-4b76-aad7-f5faf1ddb88e', 'volume_name': 'volume-e5949383-d126-4b76-aad7-f5faf1ddb88e', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-093c74b6-168b-453c-adee-790d6d2a02c0 tempest-TestInstancesWithCinderVolumes-864439911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b97601-ccb3-4314-a5fc-f46d4106d658) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-093c74b6-168b-453c-adee-790d6d2a02c0 tempest-TestInstancesWithCinderVolumes-864439911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (68b97601-ccb3-4314-a5fc-f46d4106d658) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-093c74b6-168b-453c-adee-790d6d2a02c0 tempest-TestInstancesWithCinderVolumes-864439911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daeb09db-c476-43e7-9979-9c1fc75f5f82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:46 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-093c74b6-168b-453c-adee-790d6d2a02c0 tempest-TestInstancesWithCinderVolumes-864439911 None] Volume e5949383-d126-4b76-aad7-f5faf1ddb88e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5949383-d126-4b76-aad7-f5faf1ddb88e', 'volume_size': 1} Nov 01 12:34:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-093c74b6-168b-453c-adee-790d6d2a02c0 tempest-TestInstancesWithCinderVolumes-864439911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:34:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-093c74b6-168b-453c-adee-790d6d2a02c0 tempest-TestInstancesWithCinderVolumes-864439911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:34:46 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-093c74b6-168b-453c-adee-790d6d2a02c0 tempest-TestInstancesWithCinderVolumes-864439911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-679658008',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5949383-d126-4b76-aad7-f5faf1ddb88e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='975202a2ff8f4154a8b4f4101f0fc7d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:34:46Z,use_quota=True,user_id='acca9d51b7354a5ebe86dc9bf387dbee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(a27286ad-e23c-4ed5-aa43-cbad5d8d09ad),volume_type_id=a27286ad-e23c-4ed5-aa43-cbad5d8d09ad)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:34:46 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-093c74b6-168b-453c-adee-790d6d2a02c0 tempest-TestInstancesWithCinderVolumes-864439911 None] Creating volume e5949383-d126-4b76-aad7-f5faf1ddb88e {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:34:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-093c74b6-168b-453c-adee-790d6d2a02c0 tempest-TestInstancesWithCinderVolumes-864439911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:34:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-093c74b6-168b-453c-adee-790d6d2a02c0 tempest-TestInstancesWithCinderVolumes-864439911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:34:46 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-093c74b6-168b-453c-adee-790d6d2a02c0 tempest-TestInstancesWithCinderVolumes-864439911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:34:46 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-093c74b6-168b-453c-adee-790d6d2a02c0 tempest-TestInstancesWithCinderVolumes-864439911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:34:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-093c74b6-168b-453c-adee-790d6d2a02c0 tempest-TestInstancesWithCinderVolumes-864439911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:34:46 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-093c74b6-168b-453c-adee-790d6d2a02c0 tempest-TestInstancesWithCinderVolumes-864439911 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:34:46 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-093c74b6-168b-453c-adee-790d6d2a02c0 tempest-TestInstancesWithCinderVolumes-864439911 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:34:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-093c74b6-168b-453c-adee-790d6d2a02c0 tempest-TestInstancesWithCinderVolumes-864439911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e5949383-d126-4b76-aad7-f5faf1ddb88e 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:46 devstack sudo[103422]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e5949383-d126-4b76-aad7-f5faf1ddb88e 1073741824 Nov 01 12:34:46 devstack sudo[103422]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:46 devstack sudo[103419]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5a8e0346-6ba2-45f9-b265-3f5490465791 tempest-TestStampPattern-399521859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed68edf5-798e-4d2a-9da3-429e604a3d0f" returned: 0 in 0.393s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:46 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-5a8e0346-6ba2-45f9-b265-3f5490465791 tempest-TestStampPattern-399521859 None] Lock "cinder-quobyte-ed68edf5-798e-4d2a-9da3-429e604a3d0f" released by "delete_volume" :: held 0.903s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:34:46 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-5a8e0346-6ba2-45f9-b265-3f5490465791 tempest-TestStampPattern-399521859 None] Created reservations ['2cd73d76-5505-4521-a048-6943d068793d', '224c8b98-873a-44af-86bb-9d190e2f548d', 'fafba5b5-94c0-4af6-8c74-a66016ed4017', '1aa8b0c3-bd23-4425-be01-8149b30a9ae5'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:34:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5a8e0346-6ba2-45f9-b265-3f5490465791 tempest-TestStampPattern-399521859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:34:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5a8e0346-6ba2-45f9-b265-3f5490465791 tempest-TestStampPattern-399521859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:34:46 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-5a8e0346-6ba2-45f9-b265-3f5490465791 tempest-TestStampPattern-399521859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:34:46 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-5a8e0346-6ba2-45f9-b265-3f5490465791 tempest-TestStampPattern-399521859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:34:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5a8e0346-6ba2-45f9-b265-3f5490465791 tempest-TestStampPattern-399521859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:34:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5a8e0346-6ba2-45f9-b265-3f5490465791 tempest-TestStampPattern-399521859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:46 devstack sudo[103424]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:34:46 devstack sudo[103424]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:46 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3225e0d-d691-4c13-9b5c-a43288fc752e tempest-TestInstancesWithCinderVolumes-864439911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:34:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f3225e0d-d691-4c13-9b5c-a43288fc752e tempest-TestInstancesWithCinderVolumes-864439911 None] Flow 'volume_create_manager' (e1ae5088-29bd-4019-88ec-28674f56778d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:34:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f3225e0d-d691-4c13-9b5c-a43288fc752e tempest-TestInstancesWithCinderVolumes-864439911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41b5ba66-4b03-4c50-8e13-f9b7d3583ac9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f3225e0d-d691-4c13-9b5c-a43288fc752e tempest-TestInstancesWithCinderVolumes-864439911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (41b5ba66-4b03-4c50-8e13-f9b7d3583ac9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-618360730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d87eff6f-656a-4d6d-8ef7-4e32da41184e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='975202a2ff8f4154a8b4f4101f0fc7d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:34:46Z,use_quota=True,user_id='acca9d51b7354a5ebe86dc9bf387dbee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3527e945-e28e-4f2b-b276-ba8c8179eeb5),volume_type_id=3527e945-e28e-4f2b-b276-ba8c8179eeb5)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f3225e0d-d691-4c13-9b5c-a43288fc752e tempest-TestInstancesWithCinderVolumes-864439911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fd7b464-f1a7-486c-bb4b-46ef598c933e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f3225e0d-d691-4c13-9b5c-a43288fc752e tempest-TestInstancesWithCinderVolumes-864439911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5fd7b464-f1a7-486c-bb4b-46ef598c933e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f3225e0d-d691-4c13-9b5c-a43288fc752e tempest-TestInstancesWithCinderVolumes-864439911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30bab2b9-0d89-4419-8247-374630b6528b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f3225e0d-d691-4c13-9b5c-a43288fc752e tempest-TestInstancesWithCinderVolumes-864439911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (30bab2b9-0d89-4419-8247-374630b6528b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd87eff6f-656a-4d6d-8ef7-4e32da41184e', 'volume_name': 'volume-d87eff6f-656a-4d6d-8ef7-4e32da41184e', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f3225e0d-d691-4c13-9b5c-a43288fc752e tempest-TestInstancesWithCinderVolumes-864439911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db0d32e9-22a3-4d56-b75a-b590e4f3ff9f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f3225e0d-d691-4c13-9b5c-a43288fc752e tempest-TestInstancesWithCinderVolumes-864439911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (db0d32e9-22a3-4d56-b75a-b590e4f3ff9f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f3225e0d-d691-4c13-9b5c-a43288fc752e tempest-TestInstancesWithCinderVolumes-864439911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a82ccb1-a3ab-445f-9df9-2507fd07b396) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:46 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-f3225e0d-d691-4c13-9b5c-a43288fc752e tempest-TestInstancesWithCinderVolumes-864439911 None] Volume d87eff6f-656a-4d6d-8ef7-4e32da41184e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d87eff6f-656a-4d6d-8ef7-4e32da41184e', 'volume_size': 1} Nov 01 12:34:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f3225e0d-d691-4c13-9b5c-a43288fc752e tempest-TestInstancesWithCinderVolumes-864439911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:34:46 devstack sudo[103424]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5a8e0346-6ba2-45f9-b265-3f5490465791 tempest-TestStampPattern-399521859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.473s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:46 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-5a8e0346-6ba2-45f9-b265-3f5490465791 tempest-TestStampPattern-399521859 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:34:46 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-5a8e0346-6ba2-45f9-b265-3f5490465791 tempest-TestStampPattern-399521859 None] Deleted volume successfully. Nov 01 12:34:47 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-5a8e0346-6ba2-45f9-b265-3f5490465791 tempest-TestStampPattern-399521859 None] Lock "cinder-ed68edf5-798e-4d2a-9da3-429e604a3d0f-delete_volume" released by "delete_volume" :: held 1.680s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:34:47 devstack sudo[103422]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-093c74b6-168b-453c-adee-790d6d2a02c0 tempest-TestInstancesWithCinderVolumes-864439911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e5949383-d126-4b76-aad7-f5faf1ddb88e 1073741824" returned: 0 in 0.879s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-093c74b6-168b-453c-adee-790d6d2a02c0 tempest-TestInstancesWithCinderVolumes-864439911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e5949383-d126-4b76-aad7-f5faf1ddb88e {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:47 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ead7b853-2d01-4e08-9409-c8206a92f91d tempest-TestStampPattern-399521859 None] Acquiring lock "cinder-62344888-06a1-4b5f-a6b7-9757c7105a16-delete_snapshot" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:34:47 devstack sudo[103431]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e5949383-d126-4b76-aad7-f5faf1ddb88e Nov 01 12:34:47 devstack sudo[103431]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:47 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ead7b853-2d01-4e08-9409-c8206a92f91d tempest-TestStampPattern-399521859 None] Lock "cinder-62344888-06a1-4b5f-a6b7-9757c7105a16-delete_snapshot" acquired by "delete_snapshot" :: waited 0.026s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:34:47 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ead7b853-2d01-4e08-9409-c8206a92f91d tempest-TestStampPattern-399521859 None] Acquiring lock "cinder-quobyte-3bee0113-3ffb-4a91-8376-422bef6e15db" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:34:47 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ead7b853-2d01-4e08-9409-c8206a92f91d tempest-TestStampPattern-399521859 None] Lock "cinder-quobyte-3bee0113-3ffb-4a91-8376-422bef6e15db" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:34:47 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ead7b853-2d01-4e08-9409-c8206a92f91d tempest-TestStampPattern-399521859 None] Acquiring lock "cinder-quobyte-62344888-06a1-4b5f-a6b7-9757c7105a16" by "_delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:34:47 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ead7b853-2d01-4e08-9409-c8206a92f91d tempest-TestStampPattern-399521859 None] Lock "cinder-quobyte-62344888-06a1-4b5f-a6b7-9757c7105a16" acquired by "_delete_snapshot" :: waited 0.034s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:34:47 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-ead7b853-2d01-4e08-9409-c8206a92f91d tempest-TestStampPattern-399521859 None] Deleting offline snapshot 62344888-06a1-4b5f-a6b7-9757c7105a16 of volume 3bee0113-3ffb-4a91-8376-422bef6e15db {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:34:47 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-ead7b853-2d01-4e08-9409-c8206a92f91d tempest-TestStampPattern-399521859 None] snapshot_file for this snap is: volume-3bee0113-3ffb-4a91-8376-422bef6e15db.62344888-06a1-4b5f-a6b7-9757c7105a16 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:34:47 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[67a9dc41-212c-4206-95a5-79756c6549ee]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:34:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ead7b853-2d01-4e08-9409-c8206a92f91d tempest-TestStampPattern-399521859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db.62344888-06a1-4b5f-a6b7-9757c7105a16 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:47 devstack sudo[103433]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db.62344888-06a1-4b5f-a6b7-9757c7105a16 Nov 01 12:34:47 devstack sudo[103433]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:47 devstack sudo[103431]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-093c74b6-168b-453c-adee-790d6d2a02c0 tempest-TestInstancesWithCinderVolumes-864439911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e5949383-d126-4b76-aad7-f5faf1ddb88e" returned: 0 in 0.309s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:47 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-093c74b6-168b-453c-adee-790d6d2a02c0 tempest-TestInstancesWithCinderVolumes-864439911 None] <== create_volume: return (1252ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:34:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-093c74b6-168b-453c-adee-790d6d2a02c0 tempest-TestInstancesWithCinderVolumes-864439911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.258s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:34:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f3225e0d-d691-4c13-9b5c-a43288fc752e tempest-TestInstancesWithCinderVolumes-864439911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.665s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:34:47 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f3225e0d-d691-4c13-9b5c-a43288fc752e tempest-TestInstancesWithCinderVolumes-864439911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:34:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-618360730',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d87eff6f-656a-4d6d-8ef7-4e32da41184e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='975202a2ff8f4154a8b4f4101f0fc7d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:34:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:34:46Z,use_quota=True,user_id='acca9d51b7354a5ebe86dc9bf387dbee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3527e945-e28e-4f2b-b276-ba8c8179eeb5),volume_type_id=3527e945-e28e-4f2b-b276-ba8c8179eeb5)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:34:47 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-f3225e0d-d691-4c13-9b5c-a43288fc752e tempest-TestInstancesWithCinderVolumes-864439911 None] Creating volume d87eff6f-656a-4d6d-8ef7-4e32da41184e {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:34:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f3225e0d-d691-4c13-9b5c-a43288fc752e tempest-TestInstancesWithCinderVolumes-864439911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:34:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f3225e0d-d691-4c13-9b5c-a43288fc752e tempest-TestInstancesWithCinderVolumes-864439911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:34:47 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f3225e0d-d691-4c13-9b5c-a43288fc752e tempest-TestInstancesWithCinderVolumes-864439911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:34:47 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f3225e0d-d691-4c13-9b5c-a43288fc752e tempest-TestInstancesWithCinderVolumes-864439911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:34:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f3225e0d-d691-4c13-9b5c-a43288fc752e tempest-TestInstancesWithCinderVolumes-864439911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:34:47 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f3225e0d-d691-4c13-9b5c-a43288fc752e tempest-TestInstancesWithCinderVolumes-864439911 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:34:47 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-f3225e0d-d691-4c13-9b5c-a43288fc752e tempest-TestInstancesWithCinderVolumes-864439911 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:34:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f3225e0d-d691-4c13-9b5c-a43288fc752e tempest-TestInstancesWithCinderVolumes-864439911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d87eff6f-656a-4d6d-8ef7-4e32da41184e 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-093c74b6-168b-453c-adee-790d6d2a02c0 tempest-TestInstancesWithCinderVolumes-864439911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (daeb09db-c476-43e7-9979-9c1fc75f5f82) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5949383-d126-4b76-aad7-f5faf1ddb88e', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-093c74b6-168b-453c-adee-790d6d2a02c0 tempest-TestInstancesWithCinderVolumes-864439911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80529cc2-c3a5-49f7-a54d-54212411e602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:47 devstack sudo[103436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d87eff6f-656a-4d6d-8ef7-4e32da41184e 1073741824 Nov 01 12:34:47 devstack sudo[103436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:47 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:34:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] Flow 'volume_create_manager' (fbba116d-3784-4520-83fc-5156c92ea7f5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:34:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f1b1fa5-ad90-451a-a761-44696dcf6d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:47 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-093c74b6-168b-453c-adee-790d6d2a02c0 tempest-TestInstancesWithCinderVolumes-864439911 None] Volume volume-e5949383-d126-4b76-aad7-f5faf1ddb88e (e5949383-d126-4b76-aad7-f5faf1ddb88e): created successfully Nov 01 12:34:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-093c74b6-168b-453c-adee-790d6d2a02c0 tempest-TestInstancesWithCinderVolumes-864439911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (80529cc2-c3a5-49f7-a54d-54212411e602) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-093c74b6-168b-453c-adee-790d6d2a02c0 tempest-TestInstancesWithCinderVolumes-864439911 None] Flow 'volume_create_manager' (7d12acdc-eb7a-44db-b10d-fdbe46c7d534) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:34:47 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-093c74b6-168b-453c-adee-790d6d2a02c0 tempest-TestInstancesWithCinderVolumes-864439911 None] Created volume successfully. Nov 01 12:34:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f1b1fa5-ad90-451a-a761-44696dcf6d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-355032210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88fb2d2b-03f6-4314-9002-9734f72b3496,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='975202a2ff8f4154a8b4f4101f0fc7d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:34:47Z,use_quota=True,user_id='acca9d51b7354a5ebe86dc9bf387dbee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(522f7d2f-6f91-4170-810e-ede6f3b0960a),volume_type_id=522f7d2f-6f91-4170-810e-ede6f3b0960a)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d05419d-7f04-4cd4-828b-3638b20ca201) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d05419d-7f04-4cd4-828b-3638b20ca201) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8c887cd-2dec-45bd-b92b-10ae19d405ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:47 devstack cinder-volume[86574]: DEBUG cinder.image.glance [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] Creating Keystone auth plugin from conf {{(pid=86574) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 01 12:34:47 devstack sudo[103433]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ead7b853-2d01-4e08-9409-c8206a92f91d tempest-TestStampPattern-399521859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db.62344888-06a1-4b5f-a6b7-9757c7105a16" returned: 0 in 0.468s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:47 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-ead7b853-2d01-4e08-9409-c8206a92f91d tempest-TestStampPattern-399521859 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-3bee0113-3ffb-4a91-8376-422bef6e15db(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:34:47 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[0900a613-e5a5-47e2-92b8-ef4aded75257]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:34:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ead7b853-2d01-4e08-9409-c8206a92f91d tempest-TestStampPattern-399521859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:47 devstack sudo[103445]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db Nov 01 12:34:47 devstack sudo[103445]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8c887cd-2dec-45bd-b92b-10ae19d405ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '88fb2d2b-03f6-4314-9002-9734f72b3496', 'volume_name': 'volume-88fb2d2b-03f6-4314-9002-9734f72b3496', 'volume_size': 1, 'image_id': 'd1828316-01ac-4ae9-b5c5-b4c07c9680b3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1828316-01ac-4ae9-b5c5-b4c07c9680b3', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1405968405', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '975202a2ff8f4154a8b4f4101f0fc7d3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1828316-01ac-4ae9-b5c5-b4c07c9680b3', 'created_at': datetime.datetime(2026, 11, 1, 11, 34, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 34, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1828316-01ac-4ae9-b5c5-b4c07c9680b3/file', 'properties': {}}, 'image_service': }' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e0285c7-2c80-4dc8-822b-a0f9d8589793) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e0285c7-2c80-4dc8-822b-a0f9d8589793) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb3e6ddc-f9f0-454f-b423-77b51ae86733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:47 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] Volume 88fb2d2b-03f6-4314-9002-9734f72b3496: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-88fb2d2b-03f6-4314-9002-9734f72b3496', 'volume_size': 1, 'image_id': 'd1828316-01ac-4ae9-b5c5-b4c07c9680b3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1828316-01ac-4ae9-b5c5-b4c07c9680b3', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1405968405', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '975202a2ff8f4154a8b4f4101f0fc7d3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1828316-01ac-4ae9-b5c5-b4c07c9680b3', 'created_at': datetime.datetime(2026, 11, 1, 11, 34, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 34, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1828316-01ac-4ae9-b5c5-b4c07c9680b3/file', 'properties': {}}, 'image_service': } Nov 01 12:34:47 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] Trying to clone 88fb2d2b-03f6-4314-9002-9734f72b3496 from image d1828316-01ac-4ae9-b5c5-b4c07c9680b3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/d1828316-01ac-4ae9-b5c5-b4c07c9680b3', 'metadata': {}}]). {{(pid=86574) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 01 12:34:47 devstack sudo[103436]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f3225e0d-d691-4c13-9b5c-a43288fc752e tempest-TestInstancesWithCinderVolumes-864439911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d87eff6f-656a-4d6d-8ef7-4e32da41184e 1073741824" returned: 0 in 0.552s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f3225e0d-d691-4c13-9b5c-a43288fc752e tempest-TestInstancesWithCinderVolumes-864439911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d87eff6f-656a-4d6d-8ef7-4e32da41184e {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:48 devstack sudo[103448]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d87eff6f-656a-4d6d-8ef7-4e32da41184e Nov 01 12:34:48 devstack sudo[103448]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:48 devstack sudo[103448]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f3225e0d-d691-4c13-9b5c-a43288fc752e tempest-TestInstancesWithCinderVolumes-864439911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d87eff6f-656a-4d6d-8ef7-4e32da41184e" returned: 0 in 0.289s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:48 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f3225e0d-d691-4c13-9b5c-a43288fc752e tempest-TestInstancesWithCinderVolumes-864439911 None] <== create_volume: return (901ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:34:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f3225e0d-d691-4c13-9b5c-a43288fc752e tempest-TestInstancesWithCinderVolumes-864439911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:34:48 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f3225e0d-d691-4c13-9b5c-a43288fc752e tempest-TestInstancesWithCinderVolumes-864439911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6a82ccb1-a3ab-445f-9df9-2507fd07b396) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d87eff6f-656a-4d6d-8ef7-4e32da41184e', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:48 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f3225e0d-d691-4c13-9b5c-a43288fc752e tempest-TestInstancesWithCinderVolumes-864439911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f7d6914-8dc5-4bd8-b8d8-708b03690876) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:48 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-f3225e0d-d691-4c13-9b5c-a43288fc752e tempest-TestInstancesWithCinderVolumes-864439911 None] Volume volume-d87eff6f-656a-4d6d-8ef7-4e32da41184e (d87eff6f-656a-4d6d-8ef7-4e32da41184e): created successfully Nov 01 12:34:48 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f3225e0d-d691-4c13-9b5c-a43288fc752e tempest-TestInstancesWithCinderVolumes-864439911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3f7d6914-8dc5-4bd8-b8d8-708b03690876) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:48 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f3225e0d-d691-4c13-9b5c-a43288fc752e tempest-TestInstancesWithCinderVolumes-864439911 None] Flow 'volume_create_manager' (e1ae5088-29bd-4019-88ec-28674f56778d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:34:48 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-f3225e0d-d691-4c13-9b5c-a43288fc752e tempest-TestInstancesWithCinderVolumes-864439911 None] Created volume successfully. Nov 01 12:34:48 devstack sudo[103445]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ead7b853-2d01-4e08-9409-c8206a92f91d tempest-TestStampPattern-399521859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db" returned: 0 in 0.620s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ead7b853-2d01-4e08-9409-c8206a92f91d tempest-TestStampPattern-399521859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db.62344888-06a1-4b5f-a6b7-9757c7105a16 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:48 devstack sudo[103455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db.62344888-06a1-4b5f-a6b7-9757c7105a16 Nov 01 12:34:48 devstack sudo[103455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:48 devstack sudo[103455]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ead7b853-2d01-4e08-9409-c8206a92f91d tempest-TestStampPattern-399521859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db.62344888-06a1-4b5f-a6b7-9757c7105a16" returned: 0 in 0.418s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ead7b853-2d01-4e08-9409-c8206a92f91d tempest-TestStampPattern-399521859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db.62344888-06a1-4b5f-a6b7-9757c7105a16 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:48 devstack sudo[103463]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db.62344888-06a1-4b5f-a6b7-9757c7105a16 Nov 01 12:34:48 devstack sudo[103463]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:49 devstack sudo[103463]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ead7b853-2d01-4e08-9409-c8206a92f91d tempest-TestStampPattern-399521859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db.62344888-06a1-4b5f-a6b7-9757c7105a16" returned: 0 in 0.315s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:49 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ead7b853-2d01-4e08-9409-c8206a92f91d tempest-TestStampPattern-399521859 None] Lock "cinder-quobyte-62344888-06a1-4b5f-a6b7-9757c7105a16" released by "_delete_snapshot" :: held 1.969s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:34:49 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ead7b853-2d01-4e08-9409-c8206a92f91d tempest-TestStampPattern-399521859 None] Lock "cinder-quobyte-3bee0113-3ffb-4a91-8376-422bef6e15db" released by "delete_snapshot" :: held 2.014s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:34:49 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-ead7b853-2d01-4e08-9409-c8206a92f91d tempest-TestStampPattern-399521859 None] Created reservations ['c74a797d-8779-44ce-9a5c-63e913e3af86', '979e488b-3e84-4666-b6c9-2b4939f586de', '6842e4d1-a01c-45e9-b223-93254f2a50fe', 'bd859424-2b58-42b2-882d-a7935ea57cbc'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:34:49 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-ead7b853-2d01-4e08-9409-c8206a92f91d tempest-TestStampPattern-399521859 None] Delete snapshot completed successfully. Nov 01 12:34:49 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ead7b853-2d01-4e08-9409-c8206a92f91d tempest-TestStampPattern-399521859 None] Lock "cinder-62344888-06a1-4b5f-a6b7-9757c7105a16-delete_snapshot" released by "delete_snapshot" :: held 2.245s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:34:51 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d1828316-01ac-4ae9-b5c5-b4c07c9680b3_9tx_zwx0devstack@QuobyteHD, size 20.69 MB, duration 3.88 sec {{(pid=86574) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 01 12:34:51 devstack cinder-volume[86574]: INFO cinder.image.image_utils [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] Image download 20.69 MB at 5.33 MB/s Nov 01 12:34:51 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9a088a1-2d09-43e9-8917-fb4e21c5062a]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:34:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1828316-01ac-4ae9-b5c5-b4c07c9680b3_9tx_zwx0devstack@QuobyteHD {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:52 devstack sudo[103507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1828316-01ac-4ae9-b5c5-b4c07c9680b3_9tx_zwx0devstack@QuobyteHD Nov 01 12:34:52 devstack sudo[103507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:52 devstack sudo[103507]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1828316-01ac-4ae9-b5c5-b4c07c9680b3_9tx_zwx0devstack@QuobyteHD" returned: 0 in 0.439s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:52 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] Temporary image d1828316-01ac-4ae9-b5c5-b4c07c9680b3 is fetched for user acca9d51b7354a5ebe86dc9bf387dbee. {{(pid=86574) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 01 12:34:52 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[58e9634e-73fb-4d84-be4d-1edf0e300ab0]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:34:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1828316-01ac-4ae9-b5c5-b4c07c9680b3_9tx_zwx0devstack@QuobyteHD {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:52 devstack sudo[103526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1828316-01ac-4ae9-b5c5-b4c07c9680b3_9tx_zwx0devstack@QuobyteHD Nov 01 12:34:52 devstack sudo[103526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:52 devstack sudo[103526]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1828316-01ac-4ae9-b5c5-b4c07c9680b3_9tx_zwx0devstack@QuobyteHD" returned: 0 in 0.419s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:34:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:34:52 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:34:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-355032210',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=88fb2d2b-03f6-4314-9002-9734f72b3496,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='975202a2ff8f4154a8b4f4101f0fc7d3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:34:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:34:47Z,use_quota=True,user_id='acca9d51b7354a5ebe86dc9bf387dbee',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(522f7d2f-6f91-4170-810e-ede6f3b0960a),volume_type_id=522f7d2f-6f91-4170-810e-ede6f3b0960a)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:34:52 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] Creating volume 88fb2d2b-03f6-4314-9002-9734f72b3496 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:34:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:34:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:34:52 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:34:52 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:34:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:34:52 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:34:52 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:34:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-88fb2d2b-03f6-4314-9002-9734f72b3496 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:52 devstack sudo[103545]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-88fb2d2b-03f6-4314-9002-9734f72b3496 1073741824 Nov 01 12:34:52 devstack sudo[103545]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:53 devstack sudo[103545]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-88fb2d2b-03f6-4314-9002-9734f72b3496 1073741824" returned: 0 in 0.592s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-88fb2d2b-03f6-4314-9002-9734f72b3496 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:53 devstack sudo[103559]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-88fb2d2b-03f6-4314-9002-9734f72b3496 Nov 01 12:34:53 devstack sudo[103559]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:53 devstack sudo[103559]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-88fb2d2b-03f6-4314-9002-9734f72b3496" returned: 0 in 0.256s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:53 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] <== create_volume: return (914ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:34:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.920s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:34:53 devstack cinder-volume[86574]: DEBUG cinder.volume.volume_utils [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] Attempting download of d1828316-01ac-4ae9-b5c5-b4c07c9680b3 ((None, [{'url': 'file:///opt/stack/data/glance/images/d1828316-01ac-4ae9-b5c5-b4c07c9680b3', 'metadata': {}}])) to volume 88fb2d2b-03f6-4314-9002-9734f72b3496. {{(pid=86574) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 01 12:34:53 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[6ad97d78-8730-4ce7-b96d-484a08f81674]: (4, 'raw') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:34:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1828316-01ac-4ae9-b5c5-b4c07c9680b3_ahjcd25q {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:54 devstack sudo[103562]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1828316-01ac-4ae9-b5c5-b4c07c9680b3_ahjcd25q Nov 01 12:34:54 devstack sudo[103562]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:54 devstack sudo[103562]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d1828316-01ac-4ae9-b5c5-b4c07c9680b3_ahjcd25q" returned: 0 in 0.425s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1828316-01ac-4ae9-b5c5-b4c07c9680b3_ahjcd25q {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:54 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d6d4a5ad-4f2e-4b0a-ba4b-d06ef0666167 tempest-TestStampPattern-399521859 None] Acquiring lock "cinder-3bee0113-3ffb-4a91-8376-422bef6e15db-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:34:54 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d6d4a5ad-4f2e-4b0a-ba4b-d06ef0666167 tempest-TestStampPattern-399521859 None] Lock "cinder-3bee0113-3ffb-4a91-8376-422bef6e15db-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:34:54 devstack sudo[103568]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1828316-01ac-4ae9-b5c5-b4c07c9680b3_ahjcd25q Nov 01 12:34:54 devstack sudo[103568]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:54 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d6d4a5ad-4f2e-4b0a-ba4b-d06ef0666167 tempest-TestStampPattern-399521859 None] Acquiring lock "cinder-quobyte-3bee0113-3ffb-4a91-8376-422bef6e15db" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:34:54 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d6d4a5ad-4f2e-4b0a-ba4b-d06ef0666167 tempest-TestStampPattern-399521859 None] Lock "cinder-quobyte-3bee0113-3ffb-4a91-8376-422bef6e15db" acquired by "delete_volume" :: waited 0.023s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:34:54 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[50c85891-7e5e-43a9-9247-4425faadcd25]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:34:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d6d4a5ad-4f2e-4b0a-ba4b-d06ef0666167 tempest-TestStampPattern-399521859 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:54 devstack sudo[103570]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db Nov 01 12:34:54 devstack sudo[103570]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:54 devstack sudo[103568]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1828316-01ac-4ae9-b5c5-b4c07c9680b3_ahjcd25q" returned: 1 in 0.442s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d1828316-01ac-4ae9-b5c5-b4c07c9680b3_ahjcd25q' failed. Not Retrying. {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 12:34:54 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[58de3170-904f-4d09-8120-5768d7b0b963]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:34:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1828316-01ac-4ae9-b5c5-b4c07c9680b3_9tx_zwx0devstack@QuobyteHD {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:54 devstack sudo[103574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1828316-01ac-4ae9-b5c5-b4c07c9680b3_9tx_zwx0devstack@QuobyteHD Nov 01 12:34:54 devstack sudo[103574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:54 devstack sudo[103570]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d6d4a5ad-4f2e-4b0a-ba4b-d06ef0666167 tempest-TestStampPattern-399521859 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db" returned: 0 in 0.405s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d6d4a5ad-4f2e-4b0a-ba4b-d06ef0666167 tempest-TestStampPattern-399521859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:55 devstack sudo[103580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db Nov 01 12:34:55 devstack sudo[103580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:55 devstack sudo[103574]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d1828316-01ac-4ae9-b5c5-b4c07c9680b3_9tx_zwx0devstack@QuobyteHD" returned: 0 in 0.337s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:55 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] d1828316-01ac-4ae9-b5c5-b4c07c9680b3 was qcow2, converting to qcow2 {{(pid=86574) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 01 12:34:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1828316-01ac-4ae9-b5c5-b4c07c9680b3_9tx_zwx0devstack@QuobyteHD /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-88fb2d2b-03f6-4314-9002-9734f72b3496 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:55 devstack sudo[103586]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1828316-01ac-4ae9-b5c5-b4c07c9680b3_9tx_zwx0devstack@QuobyteHD /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-88fb2d2b-03f6-4314-9002-9734f72b3496 Nov 01 12:34:55 devstack sudo[103586]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:55 devstack sudo[103580]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d6d4a5ad-4f2e-4b0a-ba4b-d06ef0666167 tempest-TestStampPattern-399521859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3bee0113-3ffb-4a91-8376-422bef6e15db" returned: 0 in 0.271s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:55 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d6d4a5ad-4f2e-4b0a-ba4b-d06ef0666167 tempest-TestStampPattern-399521859 None] Lock "cinder-quobyte-3bee0113-3ffb-4a91-8376-422bef6e15db" released by "delete_volume" :: held 0.745s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:34:55 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-d6d4a5ad-4f2e-4b0a-ba4b-d06ef0666167 tempest-TestStampPattern-399521859 None] Created reservations ['a51f4dc0-e4dd-499b-8fe0-3aca2f13b94f', '97f2827f-82c3-4a9e-be0f-8b85e149a386', '926d5f12-23b5-47ac-83e0-6dc301a12d80', 'ccb7abe5-143f-4d17-9ae5-f5fe51eb102e'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:34:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d6d4a5ad-4f2e-4b0a-ba4b-d06ef0666167 tempest-TestStampPattern-399521859 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:34:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d6d4a5ad-4f2e-4b0a-ba4b-d06ef0666167 tempest-TestStampPattern-399521859 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:34:55 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d6d4a5ad-4f2e-4b0a-ba4b-d06ef0666167 tempest-TestStampPattern-399521859 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:34:55 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d6d4a5ad-4f2e-4b0a-ba4b-d06ef0666167 tempest-TestStampPattern-399521859 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:34:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d6d4a5ad-4f2e-4b0a-ba4b-d06ef0666167 tempest-TestStampPattern-399521859 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:34:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d6d4a5ad-4f2e-4b0a-ba4b-d06ef0666167 tempest-TestStampPattern-399521859 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:55 devstack sudo[103593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:34:55 devstack sudo[103593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:55 devstack sudo[103593]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d6d4a5ad-4f2e-4b0a-ba4b-d06ef0666167 tempest-TestStampPattern-399521859 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.311s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:55 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-d6d4a5ad-4f2e-4b0a-ba4b-d06ef0666167 tempest-TestStampPattern-399521859 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:34:55 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-d6d4a5ad-4f2e-4b0a-ba4b-d06ef0666167 tempest-TestStampPattern-399521859 None] Deleted volume successfully. Nov 01 12:34:55 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d6d4a5ad-4f2e-4b0a-ba4b-d06ef0666167 tempest-TestStampPattern-399521859 None] Lock "cinder-3bee0113-3ffb-4a91-8376-422bef6e15db-delete_volume" released by "delete_volume" :: held 1.375s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:34:57 devstack sudo[103586]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d1828316-01ac-4ae9-b5c5-b4c07c9680b3_9tx_zwx0devstack@QuobyteHD /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-88fb2d2b-03f6-4314-9002-9734f72b3496" returned: 0 in 2.371s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:57 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d1828316-01ac-4ae9-b5c5-b4c07c9680b3_9tx_zwx0devstack@QuobyteHD, size 112.00 MB, duration 2.37 sec, destination /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-88fb2d2b-03f6-4314-9002-9734f72b3496 {{(pid=86574) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 12:34:57 devstack cinder-volume[86574]: INFO cinder.image.image_utils [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] Converted 112.00 MB image at 47.21 MB/s Nov 01 12:34:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-88fb2d2b-03f6-4314-9002-9734f72b3496 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:34:57 devstack sudo[103598]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-88fb2d2b-03f6-4314-9002-9734f72b3496 1G Nov 01 12:34:57 devstack sudo[103598]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:34:57 devstack sudo[103598]: pam_unix(sudo:session): session closed for user root Nov 01 12:34:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-88fb2d2b-03f6-4314-9002-9734f72b3496 1G" returned: 0 in 0.331s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:34:57 devstack cinder-volume[86574]: DEBUG cinder.volume.volume_utils [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] Downloaded image d1828316-01ac-4ae9-b5c5-b4c07c9680b3 ((None, [{'url': 'file:///opt/stack/data/glance/images/d1828316-01ac-4ae9-b5c5-b4c07c9680b3', 'metadata': {}}])) to volume 88fb2d2b-03f6-4314-9002-9734f72b3496 successfully. {{(pid=86574) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 01 12:34:57 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] Temporary image d1828316-01ac-4ae9-b5c5-b4c07c9680b3 for user acca9d51b7354a5ebe86dc9bf387dbee is deleted. {{(pid=86574) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 01 12:34:57 devstack cinder-volume[86574]: DEBUG cinder.volume.volume_utils [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] Marking volume 88fb2d2b-03f6-4314-9002-9734f72b3496 as bootable. {{(pid=86574) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 01 12:34:57 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] Copying metadata from image d1828316-01ac-4ae9-b5c5-b4c07c9680b3 to 88fb2d2b-03f6-4314-9002-9734f72b3496. {{(pid=86574) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 01 12:34:57 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] Creating volume glance metadata for volume 88fb2d2b-03f6-4314-9002-9734f72b3496 backed by image d1828316-01ac-4ae9-b5c5-b4c07c9680b3 with: {'image_id': 'd1828316-01ac-4ae9-b5c5-b4c07c9680b3', 'image_name': 'tempest-scenario-img--1405968405', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=86574) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 01 12:34:57 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fb3e6ddc-f9f0-454f-b423-77b51ae86733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-88fb2d2b-03f6-4314-9002-9734f72b3496', 'volume_size': 1, 'image_id': 'd1828316-01ac-4ae9-b5c5-b4c07c9680b3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d1828316-01ac-4ae9-b5c5-b4c07c9680b3', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1405968405', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '975202a2ff8f4154a8b4f4101f0fc7d3', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd1828316-01ac-4ae9-b5c5-b4c07c9680b3', 'created_at': datetime.datetime(2026, 11, 1, 11, 34, 43, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 34, 45, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d1828316-01ac-4ae9-b5c5-b4c07c9680b3/file', 'properties': {}}, 'image_service': }' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:57 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a531d24-d9d6-4dbb-a287-c6b3b42c4939) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:34:57 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] Volume volume-88fb2d2b-03f6-4314-9002-9734f72b3496 (88fb2d2b-03f6-4314-9002-9734f72b3496): created successfully Nov 01 12:34:57 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a531d24-d9d6-4dbb-a287-c6b3b42c4939) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:34:57 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] Flow 'volume_create_manager' (fbba116d-3784-4520-83fc-5156c92ea7f5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:34:57 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-f47b8aa8-c30e-4d28-8ad8-1807e182caef tempest-TestInstancesWithCinderVolumes-864439911 None] Created volume successfully. Nov 01 12:35:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-1f7d9cc0-21c5-454f-a723-b3a4a702bdc4 req-c3d408fe-311a-4f2b-a753-011ebf0a439b tempest-TestInstancesWithCinderVolumes-864439911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:35:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-1f7d9cc0-21c5-454f-a723-b3a4a702bdc4 req-c3d408fe-311a-4f2b-a753-011ebf0a439b tempest-TestInstancesWithCinderVolumes-864439911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:35:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-1f7d9cc0-21c5-454f-a723-b3a4a702bdc4 req-c3d408fe-311a-4f2b-a753-011ebf0a439b tempest-TestInstancesWithCinderVolumes-864439911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.022s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:35:01 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-1f7d9cc0-21c5-454f-a723-b3a4a702bdc4 req-c3d408fe-311a-4f2b-a753-011ebf0a439b tempest-TestInstancesWithCinderVolumes-864439911 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb', 'name': 'volume-88fb2d2b-03f6-4314-9002-9734f72b3496', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '31fcf206-67ce-4a59-8137-3f8eff016d42', 'enforce_multipath': True} {{(pid=86574) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 12:35:01 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-1f7d9cc0-21c5-454f-a723-b3a4a702bdc4 req-c3d408fe-311a-4f2b-a753-011ebf0a439b tempest-TestInstancesWithCinderVolumes-864439911 None] attachment_update completed successfully. Nov 01 12:35:11 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:SELECT=53,cinder:INSERT=12,cinder:UPDATE=36,cinder:DELETE=2 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:35:18 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:SELECT=47,cinder:UPDATE=44,cinder:DELETE=4,cinder:INSERT=13 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:35:19 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-9360685c-361c-44ed-a59b-0a98432bf430 req-3f70a4a6-fd64-445d-bf55-73dd4a824699 tempest-TestMinimumBasicScenario-44221468 None] Terminate volume connection completed successfully. Nov 01 12:35:19 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-9360685c-361c-44ed-a59b-0a98432bf430 req-3f70a4a6-fd64-445d-bf55-73dd4a824699 tempest-TestMinimumBasicScenario-44221468 None] Deleting attachment 7d64e4b6-8e96-4100-806b-5aee8f25c64d. {{(pid=86574) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 12:35:20 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6643f3a5-f29c-4eb2-9e8a-7aee1ed0963a tempest-TestMinimumBasicScenario-44221468 None] Acquiring lock "cinder-0dd3cdc6-f381-4aa6-96d3-ab0aede37eed-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:35:20 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6643f3a5-f29c-4eb2-9e8a-7aee1ed0963a tempest-TestMinimumBasicScenario-44221468 None] Lock "cinder-0dd3cdc6-f381-4aa6-96d3-ab0aede37eed-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:35:20 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-3db7c099-338a-4620-adb9-0f251bc2bf65 tempest-ProjectReaderTests-764189810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:35:20 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-3db7c099-338a-4620-adb9-0f251bc2bf65 tempest-ProjectReaderTests-764189810 None] Flow 'volume_create_manager' (5a762806-7895-4d27-ac24-a3819b5f515f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:35:20 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-3db7c099-338a-4620-adb9-0f251bc2bf65 tempest-ProjectReaderTests-764189810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b39d8313-5f01-4f15-a67a-423acd612e23) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:20 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-3db7c099-338a-4620-adb9-0f251bc2bf65 tempest-ProjectReaderTests-764189810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b39d8313-5f01-4f15-a67a-423acd612e23) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1966552006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bf4cfa2-4b91-40ac-b23f-ee7070c94e0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68671b11c898495eb9c6db6d22632e4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:35:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:35:20Z,use_quota=True,user_id='0fdf1c77475f43a6a4c374455bb7fba5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:20 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-3db7c099-338a-4620-adb9-0f251bc2bf65 tempest-ProjectReaderTests-764189810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95e74be4-f2d2-4ebe-9edc-69038a9d0b34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:20 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-3db7c099-338a-4620-adb9-0f251bc2bf65 tempest-ProjectReaderTests-764189810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (95e74be4-f2d2-4ebe-9edc-69038a9d0b34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:20 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-3db7c099-338a-4620-adb9-0f251bc2bf65 tempest-ProjectReaderTests-764189810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72e054af-4119-4f2b-a8ad-e770c884bc11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:20 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-3db7c099-338a-4620-adb9-0f251bc2bf65 tempest-ProjectReaderTests-764189810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72e054af-4119-4f2b-a8ad-e770c884bc11) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0bf4cfa2-4b91-40ac-b23f-ee7070c94e0b', 'volume_name': 'volume-0bf4cfa2-4b91-40ac-b23f-ee7070c94e0b', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:20 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-3db7c099-338a-4620-adb9-0f251bc2bf65 tempest-ProjectReaderTests-764189810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd89c588-e790-42f2-b01a-a40a5f69473c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:20 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-3db7c099-338a-4620-adb9-0f251bc2bf65 tempest-ProjectReaderTests-764189810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cd89c588-e790-42f2-b01a-a40a5f69473c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:20 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-3db7c099-338a-4620-adb9-0f251bc2bf65 tempest-ProjectReaderTests-764189810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e27073f-b26e-43ce-adac-b740dcc4eaec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:20 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-3db7c099-338a-4620-adb9-0f251bc2bf65 tempest-ProjectReaderTests-764189810 None] Volume 0bf4cfa2-4b91-40ac-b23f-ee7070c94e0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0bf4cfa2-4b91-40ac-b23f-ee7070c94e0b', 'volume_size': 1} Nov 01 12:35:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-3db7c099-338a-4620-adb9-0f251bc2bf65 tempest-ProjectReaderTests-764189810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:35:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-3db7c099-338a-4620-adb9-0f251bc2bf65 tempest-ProjectReaderTests-764189810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:35:20 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-3db7c099-338a-4620-adb9-0f251bc2bf65 tempest-ProjectReaderTests-764189810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:35:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1966552006',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0bf4cfa2-4b91-40ac-b23f-ee7070c94e0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68671b11c898495eb9c6db6d22632e4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:35:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:35:20Z,use_quota=True,user_id='0fdf1c77475f43a6a4c374455bb7fba5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:35:20 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-3db7c099-338a-4620-adb9-0f251bc2bf65 tempest-ProjectReaderTests-764189810 None] Creating volume 0bf4cfa2-4b91-40ac-b23f-ee7070c94e0b {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:35:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-3db7c099-338a-4620-adb9-0f251bc2bf65 tempest-ProjectReaderTests-764189810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:35:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-3db7c099-338a-4620-adb9-0f251bc2bf65 tempest-ProjectReaderTests-764189810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:35:20 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-3db7c099-338a-4620-adb9-0f251bc2bf65 tempest-ProjectReaderTests-764189810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:35:20 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-3db7c099-338a-4620-adb9-0f251bc2bf65 tempest-ProjectReaderTests-764189810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:35:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-3db7c099-338a-4620-adb9-0f251bc2bf65 tempest-ProjectReaderTests-764189810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:35:20 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-3db7c099-338a-4620-adb9-0f251bc2bf65 tempest-ProjectReaderTests-764189810 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:35:20 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-3db7c099-338a-4620-adb9-0f251bc2bf65 tempest-ProjectReaderTests-764189810 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:35:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3db7c099-338a-4620-adb9-0f251bc2bf65 tempest-ProjectReaderTests-764189810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0bf4cfa2-4b91-40ac-b23f-ee7070c94e0b 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:20 devstack sudo[103723]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0bf4cfa2-4b91-40ac-b23f-ee7070c94e0b 1073741824 Nov 01 12:35:20 devstack sudo[103723]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:20 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6643f3a5-f29c-4eb2-9e8a-7aee1ed0963a tempest-TestMinimumBasicScenario-44221468 None] Acquiring lock "cinder-quobyte-0dd3cdc6-f381-4aa6-96d3-ab0aede37eed" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:35:20 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6643f3a5-f29c-4eb2-9e8a-7aee1ed0963a tempest-TestMinimumBasicScenario-44221468 None] Lock "cinder-quobyte-0dd3cdc6-f381-4aa6-96d3-ab0aede37eed" acquired by "delete_volume" :: waited 0.022s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:35:20 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef43b258-f255-44f7-a29f-b5acc645439b]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:35:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6643f3a5-f29c-4eb2-9e8a-7aee1ed0963a tempest-TestMinimumBasicScenario-44221468 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0dd3cdc6-f381-4aa6-96d3-ab0aede37eed {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:20 devstack sudo[103725]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0dd3cdc6-f381-4aa6-96d3-ab0aede37eed Nov 01 12:35:20 devstack sudo[103725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:20 devstack sudo[103723]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3db7c099-338a-4620-adb9-0f251bc2bf65 tempest-ProjectReaderTests-764189810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0bf4cfa2-4b91-40ac-b23f-ee7070c94e0b 1073741824" returned: 0 in 0.423s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3db7c099-338a-4620-adb9-0f251bc2bf65 tempest-ProjectReaderTests-764189810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0bf4cfa2-4b91-40ac-b23f-ee7070c94e0b {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:20 devstack sudo[103735]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0bf4cfa2-4b91-40ac-b23f-ee7070c94e0b Nov 01 12:35:20 devstack sudo[103735]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:20 devstack sudo[103725]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6643f3a5-f29c-4eb2-9e8a-7aee1ed0963a tempest-TestMinimumBasicScenario-44221468 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0dd3cdc6-f381-4aa6-96d3-ab0aede37eed" returned: 0 in 0.422s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6643f3a5-f29c-4eb2-9e8a-7aee1ed0963a tempest-TestMinimumBasicScenario-44221468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0dd3cdc6-f381-4aa6-96d3-ab0aede37eed {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:20 devstack sudo[103737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0dd3cdc6-f381-4aa6-96d3-ab0aede37eed Nov 01 12:35:20 devstack sudo[103737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:21 devstack sudo[103735]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3db7c099-338a-4620-adb9-0f251bc2bf65 tempest-ProjectReaderTests-764189810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0bf4cfa2-4b91-40ac-b23f-ee7070c94e0b" returned: 0 in 0.280s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:21 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-3db7c099-338a-4620-adb9-0f251bc2bf65 tempest-ProjectReaderTests-764189810 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:35:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-3db7c099-338a-4620-adb9-0f251bc2bf65 tempest-ProjectReaderTests-764189810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.758s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:35:21 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-3db7c099-338a-4620-adb9-0f251bc2bf65 tempest-ProjectReaderTests-764189810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e27073f-b26e-43ce-adac-b740dcc4eaec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0bf4cfa2-4b91-40ac-b23f-ee7070c94e0b', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:21 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-3db7c099-338a-4620-adb9-0f251bc2bf65 tempest-ProjectReaderTests-764189810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20b287ef-e0e7-4125-ac0c-769683412e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:21 devstack sudo[103737]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6643f3a5-f29c-4eb2-9e8a-7aee1ed0963a tempest-TestMinimumBasicScenario-44221468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0dd3cdc6-f381-4aa6-96d3-ab0aede37eed" returned: 0 in 0.260s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:21 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6643f3a5-f29c-4eb2-9e8a-7aee1ed0963a tempest-TestMinimumBasicScenario-44221468 None] Lock "cinder-quobyte-0dd3cdc6-f381-4aa6-96d3-ab0aede37eed" released by "delete_volume" :: held 0.747s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:35:21 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-3db7c099-338a-4620-adb9-0f251bc2bf65 tempest-ProjectReaderTests-764189810 None] Volume volume-0bf4cfa2-4b91-40ac-b23f-ee7070c94e0b (0bf4cfa2-4b91-40ac-b23f-ee7070c94e0b): created successfully Nov 01 12:35:21 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-3db7c099-338a-4620-adb9-0f251bc2bf65 tempest-ProjectReaderTests-764189810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (20b287ef-e0e7-4125-ac0c-769683412e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:21 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-3db7c099-338a-4620-adb9-0f251bc2bf65 tempest-ProjectReaderTests-764189810 None] Flow 'volume_create_manager' (5a762806-7895-4d27-ac24-a3819b5f515f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:35:21 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-3db7c099-338a-4620-adb9-0f251bc2bf65 tempest-ProjectReaderTests-764189810 None] Created volume successfully. Nov 01 12:35:21 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-6643f3a5-f29c-4eb2-9e8a-7aee1ed0963a tempest-TestMinimumBasicScenario-44221468 None] Created reservations ['44808131-d75b-492c-b010-76c780eb242a', '577acd31-acd1-4ae4-a9c6-eb4d12daab61', 'ab4a0461-8f85-426c-995d-17ec5edb3363', 'a4b10493-f0c5-409f-a325-b6fe0d3020e7'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:35:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-6643f3a5-f29c-4eb2-9e8a-7aee1ed0963a tempest-TestMinimumBasicScenario-44221468 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:35:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-6643f3a5-f29c-4eb2-9e8a-7aee1ed0963a tempest-TestMinimumBasicScenario-44221468 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:35:21 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-6643f3a5-f29c-4eb2-9e8a-7aee1ed0963a tempest-TestMinimumBasicScenario-44221468 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:35:21 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-6643f3a5-f29c-4eb2-9e8a-7aee1ed0963a tempest-TestMinimumBasicScenario-44221468 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:35:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-6643f3a5-f29c-4eb2-9e8a-7aee1ed0963a tempest-TestMinimumBasicScenario-44221468 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:35:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6643f3a5-f29c-4eb2-9e8a-7aee1ed0963a tempest-TestMinimumBasicScenario-44221468 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:21 devstack sudo[103741]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:35:21 devstack sudo[103741]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:21 devstack sudo[103741]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6643f3a5-f29c-4eb2-9e8a-7aee1ed0963a tempest-TestMinimumBasicScenario-44221468 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.274s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:21 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-6643f3a5-f29c-4eb2-9e8a-7aee1ed0963a tempest-TestMinimumBasicScenario-44221468 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:35:21 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-6643f3a5-f29c-4eb2-9e8a-7aee1ed0963a tempest-TestMinimumBasicScenario-44221468 None] Deleted volume successfully. Nov 01 12:35:21 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6643f3a5-f29c-4eb2-9e8a-7aee1ed0963a tempest-TestMinimumBasicScenario-44221468 None] Lock "cinder-0dd3cdc6-f381-4aa6-96d3-ab0aede37eed-delete_volume" released by "delete_volume" :: held 1.408s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:35:22 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-662299d6-b389-4b77-9dab-eb292259a529 tempest-ProjectReaderTests-764189810 None] Acquiring lock "cinder-0bf4cfa2-4b91-40ac-b23f-ee7070c94e0b-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:35:22 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-662299d6-b389-4b77-9dab-eb292259a529 tempest-ProjectReaderTests-764189810 None] Lock "cinder-0bf4cfa2-4b91-40ac-b23f-ee7070c94e0b-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:35:22 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-662299d6-b389-4b77-9dab-eb292259a529 tempest-ProjectReaderTests-764189810 None] Acquiring lock "cinder-quobyte-0bf4cfa2-4b91-40ac-b23f-ee7070c94e0b" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:35:22 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-662299d6-b389-4b77-9dab-eb292259a529 tempest-ProjectReaderTests-764189810 None] Lock "cinder-quobyte-0bf4cfa2-4b91-40ac-b23f-ee7070c94e0b" acquired by "delete_volume" :: waited 0.025s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:35:22 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[341b350d-7836-43f2-b73f-18d2764724fd]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:35:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-662299d6-b389-4b77-9dab-eb292259a529 tempest-ProjectReaderTests-764189810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0bf4cfa2-4b91-40ac-b23f-ee7070c94e0b {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:22 devstack sudo[103766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0bf4cfa2-4b91-40ac-b23f-ee7070c94e0b Nov 01 12:35:22 devstack sudo[103766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:23 devstack sudo[103766]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-662299d6-b389-4b77-9dab-eb292259a529 tempest-ProjectReaderTests-764189810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0bf4cfa2-4b91-40ac-b23f-ee7070c94e0b" returned: 0 in 0.642s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-662299d6-b389-4b77-9dab-eb292259a529 tempest-ProjectReaderTests-764189810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0bf4cfa2-4b91-40ac-b23f-ee7070c94e0b {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:23 devstack sudo[103783]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0bf4cfa2-4b91-40ac-b23f-ee7070c94e0b Nov 01 12:35:23 devstack sudo[103783]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:23 devstack sudo[103783]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-662299d6-b389-4b77-9dab-eb292259a529 tempest-ProjectReaderTests-764189810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0bf4cfa2-4b91-40ac-b23f-ee7070c94e0b" returned: 0 in 0.295s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:23 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-662299d6-b389-4b77-9dab-eb292259a529 tempest-ProjectReaderTests-764189810 None] Lock "cinder-quobyte-0bf4cfa2-4b91-40ac-b23f-ee7070c94e0b" released by "delete_volume" :: held 1.051s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:35:23 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-662299d6-b389-4b77-9dab-eb292259a529 tempest-ProjectReaderTests-764189810 None] Created reservations ['4d8a466d-edcb-4f8a-b8e5-1cda001c8f32', '53ebe74c-5112-4a13-a0b6-df0171c3e600', '59e0a17f-cb50-4c26-9adb-c03be27daca8', 'a47551fb-c3ba-41a7-8abc-794daeb2c492'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:35:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-662299d6-b389-4b77-9dab-eb292259a529 tempest-ProjectReaderTests-764189810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:35:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-662299d6-b389-4b77-9dab-eb292259a529 tempest-ProjectReaderTests-764189810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:35:23 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-662299d6-b389-4b77-9dab-eb292259a529 tempest-ProjectReaderTests-764189810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:35:23 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-662299d6-b389-4b77-9dab-eb292259a529 tempest-ProjectReaderTests-764189810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:35:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-662299d6-b389-4b77-9dab-eb292259a529 tempest-ProjectReaderTests-764189810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:35:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-662299d6-b389-4b77-9dab-eb292259a529 tempest-ProjectReaderTests-764189810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:23 devstack sudo[103786]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:35:23 devstack sudo[103786]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:24 devstack sudo[103786]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-662299d6-b389-4b77-9dab-eb292259a529 tempest-ProjectReaderTests-764189810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.257s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:24 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-662299d6-b389-4b77-9dab-eb292259a529 tempest-ProjectReaderTests-764189810 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:35:24 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-662299d6-b389-4b77-9dab-eb292259a529 tempest-ProjectReaderTests-764189810 None] Deleted volume successfully. Nov 01 12:35:24 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-662299d6-b389-4b77-9dab-eb292259a529 tempest-ProjectReaderTests-764189810 None] Lock "cinder-0bf4cfa2-4b91-40ac-b23f-ee7070c94e0b-delete_volume" released by "delete_volume" :: held 1.580s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:35:25 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-38fbac12-305e-4134-8a41-b90df46fdb18 tempest-ProjectReaderTests-764189810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:35:25 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-38fbac12-305e-4134-8a41-b90df46fdb18 tempest-ProjectReaderTests-764189810 None] Flow 'volume_create_manager' (7e8e08ab-9c3a-443f-84ed-f2116fdea6bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:35:25 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-38fbac12-305e-4134-8a41-b90df46fdb18 tempest-ProjectReaderTests-764189810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c56fc3f0-e317-4033-8654-73fd7c5f3bc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:25 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-38fbac12-305e-4134-8a41-b90df46fdb18 tempest-ProjectReaderTests-764189810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c56fc3f0-e317-4033-8654-73fd7c5f3bc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-667596975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbae1ea6-665a-46af-9dac-61278344c838,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68671b11c898495eb9c6db6d22632e4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:35:25Z,use_quota=True,user_id='0fdf1c77475f43a6a4c374455bb7fba5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:25 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-38fbac12-305e-4134-8a41-b90df46fdb18 tempest-ProjectReaderTests-764189810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a608c25-86c9-4911-88c7-a76002b892fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:25 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-38fbac12-305e-4134-8a41-b90df46fdb18 tempest-ProjectReaderTests-764189810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2a608c25-86c9-4911-88c7-a76002b892fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:25 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-38fbac12-305e-4134-8a41-b90df46fdb18 tempest-ProjectReaderTests-764189810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7207083c-10dd-40f1-8434-264f75489134) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:25 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-38fbac12-305e-4134-8a41-b90df46fdb18 tempest-ProjectReaderTests-764189810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7207083c-10dd-40f1-8434-264f75489134) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fbae1ea6-665a-46af-9dac-61278344c838', 'volume_name': 'volume-fbae1ea6-665a-46af-9dac-61278344c838', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:25 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-38fbac12-305e-4134-8a41-b90df46fdb18 tempest-ProjectReaderTests-764189810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d28aff0b-e596-4a14-8f74-87ea7173c7fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:25 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-38fbac12-305e-4134-8a41-b90df46fdb18 tempest-ProjectReaderTests-764189810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d28aff0b-e596-4a14-8f74-87ea7173c7fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:25 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-38fbac12-305e-4134-8a41-b90df46fdb18 tempest-ProjectReaderTests-764189810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbba27a0-c64b-4395-9ea2-06407824a3b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:25 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-38fbac12-305e-4134-8a41-b90df46fdb18 tempest-ProjectReaderTests-764189810 None] Volume fbae1ea6-665a-46af-9dac-61278344c838: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fbae1ea6-665a-46af-9dac-61278344c838', 'volume_size': 1} Nov 01 12:35:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-38fbac12-305e-4134-8a41-b90df46fdb18 tempest-ProjectReaderTests-764189810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:35:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-38fbac12-305e-4134-8a41-b90df46fdb18 tempest-ProjectReaderTests-764189810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:35:25 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-38fbac12-305e-4134-8a41-b90df46fdb18 tempest-ProjectReaderTests-764189810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:35:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-667596975',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fbae1ea6-665a-46af-9dac-61278344c838,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68671b11c898495eb9c6db6d22632e4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:35:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:35:25Z,use_quota=True,user_id='0fdf1c77475f43a6a4c374455bb7fba5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:35:25 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-38fbac12-305e-4134-8a41-b90df46fdb18 tempest-ProjectReaderTests-764189810 None] Creating volume fbae1ea6-665a-46af-9dac-61278344c838 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:35:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-38fbac12-305e-4134-8a41-b90df46fdb18 tempest-ProjectReaderTests-764189810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:35:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-38fbac12-305e-4134-8a41-b90df46fdb18 tempest-ProjectReaderTests-764189810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:35:25 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-38fbac12-305e-4134-8a41-b90df46fdb18 tempest-ProjectReaderTests-764189810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:35:25 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-38fbac12-305e-4134-8a41-b90df46fdb18 tempest-ProjectReaderTests-764189810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:35:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-38fbac12-305e-4134-8a41-b90df46fdb18 tempest-ProjectReaderTests-764189810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:35:25 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-38fbac12-305e-4134-8a41-b90df46fdb18 tempest-ProjectReaderTests-764189810 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:35:25 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-38fbac12-305e-4134-8a41-b90df46fdb18 tempest-ProjectReaderTests-764189810 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:35:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-38fbac12-305e-4134-8a41-b90df46fdb18 tempest-ProjectReaderTests-764189810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fbae1ea6-665a-46af-9dac-61278344c838 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:25 devstack sudo[103789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fbae1ea6-665a-46af-9dac-61278344c838 1073741824 Nov 01 12:35:25 devstack sudo[103789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:25 devstack sudo[103789]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-38fbac12-305e-4134-8a41-b90df46fdb18 tempest-ProjectReaderTests-764189810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fbae1ea6-665a-46af-9dac-61278344c838 1073741824" returned: 0 in 0.507s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-38fbac12-305e-4134-8a41-b90df46fdb18 tempest-ProjectReaderTests-764189810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fbae1ea6-665a-46af-9dac-61278344c838 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:26 devstack sudo[103796]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fbae1ea6-665a-46af-9dac-61278344c838 Nov 01 12:35:26 devstack sudo[103796]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:26 devstack sudo[103796]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-38fbac12-305e-4134-8a41-b90df46fdb18 tempest-ProjectReaderTests-764189810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fbae1ea6-665a-46af-9dac-61278344c838" returned: 0 in 0.251s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:26 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-38fbac12-305e-4134-8a41-b90df46fdb18 tempest-ProjectReaderTests-764189810 None] <== create_volume: return (797ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:35:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-38fbac12-305e-4134-8a41-b90df46fdb18 tempest-ProjectReaderTests-764189810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:35:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-38fbac12-305e-4134-8a41-b90df46fdb18 tempest-ProjectReaderTests-764189810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cbba27a0-c64b-4395-9ea2-06407824a3b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fbae1ea6-665a-46af-9dac-61278344c838', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-38fbac12-305e-4134-8a41-b90df46fdb18 tempest-ProjectReaderTests-764189810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf7847ed-a6f0-48e3-aa50-06cfbaf3f623) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:26 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-38fbac12-305e-4134-8a41-b90df46fdb18 tempest-ProjectReaderTests-764189810 None] Volume volume-fbae1ea6-665a-46af-9dac-61278344c838 (fbae1ea6-665a-46af-9dac-61278344c838): created successfully Nov 01 12:35:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-38fbac12-305e-4134-8a41-b90df46fdb18 tempest-ProjectReaderTests-764189810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bf7847ed-a6f0-48e3-aa50-06cfbaf3f623) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-38fbac12-305e-4134-8a41-b90df46fdb18 tempest-ProjectReaderTests-764189810 None] Flow 'volume_create_manager' (7e8e08ab-9c3a-443f-84ed-f2116fdea6bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:35:26 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-38fbac12-305e-4134-8a41-b90df46fdb18 tempest-ProjectReaderTests-764189810 None] Created volume successfully. Nov 01 12:35:27 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ffeed10e-92dd-4727-9ecf-9109583cfe9c tempest-ProjectReaderTests-764189810 None] Acquiring lock "cinder-fbae1ea6-665a-46af-9dac-61278344c838-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:35:27 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ffeed10e-92dd-4727-9ecf-9109583cfe9c tempest-ProjectReaderTests-764189810 None] Lock "cinder-fbae1ea6-665a-46af-9dac-61278344c838-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:35:27 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ffeed10e-92dd-4727-9ecf-9109583cfe9c tempest-ProjectReaderTests-764189810 None] Acquiring lock "cinder-quobyte-fbae1ea6-665a-46af-9dac-61278344c838" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:35:27 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ffeed10e-92dd-4727-9ecf-9109583cfe9c tempest-ProjectReaderTests-764189810 None] Lock "cinder-quobyte-fbae1ea6-665a-46af-9dac-61278344c838" acquired by "delete_volume" :: waited 0.018s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:35:27 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[5cf47a16-9f45-4b67-9f42-6e0156b69641]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:35:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ffeed10e-92dd-4727-9ecf-9109583cfe9c tempest-ProjectReaderTests-764189810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fbae1ea6-665a-46af-9dac-61278344c838 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:27 devstack sudo[103800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fbae1ea6-665a-46af-9dac-61278344c838 Nov 01 12:35:27 devstack sudo[103800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:28 devstack sudo[103800]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ffeed10e-92dd-4727-9ecf-9109583cfe9c tempest-ProjectReaderTests-764189810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fbae1ea6-665a-46af-9dac-61278344c838" returned: 0 in 0.447s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ffeed10e-92dd-4727-9ecf-9109583cfe9c tempest-ProjectReaderTests-764189810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fbae1ea6-665a-46af-9dac-61278344c838 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:28 devstack sudo[103805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fbae1ea6-665a-46af-9dac-61278344c838 Nov 01 12:35:28 devstack sudo[103805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:28 devstack sudo[103805]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ffeed10e-92dd-4727-9ecf-9109583cfe9c tempest-ProjectReaderTests-764189810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fbae1ea6-665a-46af-9dac-61278344c838" returned: 0 in 0.251s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:28 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ffeed10e-92dd-4727-9ecf-9109583cfe9c tempest-ProjectReaderTests-764189810 None] Lock "cinder-quobyte-fbae1ea6-665a-46af-9dac-61278344c838" released by "delete_volume" :: held 0.751s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:35:28 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-ffeed10e-92dd-4727-9ecf-9109583cfe9c tempest-ProjectReaderTests-764189810 None] Created reservations ['bb24ae1f-9fc1-4420-a806-2fc9aa99c9de', '6cefcc12-b2d6-40e5-b846-a13b8ef7e5e8', 'dd9173b9-7910-48f6-8c09-c8a24e805a97', '82a97c20-fc38-476e-9bae-876ac9a11e9a'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:35:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ffeed10e-92dd-4727-9ecf-9109583cfe9c tempest-ProjectReaderTests-764189810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:35:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ffeed10e-92dd-4727-9ecf-9109583cfe9c tempest-ProjectReaderTests-764189810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:35:28 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ffeed10e-92dd-4727-9ecf-9109583cfe9c tempest-ProjectReaderTests-764189810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:35:28 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ffeed10e-92dd-4727-9ecf-9109583cfe9c tempest-ProjectReaderTests-764189810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:35:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ffeed10e-92dd-4727-9ecf-9109583cfe9c tempest-ProjectReaderTests-764189810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:35:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ffeed10e-92dd-4727-9ecf-9109583cfe9c tempest-ProjectReaderTests-764189810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:28 devstack sudo[103810]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:35:28 devstack sudo[103810]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:28 devstack sudo[103810]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ffeed10e-92dd-4727-9ecf-9109583cfe9c tempest-ProjectReaderTests-764189810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.290s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:28 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-ffeed10e-92dd-4727-9ecf-9109583cfe9c tempest-ProjectReaderTests-764189810 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:35:28 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-ffeed10e-92dd-4727-9ecf-9109583cfe9c tempest-ProjectReaderTests-764189810 None] Deleted volume successfully. Nov 01 12:35:28 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ffeed10e-92dd-4727-9ecf-9109583cfe9c tempest-ProjectReaderTests-764189810 None] Lock "cinder-fbae1ea6-665a-46af-9dac-61278344c838-delete_volume" released by "delete_volume" :: held 1.287s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:35:29 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-e49e8233-aba9-4539-a36a-8e65ebd5d123 tempest-ProjectReaderTests-764189810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:35:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e49e8233-aba9-4539-a36a-8e65ebd5d123 tempest-ProjectReaderTests-764189810 None] Flow 'volume_create_manager' (a0fa8715-b367-47dc-ab9c-b2cb89ef602f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:35:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e49e8233-aba9-4539-a36a-8e65ebd5d123 tempest-ProjectReaderTests-764189810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1de70d0c-2504-447f-8877-b185e877683b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e49e8233-aba9-4539-a36a-8e65ebd5d123 tempest-ProjectReaderTests-764189810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1de70d0c-2504-447f-8877-b185e877683b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-777150148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03376b34-448c-4ebb-97a2-e578f300026a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68671b11c898495eb9c6db6d22632e4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:35:29Z,use_quota=True,user_id='0fdf1c77475f43a6a4c374455bb7fba5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e49e8233-aba9-4539-a36a-8e65ebd5d123 tempest-ProjectReaderTests-764189810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5735e85-e89c-49f8-8b70-a11561661da8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e49e8233-aba9-4539-a36a-8e65ebd5d123 tempest-ProjectReaderTests-764189810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c5735e85-e89c-49f8-8b70-a11561661da8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e49e8233-aba9-4539-a36a-8e65ebd5d123 tempest-ProjectReaderTests-764189810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90ae2001-b9c8-4341-bf77-40c6c8267313) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e49e8233-aba9-4539-a36a-8e65ebd5d123 tempest-ProjectReaderTests-764189810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (90ae2001-b9c8-4341-bf77-40c6c8267313) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03376b34-448c-4ebb-97a2-e578f300026a', 'volume_name': 'volume-03376b34-448c-4ebb-97a2-e578f300026a', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e49e8233-aba9-4539-a36a-8e65ebd5d123 tempest-ProjectReaderTests-764189810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (515cc73c-37b1-4bf3-8746-4cb269741ac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e49e8233-aba9-4539-a36a-8e65ebd5d123 tempest-ProjectReaderTests-764189810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (515cc73c-37b1-4bf3-8746-4cb269741ac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e49e8233-aba9-4539-a36a-8e65ebd5d123 tempest-ProjectReaderTests-764189810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e44d59a-ef99-46c4-8772-b55706782c7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:29 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-e49e8233-aba9-4539-a36a-8e65ebd5d123 tempest-ProjectReaderTests-764189810 None] Volume 03376b34-448c-4ebb-97a2-e578f300026a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03376b34-448c-4ebb-97a2-e578f300026a', 'volume_size': 1} Nov 01 12:35:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e49e8233-aba9-4539-a36a-8e65ebd5d123 tempest-ProjectReaderTests-764189810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:35:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e49e8233-aba9-4539-a36a-8e65ebd5d123 tempest-ProjectReaderTests-764189810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:35:29 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e49e8233-aba9-4539-a36a-8e65ebd5d123 tempest-ProjectReaderTests-764189810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:35:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-777150148',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=03376b34-448c-4ebb-97a2-e578f300026a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68671b11c898495eb9c6db6d22632e4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:35:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:35:29Z,use_quota=True,user_id='0fdf1c77475f43a6a4c374455bb7fba5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:35:29 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-e49e8233-aba9-4539-a36a-8e65ebd5d123 tempest-ProjectReaderTests-764189810 None] Creating volume 03376b34-448c-4ebb-97a2-e578f300026a {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:35:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e49e8233-aba9-4539-a36a-8e65ebd5d123 tempest-ProjectReaderTests-764189810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:35:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e49e8233-aba9-4539-a36a-8e65ebd5d123 tempest-ProjectReaderTests-764189810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:35:29 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e49e8233-aba9-4539-a36a-8e65ebd5d123 tempest-ProjectReaderTests-764189810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:35:29 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e49e8233-aba9-4539-a36a-8e65ebd5d123 tempest-ProjectReaderTests-764189810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:35:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e49e8233-aba9-4539-a36a-8e65ebd5d123 tempest-ProjectReaderTests-764189810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:35:29 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e49e8233-aba9-4539-a36a-8e65ebd5d123 tempest-ProjectReaderTests-764189810 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:35:29 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-e49e8233-aba9-4539-a36a-8e65ebd5d123 tempest-ProjectReaderTests-764189810 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:35:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e49e8233-aba9-4539-a36a-8e65ebd5d123 tempest-ProjectReaderTests-764189810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-03376b34-448c-4ebb-97a2-e578f300026a 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:29 devstack sudo[103813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-03376b34-448c-4ebb-97a2-e578f300026a 1073741824 Nov 01 12:35:29 devstack sudo[103813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:29 devstack sudo[103813]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e49e8233-aba9-4539-a36a-8e65ebd5d123 tempest-ProjectReaderTests-764189810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-03376b34-448c-4ebb-97a2-e578f300026a 1073741824" returned: 0 in 0.559s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e49e8233-aba9-4539-a36a-8e65ebd5d123 tempest-ProjectReaderTests-764189810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-03376b34-448c-4ebb-97a2-e578f300026a {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:29 devstack sudo[103819]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-03376b34-448c-4ebb-97a2-e578f300026a Nov 01 12:35:29 devstack sudo[103819]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:30 devstack sudo[103819]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e49e8233-aba9-4539-a36a-8e65ebd5d123 tempest-ProjectReaderTests-764189810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-03376b34-448c-4ebb-97a2-e578f300026a" returned: 0 in 0.307s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:30 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e49e8233-aba9-4539-a36a-8e65ebd5d123 tempest-ProjectReaderTests-764189810 None] <== create_volume: return (923ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:35:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e49e8233-aba9-4539-a36a-8e65ebd5d123 tempest-ProjectReaderTests-764189810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.926s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:35:30 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e49e8233-aba9-4539-a36a-8e65ebd5d123 tempest-ProjectReaderTests-764189810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8e44d59a-ef99-46c4-8772-b55706782c7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03376b34-448c-4ebb-97a2-e578f300026a', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:30 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e49e8233-aba9-4539-a36a-8e65ebd5d123 tempest-ProjectReaderTests-764189810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9eae878-51c1-4283-966a-e230a5f73be5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:30 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-e49e8233-aba9-4539-a36a-8e65ebd5d123 tempest-ProjectReaderTests-764189810 None] Volume volume-03376b34-448c-4ebb-97a2-e578f300026a (03376b34-448c-4ebb-97a2-e578f300026a): created successfully Nov 01 12:35:30 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e49e8233-aba9-4539-a36a-8e65ebd5d123 tempest-ProjectReaderTests-764189810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a9eae878-51c1-4283-966a-e230a5f73be5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:30 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e49e8233-aba9-4539-a36a-8e65ebd5d123 tempest-ProjectReaderTests-764189810 None] Flow 'volume_create_manager' (a0fa8715-b367-47dc-ab9c-b2cb89ef602f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:35:30 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-e49e8233-aba9-4539-a36a-8e65ebd5d123 tempest-ProjectReaderTests-764189810 None] Created volume successfully. Nov 01 12:35:31 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-93a1ced7-22d6-4941-bdd7-ddb4b9d712b1 tempest-ProjectReaderTests-764189810 None] Acquiring lock "cinder-03376b34-448c-4ebb-97a2-e578f300026a-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:35:31 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-93a1ced7-22d6-4941-bdd7-ddb4b9d712b1 tempest-ProjectReaderTests-764189810 None] Lock "cinder-03376b34-448c-4ebb-97a2-e578f300026a-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:35:31 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-93a1ced7-22d6-4941-bdd7-ddb4b9d712b1 tempest-ProjectReaderTests-764189810 None] Acquiring lock "cinder-quobyte-03376b34-448c-4ebb-97a2-e578f300026a" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:35:31 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-93a1ced7-22d6-4941-bdd7-ddb4b9d712b1 tempest-ProjectReaderTests-764189810 None] Lock "cinder-quobyte-03376b34-448c-4ebb-97a2-e578f300026a" acquired by "delete_volume" :: waited 0.015s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:35:31 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[b17db0d9-9a64-439b-ac17-6e95e5bf8f7f]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:35:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-93a1ced7-22d6-4941-bdd7-ddb4b9d712b1 tempest-ProjectReaderTests-764189810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-03376b34-448c-4ebb-97a2-e578f300026a {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:31 devstack sudo[103828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-03376b34-448c-4ebb-97a2-e578f300026a Nov 01 12:35:31 devstack sudo[103828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:31 devstack sudo[103828]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-93a1ced7-22d6-4941-bdd7-ddb4b9d712b1 tempest-ProjectReaderTests-764189810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-03376b34-448c-4ebb-97a2-e578f300026a" returned: 0 in 0.390s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-93a1ced7-22d6-4941-bdd7-ddb4b9d712b1 tempest-ProjectReaderTests-764189810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-03376b34-448c-4ebb-97a2-e578f300026a {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:31 devstack sudo[103833]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-03376b34-448c-4ebb-97a2-e578f300026a Nov 01 12:35:31 devstack sudo[103833]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:32 devstack sudo[103833]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-93a1ced7-22d6-4941-bdd7-ddb4b9d712b1 tempest-ProjectReaderTests-764189810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-03376b34-448c-4ebb-97a2-e578f300026a" returned: 0 in 0.292s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:32 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-93a1ced7-22d6-4941-bdd7-ddb4b9d712b1 tempest-ProjectReaderTests-764189810 None] Lock "cinder-quobyte-03376b34-448c-4ebb-97a2-e578f300026a" released by "delete_volume" :: held 0.736s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:35:32 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-93a1ced7-22d6-4941-bdd7-ddb4b9d712b1 tempest-ProjectReaderTests-764189810 None] Created reservations ['051f5a65-a84c-4001-bdc5-b790ef81280c', 'b2f1deb0-f65f-44a7-b157-3404b429f423', '999c9ee8-f565-41ed-ba97-ef15b8cdbffa', 'ac138fd6-10f0-44b9-8c6b-a7fcc83e33e7'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:35:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-93a1ced7-22d6-4941-bdd7-ddb4b9d712b1 tempest-ProjectReaderTests-764189810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:35:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-93a1ced7-22d6-4941-bdd7-ddb4b9d712b1 tempest-ProjectReaderTests-764189810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:35:32 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-93a1ced7-22d6-4941-bdd7-ddb4b9d712b1 tempest-ProjectReaderTests-764189810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:35:32 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-93a1ced7-22d6-4941-bdd7-ddb4b9d712b1 tempest-ProjectReaderTests-764189810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:35:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-93a1ced7-22d6-4941-bdd7-ddb4b9d712b1 tempest-ProjectReaderTests-764189810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:35:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-93a1ced7-22d6-4941-bdd7-ddb4b9d712b1 tempest-ProjectReaderTests-764189810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:32 devstack sudo[103836]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:35:32 devstack sudo[103836]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:32 devstack sudo[103836]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-93a1ced7-22d6-4941-bdd7-ddb4b9d712b1 tempest-ProjectReaderTests-764189810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.284s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:32 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-93a1ced7-22d6-4941-bdd7-ddb4b9d712b1 tempest-ProjectReaderTests-764189810 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:35:32 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-93a1ced7-22d6-4941-bdd7-ddb4b9d712b1 tempest-ProjectReaderTests-764189810 None] Deleted volume successfully. Nov 01 12:35:32 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-93a1ced7-22d6-4941-bdd7-ddb4b9d712b1 tempest-ProjectReaderTests-764189810 None] Lock "cinder-03376b34-448c-4ebb-97a2-e578f300026a-delete_volume" released by "delete_volume" :: held 1.333s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:35:33 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ed7b3ca-fb34-49a5-b69b-8739fdd39398 tempest-ProjectReaderTests-764189810 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:35:33 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6ed7b3ca-fb34-49a5-b69b-8739fdd39398 tempest-ProjectReaderTests-764189810 None] Flow 'volume_create_manager' (398a3d7f-7a66-45a2-a7f8-ee6b939fa39e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:35:33 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6ed7b3ca-fb34-49a5-b69b-8739fdd39398 tempest-ProjectReaderTests-764189810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d12d66e9-b517-433f-ad75-b9d9c9bd372e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:33 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6ed7b3ca-fb34-49a5-b69b-8739fdd39398 tempest-ProjectReaderTests-764189810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d12d66e9-b517-433f-ad75-b9d9c9bd372e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:35:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-103729035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdd638c5-81f3-4be9-a294-58389b8640ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68671b11c898495eb9c6db6d22632e4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:35:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:35:33Z,use_quota=True,user_id='0fdf1c77475f43a6a4c374455bb7fba5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:33 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6ed7b3ca-fb34-49a5-b69b-8739fdd39398 tempest-ProjectReaderTests-764189810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c42e2fd-35c0-4da3-8d8b-0dbef82dfc73) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:33 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6ed7b3ca-fb34-49a5-b69b-8739fdd39398 tempest-ProjectReaderTests-764189810 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8c42e2fd-35c0-4da3-8d8b-0dbef82dfc73) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:33 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6ed7b3ca-fb34-49a5-b69b-8739fdd39398 tempest-ProjectReaderTests-764189810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (381763d7-c96f-41b0-8d5a-57574c5ee182) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:33 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6ed7b3ca-fb34-49a5-b69b-8739fdd39398 tempest-ProjectReaderTests-764189810 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (381763d7-c96f-41b0-8d5a-57574c5ee182) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fdd638c5-81f3-4be9-a294-58389b8640ab', 'volume_name': 'volume-fdd638c5-81f3-4be9-a294-58389b8640ab', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:33 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6ed7b3ca-fb34-49a5-b69b-8739fdd39398 tempest-ProjectReaderTests-764189810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13c07cb7-6eea-4906-a01e-08b3292758cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:33 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6ed7b3ca-fb34-49a5-b69b-8739fdd39398 tempest-ProjectReaderTests-764189810 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (13c07cb7-6eea-4906-a01e-08b3292758cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:33 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6ed7b3ca-fb34-49a5-b69b-8739fdd39398 tempest-ProjectReaderTests-764189810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fe2aae8-f29d-47e7-a925-8a5ef9574fb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:33 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-6ed7b3ca-fb34-49a5-b69b-8739fdd39398 tempest-ProjectReaderTests-764189810 None] Volume fdd638c5-81f3-4be9-a294-58389b8640ab: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fdd638c5-81f3-4be9-a294-58389b8640ab', 'volume_size': 1} Nov 01 12:35:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-6ed7b3ca-fb34-49a5-b69b-8739fdd39398 tempest-ProjectReaderTests-764189810 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:35:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-6ed7b3ca-fb34-49a5-b69b-8739fdd39398 tempest-ProjectReaderTests-764189810 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:35:33 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-6ed7b3ca-fb34-49a5-b69b-8739fdd39398 tempest-ProjectReaderTests-764189810 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:35:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-103729035',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fdd638c5-81f3-4be9-a294-58389b8640ab,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68671b11c898495eb9c6db6d22632e4d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:35:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:35:33Z,use_quota=True,user_id='0fdf1c77475f43a6a4c374455bb7fba5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:35:33 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-6ed7b3ca-fb34-49a5-b69b-8739fdd39398 tempest-ProjectReaderTests-764189810 None] Creating volume fdd638c5-81f3-4be9-a294-58389b8640ab {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:35:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-6ed7b3ca-fb34-49a5-b69b-8739fdd39398 tempest-ProjectReaderTests-764189810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:35:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-6ed7b3ca-fb34-49a5-b69b-8739fdd39398 tempest-ProjectReaderTests-764189810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:35:33 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-6ed7b3ca-fb34-49a5-b69b-8739fdd39398 tempest-ProjectReaderTests-764189810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:35:33 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-6ed7b3ca-fb34-49a5-b69b-8739fdd39398 tempest-ProjectReaderTests-764189810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:35:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-6ed7b3ca-fb34-49a5-b69b-8739fdd39398 tempest-ProjectReaderTests-764189810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:35:33 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-6ed7b3ca-fb34-49a5-b69b-8739fdd39398 tempest-ProjectReaderTests-764189810 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:35:33 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-6ed7b3ca-fb34-49a5-b69b-8739fdd39398 tempest-ProjectReaderTests-764189810 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:35:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6ed7b3ca-fb34-49a5-b69b-8739fdd39398 tempest-ProjectReaderTests-764189810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fdd638c5-81f3-4be9-a294-58389b8640ab 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:33 devstack sudo[103840]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fdd638c5-81f3-4be9-a294-58389b8640ab 1073741824 Nov 01 12:35:33 devstack sudo[103840]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:33 devstack sudo[103840]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6ed7b3ca-fb34-49a5-b69b-8739fdd39398 tempest-ProjectReaderTests-764189810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fdd638c5-81f3-4be9-a294-58389b8640ab 1073741824" returned: 0 in 0.457s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6ed7b3ca-fb34-49a5-b69b-8739fdd39398 tempest-ProjectReaderTests-764189810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fdd638c5-81f3-4be9-a294-58389b8640ab {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:33 devstack sudo[103846]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fdd638c5-81f3-4be9-a294-58389b8640ab Nov 01 12:35:33 devstack sudo[103846]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:34 devstack sudo[103846]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6ed7b3ca-fb34-49a5-b69b-8739fdd39398 tempest-ProjectReaderTests-764189810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fdd638c5-81f3-4be9-a294-58389b8640ab" returned: 0 in 0.256s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:34 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-6ed7b3ca-fb34-49a5-b69b-8739fdd39398 tempest-ProjectReaderTests-764189810 None] <== create_volume: return (758ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:35:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-6ed7b3ca-fb34-49a5-b69b-8739fdd39398 tempest-ProjectReaderTests-764189810 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.761s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:35:34 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6ed7b3ca-fb34-49a5-b69b-8739fdd39398 tempest-ProjectReaderTests-764189810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1fe2aae8-f29d-47e7-a925-8a5ef9574fb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fdd638c5-81f3-4be9-a294-58389b8640ab', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:34 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6ed7b3ca-fb34-49a5-b69b-8739fdd39398 tempest-ProjectReaderTests-764189810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61708d6b-8ba5-45e6-9c12-382a8bffa168) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:34 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-6ed7b3ca-fb34-49a5-b69b-8739fdd39398 tempest-ProjectReaderTests-764189810 None] Volume volume-fdd638c5-81f3-4be9-a294-58389b8640ab (fdd638c5-81f3-4be9-a294-58389b8640ab): created successfully Nov 01 12:35:34 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6ed7b3ca-fb34-49a5-b69b-8739fdd39398 tempest-ProjectReaderTests-764189810 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61708d6b-8ba5-45e6-9c12-382a8bffa168) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:34 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6ed7b3ca-fb34-49a5-b69b-8739fdd39398 tempest-ProjectReaderTests-764189810 None] Flow 'volume_create_manager' (398a3d7f-7a66-45a2-a7f8-ee6b939fa39e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:35:34 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-6ed7b3ca-fb34-49a5-b69b-8739fdd39398 tempest-ProjectReaderTests-764189810 None] Created volume successfully. Nov 01 12:35:35 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f1a286fe-cb4c-4df7-839d-a0f6bda24ec7 tempest-ProjectReaderTests-764189810 None] Acquiring lock "cinder-fdd638c5-81f3-4be9-a294-58389b8640ab-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:35:35 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f1a286fe-cb4c-4df7-839d-a0f6bda24ec7 tempest-ProjectReaderTests-764189810 None] Lock "cinder-fdd638c5-81f3-4be9-a294-58389b8640ab-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:35:35 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f1a286fe-cb4c-4df7-839d-a0f6bda24ec7 tempest-ProjectReaderTests-764189810 None] Acquiring lock "cinder-quobyte-fdd638c5-81f3-4be9-a294-58389b8640ab" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:35:35 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f1a286fe-cb4c-4df7-839d-a0f6bda24ec7 tempest-ProjectReaderTests-764189810 None] Lock "cinder-quobyte-fdd638c5-81f3-4be9-a294-58389b8640ab" acquired by "delete_volume" :: waited 0.029s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:35:35 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[5ce82a17-c3b6-4156-9634-7c224e6c8c81]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:35:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f1a286fe-cb4c-4df7-839d-a0f6bda24ec7 tempest-ProjectReaderTests-764189810 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fdd638c5-81f3-4be9-a294-58389b8640ab {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:35 devstack sudo[103856]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fdd638c5-81f3-4be9-a294-58389b8640ab Nov 01 12:35:35 devstack sudo[103856]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-1abcb3b2-18ae-4172-a184-2b022af464da req-1c7840d0-ca24-421a-8adf-3517f48e04bc tempest-TestInstancesWithCinderVolumes-864439911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:35:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-1abcb3b2-18ae-4172-a184-2b022af464da req-1c7840d0-ca24-421a-8adf-3517f48e04bc tempest-TestInstancesWithCinderVolumes-864439911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:35:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-1abcb3b2-18ae-4172-a184-2b022af464da req-1c7840d0-ca24-421a-8adf-3517f48e04bc tempest-TestInstancesWithCinderVolumes-864439911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.014s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:35:35 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-1abcb3b2-18ae-4172-a184-2b022af464da req-1c7840d0-ca24-421a-8adf-3517f48e04bc tempest-TestInstancesWithCinderVolumes-864439911 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb', 'name': 'volume-e5949383-d126-4b76-aad7-f5faf1ddb88e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '71fdb959-7c7c-446d-bf67-db9a2d545a42', 'enforce_multipath': True} {{(pid=86574) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 12:35:35 devstack sudo[103856]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f1a286fe-cb4c-4df7-839d-a0f6bda24ec7 tempest-ProjectReaderTests-764189810 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fdd638c5-81f3-4be9-a294-58389b8640ab" returned: 0 in 0.424s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f1a286fe-cb4c-4df7-839d-a0f6bda24ec7 tempest-ProjectReaderTests-764189810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fdd638c5-81f3-4be9-a294-58389b8640ab {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:35 devstack sudo[103869]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fdd638c5-81f3-4be9-a294-58389b8640ab Nov 01 12:35:35 devstack sudo[103869]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:35 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-1abcb3b2-18ae-4172-a184-2b022af464da req-1c7840d0-ca24-421a-8adf-3517f48e04bc tempest-TestInstancesWithCinderVolumes-864439911 None] attachment_update completed successfully. Nov 01 12:35:36 devstack sudo[103869]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f1a286fe-cb4c-4df7-839d-a0f6bda24ec7 tempest-ProjectReaderTests-764189810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fdd638c5-81f3-4be9-a294-58389b8640ab" returned: 0 in 0.301s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:36 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f1a286fe-cb4c-4df7-839d-a0f6bda24ec7 tempest-ProjectReaderTests-764189810 None] Lock "cinder-quobyte-fdd638c5-81f3-4be9-a294-58389b8640ab" released by "delete_volume" :: held 0.800s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:35:36 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-f1a286fe-cb4c-4df7-839d-a0f6bda24ec7 tempest-ProjectReaderTests-764189810 None] Created reservations ['19a3a121-64f7-4fa0-969d-12260d5217df', '0d200c8a-89c5-485d-b666-b0bf45041e07', 'c32d6714-7ee9-4a75-8f98-e9d107558d08', '3ad32dfe-85e7-4335-b1f5-46c900a694c0'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:35:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f1a286fe-cb4c-4df7-839d-a0f6bda24ec7 tempest-ProjectReaderTests-764189810 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:35:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f1a286fe-cb4c-4df7-839d-a0f6bda24ec7 tempest-ProjectReaderTests-764189810 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:35:36 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f1a286fe-cb4c-4df7-839d-a0f6bda24ec7 tempest-ProjectReaderTests-764189810 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:35:36 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f1a286fe-cb4c-4df7-839d-a0f6bda24ec7 tempest-ProjectReaderTests-764189810 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:35:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f1a286fe-cb4c-4df7-839d-a0f6bda24ec7 tempest-ProjectReaderTests-764189810 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:35:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f1a286fe-cb4c-4df7-839d-a0f6bda24ec7 tempest-ProjectReaderTests-764189810 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:36 devstack sudo[103874]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:35:36 devstack sudo[103874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:36 devstack sudo[103874]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f1a286fe-cb4c-4df7-839d-a0f6bda24ec7 tempest-ProjectReaderTests-764189810 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.327s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:36 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-f1a286fe-cb4c-4df7-839d-a0f6bda24ec7 tempest-ProjectReaderTests-764189810 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:35:36 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-f1a286fe-cb4c-4df7-839d-a0f6bda24ec7 tempest-ProjectReaderTests-764189810 None] Deleted volume successfully. Nov 01 12:35:36 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f1a286fe-cb4c-4df7-839d-a0f6bda24ec7 tempest-ProjectReaderTests-764189810 None] Lock "cinder-fdd638c5-81f3-4be9-a294-58389b8640ab-delete_volume" released by "delete_volume" :: held 1.486s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:35:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-37787783-b3e6-48bb-814c-2f742c690e98 req-6d3e2379-35f2-48e2-b0b7-9dcc1d27c84b tempest-TestInstancesWithCinderVolumes-864439911 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:35:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-37787783-b3e6-48bb-814c-2f742c690e98 req-6d3e2379-35f2-48e2-b0b7-9dcc1d27c84b tempest-TestInstancesWithCinderVolumes-864439911 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:35:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-37787783-b3e6-48bb-814c-2f742c690e98 req-6d3e2379-35f2-48e2-b0b7-9dcc1d27c84b tempest-TestInstancesWithCinderVolumes-864439911 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.012s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:35:38 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-37787783-b3e6-48bb-814c-2f742c690e98 req-6d3e2379-35f2-48e2-b0b7-9dcc1d27c84b tempest-TestInstancesWithCinderVolumes-864439911 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb', 'name': 'volume-d87eff6f-656a-4d6d-8ef7-4e32da41184e', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '72b802ea-abad-4b77-a4ea-a01b812ff611', 'enforce_multipath': True} {{(pid=86574) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 12:35:38 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-37787783-b3e6-48bb-814c-2f742c690e98 req-6d3e2379-35f2-48e2-b0b7-9dcc1d27c84b tempest-TestInstancesWithCinderVolumes-864439911 None] attachment_update completed successfully. Nov 01 12:35:39 devstack cinder-volume[86574]: DEBUG oslo_service.periodic_task [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86574) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:35:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:35:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:35:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:35:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:35:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:35:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:39 devstack sudo[103905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:35:39 devstack sudo[103905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:40 devstack sudo[103905]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.270s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:40 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:35:40 devstack cinder-volume[86574]: DEBUG oslo_service.periodic_task [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running periodic task VolumeManager._thread_info {{(pid=86574) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:35:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] thread count: 28 {{(pid=86574) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 12:35:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] thread info: [<_MainThread(MainThread, started 131331184930944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86574) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 12:35:43 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-7dc4ff73-188b-4454-be74-89de36bd80b7 req-ed91ae9d-6cd0-4bbc-a863-820488072ccc tempest-TestInstancesWithCinderVolumes-864439911 None] Terminate volume connection completed successfully. Nov 01 12:35:43 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-7dc4ff73-188b-4454-be74-89de36bd80b7 req-ed91ae9d-6cd0-4bbc-a863-820488072ccc tempest-TestInstancesWithCinderVolumes-864439911 None] Deleting attachment 71fdb959-7c7c-446d-bf67-db9a2d545a42. {{(pid=86574) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 12:35:44 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-5894a021-5f5f-44f0-9a71-29ef195e7dbe tempest-TestInstancesWithCinderVolumes-864439911 None] Acquiring lock "cinder-e5949383-d126-4b76-aad7-f5faf1ddb88e-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:35:44 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-5894a021-5f5f-44f0-9a71-29ef195e7dbe tempest-TestInstancesWithCinderVolumes-864439911 None] Lock "cinder-e5949383-d126-4b76-aad7-f5faf1ddb88e-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:35:44 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-5894a021-5f5f-44f0-9a71-29ef195e7dbe tempest-TestInstancesWithCinderVolumes-864439911 None] Acquiring lock "cinder-quobyte-e5949383-d126-4b76-aad7-f5faf1ddb88e" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:35:44 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-5894a021-5f5f-44f0-9a71-29ef195e7dbe tempest-TestInstancesWithCinderVolumes-864439911 None] Lock "cinder-quobyte-e5949383-d126-4b76-aad7-f5faf1ddb88e" acquired by "delete_volume" :: waited 0.018s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:35:44 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[b4688e45-f899-4908-8447-c3c2a294c426]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:35:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5894a021-5f5f-44f0-9a71-29ef195e7dbe tempest-TestInstancesWithCinderVolumes-864439911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e5949383-d126-4b76-aad7-f5faf1ddb88e {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:44 devstack sudo[103977]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e5949383-d126-4b76-aad7-f5faf1ddb88e Nov 01 12:35:44 devstack sudo[103977]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:45 devstack sudo[103977]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5894a021-5f5f-44f0-9a71-29ef195e7dbe tempest-TestInstancesWithCinderVolumes-864439911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e5949383-d126-4b76-aad7-f5faf1ddb88e" returned: 0 in 0.427s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5894a021-5f5f-44f0-9a71-29ef195e7dbe tempest-TestInstancesWithCinderVolumes-864439911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e5949383-d126-4b76-aad7-f5faf1ddb88e {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:45 devstack sudo[103984]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e5949383-d126-4b76-aad7-f5faf1ddb88e Nov 01 12:35:45 devstack sudo[103984]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:45 devstack sudo[103984]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5894a021-5f5f-44f0-9a71-29ef195e7dbe tempest-TestInstancesWithCinderVolumes-864439911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e5949383-d126-4b76-aad7-f5faf1ddb88e" returned: 0 in 0.293s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:45 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-5894a021-5f5f-44f0-9a71-29ef195e7dbe tempest-TestInstancesWithCinderVolumes-864439911 None] Lock "cinder-quobyte-e5949383-d126-4b76-aad7-f5faf1ddb88e" released by "delete_volume" :: held 0.780s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:35:45 devstack cinder-volume[86574]: WARNING cinder.quota [None req-5894a021-5f5f-44f0-9a71-29ef195e7dbe tempest-TestInstancesWithCinderVolumes-864439911 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2071788690-1373103678 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2071788690-1373103678, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:35:45 devstack cinder-volume[86574]: WARNING cinder.quota [None req-5894a021-5f5f-44f0-9a71-29ef195e7dbe tempest-TestInstancesWithCinderVolumes-864439911 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2071788690-1373103678 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2071788690-1373103678, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:35:45 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-5894a021-5f5f-44f0-9a71-29ef195e7dbe tempest-TestInstancesWithCinderVolumes-864439911 None] Created reservations ['c9d051d8-b99d-479d-a479-6beaa144b412', 'd9b243b6-ab30-42e1-b91e-9c99f2584d4a', 'f802eb98-dd93-4cb1-9be4-bfb6348ca51f', '71da59d7-9729-451d-8f65-5021753a335c'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:35:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5894a021-5f5f-44f0-9a71-29ef195e7dbe tempest-TestInstancesWithCinderVolumes-864439911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:35:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5894a021-5f5f-44f0-9a71-29ef195e7dbe tempest-TestInstancesWithCinderVolumes-864439911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:35:45 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-5894a021-5f5f-44f0-9a71-29ef195e7dbe tempest-TestInstancesWithCinderVolumes-864439911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:35:45 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-5894a021-5f5f-44f0-9a71-29ef195e7dbe tempest-TestInstancesWithCinderVolumes-864439911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:35:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5894a021-5f5f-44f0-9a71-29ef195e7dbe tempest-TestInstancesWithCinderVolumes-864439911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:35:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5894a021-5f5f-44f0-9a71-29ef195e7dbe tempest-TestInstancesWithCinderVolumes-864439911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:45 devstack sudo[103987]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:35:45 devstack sudo[103987]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:46 devstack sudo[103987]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5894a021-5f5f-44f0-9a71-29ef195e7dbe tempest-TestInstancesWithCinderVolumes-864439911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.316s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:46 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-5894a021-5f5f-44f0-9a71-29ef195e7dbe tempest-TestInstancesWithCinderVolumes-864439911 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:35:46 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-5894a021-5f5f-44f0-9a71-29ef195e7dbe tempest-TestInstancesWithCinderVolumes-864439911 None] Deleted volume successfully. Nov 01 12:35:46 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-5894a021-5f5f-44f0-9a71-29ef195e7dbe tempest-TestInstancesWithCinderVolumes-864439911 None] Lock "cinder-e5949383-d126-4b76-aad7-f5faf1ddb88e-delete_volume" released by "delete_volume" :: held 1.351s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:35:49 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-65a76e00-5a8b-4fad-9e09-1749fa1bb922 req-b83de951-4918-474d-9938-0e79a3861b14 tempest-TestInstancesWithCinderVolumes-864439911 None] Terminate volume connection completed successfully. Nov 01 12:35:49 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-65a76e00-5a8b-4fad-9e09-1749fa1bb922 req-b83de951-4918-474d-9938-0e79a3861b14 tempest-TestInstancesWithCinderVolumes-864439911 None] Deleting attachment 72b802ea-abad-4b77-a4ea-a01b812ff611. {{(pid=86574) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 12:35:49 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a6dbff54-5b2f-4315-b1b3-4f93fa510a7d tempest-TestInstancesWithCinderVolumes-864439911 None] Acquiring lock "cinder-d87eff6f-656a-4d6d-8ef7-4e32da41184e-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:35:49 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a6dbff54-5b2f-4315-b1b3-4f93fa510a7d tempest-TestInstancesWithCinderVolumes-864439911 None] Lock "cinder-d87eff6f-656a-4d6d-8ef7-4e32da41184e-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:35:49 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a6dbff54-5b2f-4315-b1b3-4f93fa510a7d tempest-TestInstancesWithCinderVolumes-864439911 None] Acquiring lock "cinder-quobyte-d87eff6f-656a-4d6d-8ef7-4e32da41184e" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:35:49 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a6dbff54-5b2f-4315-b1b3-4f93fa510a7d tempest-TestInstancesWithCinderVolumes-864439911 None] Lock "cinder-quobyte-d87eff6f-656a-4d6d-8ef7-4e32da41184e" acquired by "delete_volume" :: waited 0.022s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:35:49 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a1eed39-d28a-4d30-b1be-4ecd8953c01f]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:35:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a6dbff54-5b2f-4315-b1b3-4f93fa510a7d tempest-TestInstancesWithCinderVolumes-864439911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d87eff6f-656a-4d6d-8ef7-4e32da41184e {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:50 devstack sudo[104014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d87eff6f-656a-4d6d-8ef7-4e32da41184e Nov 01 12:35:50 devstack sudo[104014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:50 devstack sudo[104014]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a6dbff54-5b2f-4315-b1b3-4f93fa510a7d tempest-TestInstancesWithCinderVolumes-864439911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d87eff6f-656a-4d6d-8ef7-4e32da41184e" returned: 0 in 0.429s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a6dbff54-5b2f-4315-b1b3-4f93fa510a7d tempest-TestInstancesWithCinderVolumes-864439911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d87eff6f-656a-4d6d-8ef7-4e32da41184e {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:50 devstack sudo[104019]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d87eff6f-656a-4d6d-8ef7-4e32da41184e Nov 01 12:35:50 devstack sudo[104019]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:50 devstack sudo[104019]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a6dbff54-5b2f-4315-b1b3-4f93fa510a7d tempest-TestInstancesWithCinderVolumes-864439911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d87eff6f-656a-4d6d-8ef7-4e32da41184e" returned: 0 in 0.273s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:50 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a6dbff54-5b2f-4315-b1b3-4f93fa510a7d tempest-TestInstancesWithCinderVolumes-864439911 None] Lock "cinder-quobyte-d87eff6f-656a-4d6d-8ef7-4e32da41184e" released by "delete_volume" :: held 0.786s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:35:50 devstack cinder-volume[86574]: WARNING cinder.quota [None req-a6dbff54-5b2f-4315-b1b3-4f93fa510a7d tempest-TestInstancesWithCinderVolumes-864439911 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2063700735-230212593 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2063700735-230212593, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:35:50 devstack cinder-volume[86574]: WARNING cinder.quota [None req-a6dbff54-5b2f-4315-b1b3-4f93fa510a7d tempest-TestInstancesWithCinderVolumes-864439911 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2063700735-230212593 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2063700735-230212593, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:35:50 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-a6dbff54-5b2f-4315-b1b3-4f93fa510a7d tempest-TestInstancesWithCinderVolumes-864439911 None] Created reservations ['f483a7a1-0d46-4e69-9ad1-63c6ecc90510', '2bb44d66-6faf-4304-aac9-e280eb82d111', '2ef6cf2a-a2d3-4c7f-bc7f-01776e3bf2d6', 'e7b3ffe6-f1c3-49b1-ae33-d8106e4a9e73'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:35:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a6dbff54-5b2f-4315-b1b3-4f93fa510a7d tempest-TestInstancesWithCinderVolumes-864439911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:35:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a6dbff54-5b2f-4315-b1b3-4f93fa510a7d tempest-TestInstancesWithCinderVolumes-864439911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:35:50 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a6dbff54-5b2f-4315-b1b3-4f93fa510a7d tempest-TestInstancesWithCinderVolumes-864439911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:35:50 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a6dbff54-5b2f-4315-b1b3-4f93fa510a7d tempest-TestInstancesWithCinderVolumes-864439911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:35:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a6dbff54-5b2f-4315-b1b3-4f93fa510a7d tempest-TestInstancesWithCinderVolumes-864439911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:35:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a6dbff54-5b2f-4315-b1b3-4f93fa510a7d tempest-TestInstancesWithCinderVolumes-864439911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:50 devstack sudo[104022]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:35:50 devstack sudo[104022]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:51 devstack sudo[104022]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a6dbff54-5b2f-4315-b1b3-4f93fa510a7d tempest-TestInstancesWithCinderVolumes-864439911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.304s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:51 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-a6dbff54-5b2f-4315-b1b3-4f93fa510a7d tempest-TestInstancesWithCinderVolumes-864439911 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:35:51 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-a6dbff54-5b2f-4315-b1b3-4f93fa510a7d tempest-TestInstancesWithCinderVolumes-864439911 None] Deleted volume successfully. Nov 01 12:35:51 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a6dbff54-5b2f-4315-b1b3-4f93fa510a7d tempest-TestInstancesWithCinderVolumes-864439911 None] Lock "cinder-d87eff6f-656a-4d6d-8ef7-4e32da41184e-delete_volume" released by "delete_volume" :: held 1.380s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:35:54 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-2a25114e-bdc5-4bc4-905d-f410901aba1c req-9459ca8b-97e5-4660-a6a1-67b36a26e289 tempest-TestInstancesWithCinderVolumes-864439911 None] Terminate volume connection completed successfully. Nov 01 12:35:54 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-2a25114e-bdc5-4bc4-905d-f410901aba1c req-9459ca8b-97e5-4660-a6a1-67b36a26e289 tempest-TestInstancesWithCinderVolumes-864439911 None] Deleting attachment 31fcf206-67ce-4a59-8137-3f8eff016d42. {{(pid=86574) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 12:35:56 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-02332d28-85f4-415b-bdc6-457bd8391d54 tempest-TestInstancesWithCinderVolumes-864439911 None] Acquiring lock "cinder-88fb2d2b-03f6-4314-9002-9734f72b3496-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:35:56 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-02332d28-85f4-415b-bdc6-457bd8391d54 tempest-TestInstancesWithCinderVolumes-864439911 None] Lock "cinder-88fb2d2b-03f6-4314-9002-9734f72b3496-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:35:56 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-02332d28-85f4-415b-bdc6-457bd8391d54 tempest-TestInstancesWithCinderVolumes-864439911 None] Acquiring lock "cinder-quobyte-88fb2d2b-03f6-4314-9002-9734f72b3496" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:35:56 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-02332d28-85f4-415b-bdc6-457bd8391d54 tempest-TestInstancesWithCinderVolumes-864439911 None] Lock "cinder-quobyte-88fb2d2b-03f6-4314-9002-9734f72b3496" acquired by "delete_volume" :: waited 0.020s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:35:56 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[ab8ac42f-c6aa-4491-9642-0806fe9aa31b]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:35:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-02332d28-85f4-415b-bdc6-457bd8391d54 tempest-TestInstancesWithCinderVolumes-864439911 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-88fb2d2b-03f6-4314-9002-9734f72b3496 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:56 devstack sudo[104050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-88fb2d2b-03f6-4314-9002-9734f72b3496 Nov 01 12:35:56 devstack sudo[104050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:56 devstack sudo[104050]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-02332d28-85f4-415b-bdc6-457bd8391d54 tempest-TestInstancesWithCinderVolumes-864439911 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-88fb2d2b-03f6-4314-9002-9734f72b3496" returned: 0 in 0.403s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-02332d28-85f4-415b-bdc6-457bd8391d54 tempest-TestInstancesWithCinderVolumes-864439911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-88fb2d2b-03f6-4314-9002-9734f72b3496 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:56 devstack sudo[104056]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-88fb2d2b-03f6-4314-9002-9734f72b3496 Nov 01 12:35:56 devstack sudo[104056]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:56 devstack sudo[104056]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-02332d28-85f4-415b-bdc6-457bd8391d54 tempest-TestInstancesWithCinderVolumes-864439911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-88fb2d2b-03f6-4314-9002-9734f72b3496" returned: 0 in 0.319s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:56 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-02332d28-85f4-415b-bdc6-457bd8391d54 tempest-TestInstancesWithCinderVolumes-864439911 None] Lock "cinder-quobyte-88fb2d2b-03f6-4314-9002-9734f72b3496" released by "delete_volume" :: held 0.777s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:35:56 devstack cinder-volume[86574]: WARNING cinder.quota [None req-02332d28-85f4-415b-bdc6-457bd8391d54 tempest-TestInstancesWithCinderVolumes-864439911 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1637250023-1282363105 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1637250023-1282363105, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:35:56 devstack cinder-volume[86574]: WARNING cinder.quota [None req-02332d28-85f4-415b-bdc6-457bd8391d54 tempest-TestInstancesWithCinderVolumes-864439911 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1637250023-1282363105 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1637250023-1282363105, it is now deprecated. Please use the default quota class for default quota. Nov 01 12:35:56 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-02332d28-85f4-415b-bdc6-457bd8391d54 tempest-TestInstancesWithCinderVolumes-864439911 None] Created reservations ['0350aa19-d637-4426-9c42-0f1b4284535c', 'ebe99753-f6c3-4363-8db2-eb47421ab05c', 'a582403b-a9fe-4f95-b7d1-c8cf9e50d905', '8eba6171-8afa-4fe6-8a59-ffb3dc0d396a'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:35:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-02332d28-85f4-415b-bdc6-457bd8391d54 tempest-TestInstancesWithCinderVolumes-864439911 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:35:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-02332d28-85f4-415b-bdc6-457bd8391d54 tempest-TestInstancesWithCinderVolumes-864439911 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:35:57 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-02332d28-85f4-415b-bdc6-457bd8391d54 tempest-TestInstancesWithCinderVolumes-864439911 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:35:57 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-02332d28-85f4-415b-bdc6-457bd8391d54 tempest-TestInstancesWithCinderVolumes-864439911 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:35:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-02332d28-85f4-415b-bdc6-457bd8391d54 tempest-TestInstancesWithCinderVolumes-864439911 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:35:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-02332d28-85f4-415b-bdc6-457bd8391d54 tempest-TestInstancesWithCinderVolumes-864439911 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:57 devstack sudo[104059]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:35:57 devstack sudo[104059]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:57 devstack sudo[104059]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-02332d28-85f4-415b-bdc6-457bd8391d54 tempest-TestInstancesWithCinderVolumes-864439911 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.256s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:57 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-02332d28-85f4-415b-bdc6-457bd8391d54 tempest-TestInstancesWithCinderVolumes-864439911 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:35:57 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-02332d28-85f4-415b-bdc6-457bd8391d54 tempest-TestInstancesWithCinderVolumes-864439911 None] Deleted volume successfully. Nov 01 12:35:57 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-02332d28-85f4-415b-bdc6-457bd8391d54 tempest-TestInstancesWithCinderVolumes-864439911 None] Lock "cinder-88fb2d2b-03f6-4314-9002-9734f72b3496-delete_volume" released by "delete_volume" :: held 1.325s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:35:58 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-02ffd5b0-5b6f-4167-8dea-2f06274217ef tempest-TestImageHashVerification-242503956 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:35:58 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-02ffd5b0-5b6f-4167-8dea-2f06274217ef tempest-TestImageHashVerification-242503956 None] Flow 'volume_create_manager' (e78d87ec-424b-4f8c-b962-3ddf1c28491a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:35:58 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-02ffd5b0-5b6f-4167-8dea-2f06274217ef tempest-TestImageHashVerification-242503956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eecbe37a-7056-4cc7-abc0-61397711672f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:58 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-02ffd5b0-5b6f-4167-8dea-2f06274217ef tempest-TestImageHashVerification-242503956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (eecbe37a-7056-4cc7-abc0-61397711672f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:35:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1847960410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b2d4c48-fa51-461d-9dee-b80c93ce98a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68ddcc5ddb6f466f9d075d2dab01da38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:35:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:35:58Z,use_quota=True,user_id='4e93846434ff4109856edbf0f430d2e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:58 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-02ffd5b0-5b6f-4167-8dea-2f06274217ef tempest-TestImageHashVerification-242503956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e35a292-19bc-4a9a-b3c4-9eb8a27ae0e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:58 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-02ffd5b0-5b6f-4167-8dea-2f06274217ef tempest-TestImageHashVerification-242503956 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4e35a292-19bc-4a9a-b3c4-9eb8a27ae0e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:58 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-02ffd5b0-5b6f-4167-8dea-2f06274217ef tempest-TestImageHashVerification-242503956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb0a06ef-1873-4910-a1fd-8f9786d1a2f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:58 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-02ffd5b0-5b6f-4167-8dea-2f06274217ef tempest-TestImageHashVerification-242503956 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bb0a06ef-1873-4910-a1fd-8f9786d1a2f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7b2d4c48-fa51-461d-9dee-b80c93ce98a6', 'volume_name': 'volume-7b2d4c48-fa51-461d-9dee-b80c93ce98a6', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:58 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-02ffd5b0-5b6f-4167-8dea-2f06274217ef tempest-TestImageHashVerification-242503956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7059215a-b6af-46e7-bd1e-d19658dd7bd9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:58 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-02ffd5b0-5b6f-4167-8dea-2f06274217ef tempest-TestImageHashVerification-242503956 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7059215a-b6af-46e7-bd1e-d19658dd7bd9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:58 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-02ffd5b0-5b6f-4167-8dea-2f06274217ef tempest-TestImageHashVerification-242503956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (350f33ae-7d51-4dfb-be28-bee389140768) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:58 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-02ffd5b0-5b6f-4167-8dea-2f06274217ef tempest-TestImageHashVerification-242503956 None] Volume 7b2d4c48-fa51-461d-9dee-b80c93ce98a6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7b2d4c48-fa51-461d-9dee-b80c93ce98a6', 'volume_size': 1} Nov 01 12:35:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-02ffd5b0-5b6f-4167-8dea-2f06274217ef tempest-TestImageHashVerification-242503956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:35:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-02ffd5b0-5b6f-4167-8dea-2f06274217ef tempest-TestImageHashVerification-242503956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:35:58 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-02ffd5b0-5b6f-4167-8dea-2f06274217ef tempest-TestImageHashVerification-242503956 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:35:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestImageHashVerification-volume-1847960410',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7b2d4c48-fa51-461d-9dee-b80c93ce98a6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='68ddcc5ddb6f466f9d075d2dab01da38',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:35:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:35:58Z,use_quota=True,user_id='4e93846434ff4109856edbf0f430d2e6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:35:58 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-02ffd5b0-5b6f-4167-8dea-2f06274217ef tempest-TestImageHashVerification-242503956 None] Creating volume 7b2d4c48-fa51-461d-9dee-b80c93ce98a6 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:35:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-02ffd5b0-5b6f-4167-8dea-2f06274217ef tempest-TestImageHashVerification-242503956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:35:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-02ffd5b0-5b6f-4167-8dea-2f06274217ef tempest-TestImageHashVerification-242503956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:35:58 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-02ffd5b0-5b6f-4167-8dea-2f06274217ef tempest-TestImageHashVerification-242503956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:35:58 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-02ffd5b0-5b6f-4167-8dea-2f06274217ef tempest-TestImageHashVerification-242503956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:35:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-02ffd5b0-5b6f-4167-8dea-2f06274217ef tempest-TestImageHashVerification-242503956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:35:58 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-02ffd5b0-5b6f-4167-8dea-2f06274217ef tempest-TestImageHashVerification-242503956 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:35:58 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-02ffd5b0-5b6f-4167-8dea-2f06274217ef tempest-TestImageHashVerification-242503956 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:35:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-02ffd5b0-5b6f-4167-8dea-2f06274217ef tempest-TestImageHashVerification-242503956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7b2d4c48-fa51-461d-9dee-b80c93ce98a6 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:58 devstack sudo[104062]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7b2d4c48-fa51-461d-9dee-b80c93ce98a6 1073741824 Nov 01 12:35:58 devstack sudo[104062]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:58 devstack sudo[104062]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-02ffd5b0-5b6f-4167-8dea-2f06274217ef tempest-TestImageHashVerification-242503956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7b2d4c48-fa51-461d-9dee-b80c93ce98a6 1073741824" returned: 0 in 0.461s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-02ffd5b0-5b6f-4167-8dea-2f06274217ef tempest-TestImageHashVerification-242503956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7b2d4c48-fa51-461d-9dee-b80c93ce98a6 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:35:58 devstack sudo[104068]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7b2d4c48-fa51-461d-9dee-b80c93ce98a6 Nov 01 12:35:58 devstack sudo[104068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:35:59 devstack sudo[104068]: pam_unix(sudo:session): session closed for user root Nov 01 12:35:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-02ffd5b0-5b6f-4167-8dea-2f06274217ef tempest-TestImageHashVerification-242503956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7b2d4c48-fa51-461d-9dee-b80c93ce98a6" returned: 0 in 0.249s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:35:59 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-02ffd5b0-5b6f-4167-8dea-2f06274217ef tempest-TestImageHashVerification-242503956 None] <== create_volume: return (759ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:35:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-02ffd5b0-5b6f-4167-8dea-2f06274217ef tempest-TestImageHashVerification-242503956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.762s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:35:59 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-02ffd5b0-5b6f-4167-8dea-2f06274217ef tempest-TestImageHashVerification-242503956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (350f33ae-7d51-4dfb-be28-bee389140768) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7b2d4c48-fa51-461d-9dee-b80c93ce98a6', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:59 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-02ffd5b0-5b6f-4167-8dea-2f06274217ef tempest-TestImageHashVerification-242503956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65f143c2-b544-4fd2-b87a-e48623c290a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:35:59 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-02ffd5b0-5b6f-4167-8dea-2f06274217ef tempest-TestImageHashVerification-242503956 None] Volume volume-7b2d4c48-fa51-461d-9dee-b80c93ce98a6 (7b2d4c48-fa51-461d-9dee-b80c93ce98a6): created successfully Nov 01 12:35:59 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-02ffd5b0-5b6f-4167-8dea-2f06274217ef tempest-TestImageHashVerification-242503956 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (65f143c2-b544-4fd2-b87a-e48623c290a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:35:59 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-02ffd5b0-5b6f-4167-8dea-2f06274217ef tempest-TestImageHashVerification-242503956 None] Flow 'volume_create_manager' (e78d87ec-424b-4f8c-b962-3ddf1c28491a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:35:59 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-02ffd5b0-5b6f-4167-8dea-2f06274217ef tempest-TestImageHashVerification-242503956 None] Created volume successfully. Nov 01 12:36:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d0c2ab78-125f-4390-8126-17dc3abbc648 tempest-TestImageHashVerification-242503956 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:36:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d0c2ab78-125f-4390-8126-17dc3abbc648 tempest-TestImageHashVerification-242503956 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:36:00 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8844998-cedd-4042-b5ab-fcaa3a67293d]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:36:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d0c2ab78-125f-4390-8126-17dc3abbc648 tempest-TestImageHashVerification-242503956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7b2d4c48-fa51-461d-9dee-b80c93ce98a6 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:00 devstack sudo[104072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7b2d4c48-fa51-461d-9dee-b80c93ce98a6 Nov 01 12:36:00 devstack sudo[104072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:00 devstack sudo[104072]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d0c2ab78-125f-4390-8126-17dc3abbc648 tempest-TestImageHashVerification-242503956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7b2d4c48-fa51-461d-9dee-b80c93ce98a6" returned: 0 in 0.399s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:00 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[0241b3fe-8ce3-44ec-9943-6387da70412c]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:36:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d0c2ab78-125f-4390-8126-17dc3abbc648 tempest-TestImageHashVerification-242503956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7b2d4c48-fa51-461d-9dee-b80c93ce98a6 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:00 devstack sudo[104077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7b2d4c48-fa51-461d-9dee-b80c93ce98a6 Nov 01 12:36:00 devstack sudo[104077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:00 devstack sudo[104077]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d0c2ab78-125f-4390-8126-17dc3abbc648 tempest-TestImageHashVerification-242503956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7b2d4c48-fa51-461d-9dee-b80c93ce98a6" returned: 0 in 0.352s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d0c2ab78-125f-4390-8126-17dc3abbc648 tempest-TestImageHashVerification-242503956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7b2d4c48-fa51-461d-9dee-b80c93ce98a6 /opt/stack/data/cinder/conversion/7b2d4c48-fa51-461d-9dee-b80c93ce98a6.temp_image.5cc4b188-27e0-40d3-9bcf-0a0463b22b88clh0_lc2.img {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:00 devstack sudo[104082]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7b2d4c48-fa51-461d-9dee-b80c93ce98a6 /opt/stack/data/cinder/conversion/7b2d4c48-fa51-461d-9dee-b80c93ce98a6.temp_image.5cc4b188-27e0-40d3-9bcf-0a0463b22b88clh0_lc2.img Nov 01 12:36:00 devstack sudo[104082]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:07 devstack sudo[104082]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d0c2ab78-125f-4390-8126-17dc3abbc648 tempest-TestImageHashVerification-242503956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O raw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7b2d4c48-fa51-461d-9dee-b80c93ce98a6 /opt/stack/data/cinder/conversion/7b2d4c48-fa51-461d-9dee-b80c93ce98a6.temp_image.5cc4b188-27e0-40d3-9bcf-0a0463b22b88clh0_lc2.img" returned: 0 in 7.159s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:07 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[77f00ac7-233c-41c8-b15b-42ec15a3e52e]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:36:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d0c2ab78-125f-4390-8126-17dc3abbc648 tempest-TestImageHashVerification-242503956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7b2d4c48-fa51-461d-9dee-b80c93ce98a6 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:08 devstack sudo[104100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7b2d4c48-fa51-461d-9dee-b80c93ce98a6 Nov 01 12:36:08 devstack sudo[104100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:08 devstack sudo[104100]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d0c2ab78-125f-4390-8126-17dc3abbc648 tempest-TestImageHashVerification-242503956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7b2d4c48-fa51-461d-9dee-b80c93ce98a6" returned: 0 in 0.581s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:08 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-d0c2ab78-125f-4390-8126-17dc3abbc648 tempest-TestImageHashVerification-242503956 None] Image conversion details: src /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7b2d4c48-fa51-461d-9dee-b80c93ce98a6, size 1024.00 MB, duration 7.16 sec, destination /opt/stack/data/cinder/conversion/7b2d4c48-fa51-461d-9dee-b80c93ce98a6.temp_image.5cc4b188-27e0-40d3-9bcf-0a0463b22b88clh0_lc2.img {{(pid=86574) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 12:36:08 devstack cinder-volume[86574]: INFO cinder.image.image_utils [None req-d0c2ab78-125f-4390-8126-17dc3abbc648 tempest-TestImageHashVerification-242503956 None] Converted 1024.00 MB image at 143.02 MB/s Nov 01 12:36:08 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-d0c2ab78-125f-4390-8126-17dc3abbc648 tempest-TestImageHashVerification-242503956 None] 5cc4b188-27e0-40d3-9bcf-0a0463b22b88 was raw, no need to convert to raw {{(pid=86574) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1186}} Nov 01 12:36:09 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:SELECT=66,cinder:UPDATE=81,cinder:INSERT=21,cinder:DELETE=8 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:36:18 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:SELECT=71,cinder:UPDATE=83,cinder:INSERT=16,cinder:DELETE=5 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:36:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d0c2ab78-125f-4390-8126-17dc3abbc648 tempest-TestImageHashVerification-242503956 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 29.846s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:36:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d0c2ab78-125f-4390-8126-17dc3abbc648 tempest-TestImageHashVerification-242503956 None] Uploaded volume to glance image-id: 5cc4b188-27e0-40d3-9bcf-0a0463b22b88. {{(pid=86574) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1781}} Nov 01 12:36:29 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-d0c2ab78-125f-4390-8126-17dc3abbc648 tempest-TestImageHashVerification-242503956 None] Copy volume to image completed successfully. Nov 01 12:36:30 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a608ff21-17da-410b-8efc-e8f75c1cb576 tempest-TestImageHashVerification-242503956 None] Acquiring lock "cinder-7b2d4c48-fa51-461d-9dee-b80c93ce98a6-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:36:30 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a608ff21-17da-410b-8efc-e8f75c1cb576 tempest-TestImageHashVerification-242503956 None] Lock "cinder-7b2d4c48-fa51-461d-9dee-b80c93ce98a6-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:36:30 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a608ff21-17da-410b-8efc-e8f75c1cb576 tempest-TestImageHashVerification-242503956 None] Acquiring lock "cinder-quobyte-7b2d4c48-fa51-461d-9dee-b80c93ce98a6" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:36:30 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a608ff21-17da-410b-8efc-e8f75c1cb576 tempest-TestImageHashVerification-242503956 None] Lock "cinder-quobyte-7b2d4c48-fa51-461d-9dee-b80c93ce98a6" acquired by "delete_volume" :: waited 0.016s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:36:30 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[39ef25d7-b2e8-4732-9465-c45bf4f506c2]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:36:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a608ff21-17da-410b-8efc-e8f75c1cb576 tempest-TestImageHashVerification-242503956 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7b2d4c48-fa51-461d-9dee-b80c93ce98a6 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:30 devstack sudo[104112]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7b2d4c48-fa51-461d-9dee-b80c93ce98a6 Nov 01 12:36:30 devstack sudo[104112]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:31 devstack sudo[104112]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a608ff21-17da-410b-8efc-e8f75c1cb576 tempest-TestImageHashVerification-242503956 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7b2d4c48-fa51-461d-9dee-b80c93ce98a6" returned: 0 in 0.378s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a608ff21-17da-410b-8efc-e8f75c1cb576 tempest-TestImageHashVerification-242503956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7b2d4c48-fa51-461d-9dee-b80c93ce98a6 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:31 devstack sudo[104117]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7b2d4c48-fa51-461d-9dee-b80c93ce98a6 Nov 01 12:36:31 devstack sudo[104117]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:31 devstack sudo[104117]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a608ff21-17da-410b-8efc-e8f75c1cb576 tempest-TestImageHashVerification-242503956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7b2d4c48-fa51-461d-9dee-b80c93ce98a6" returned: 0 in 0.246s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:31 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a608ff21-17da-410b-8efc-e8f75c1cb576 tempest-TestImageHashVerification-242503956 None] Lock "cinder-quobyte-7b2d4c48-fa51-461d-9dee-b80c93ce98a6" released by "delete_volume" :: held 0.672s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:36:31 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-a608ff21-17da-410b-8efc-e8f75c1cb576 tempest-TestImageHashVerification-242503956 None] Created reservations ['f827b8c3-fc10-4e93-ac5c-0690985c4cc1', '052a9efd-765d-4618-a66f-e9755b383cc3', '233111e1-3af5-471e-b627-a3ce2757e755', '85afb53e-252a-488d-a4e2-c1b77313736b'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:36:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a608ff21-17da-410b-8efc-e8f75c1cb576 tempest-TestImageHashVerification-242503956 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:36:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a608ff21-17da-410b-8efc-e8f75c1cb576 tempest-TestImageHashVerification-242503956 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:36:31 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a608ff21-17da-410b-8efc-e8f75c1cb576 tempest-TestImageHashVerification-242503956 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:36:31 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a608ff21-17da-410b-8efc-e8f75c1cb576 tempest-TestImageHashVerification-242503956 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:36:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a608ff21-17da-410b-8efc-e8f75c1cb576 tempest-TestImageHashVerification-242503956 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:36:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a608ff21-17da-410b-8efc-e8f75c1cb576 tempest-TestImageHashVerification-242503956 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:31 devstack sudo[104120]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:36:31 devstack sudo[104120]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:31 devstack sudo[104120]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a608ff21-17da-410b-8efc-e8f75c1cb576 tempest-TestImageHashVerification-242503956 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.283s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:31 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-a608ff21-17da-410b-8efc-e8f75c1cb576 tempest-TestImageHashVerification-242503956 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:36:31 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-a608ff21-17da-410b-8efc-e8f75c1cb576 tempest-TestImageHashVerification-242503956 None] Deleted volume successfully. Nov 01 12:36:31 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a608ff21-17da-410b-8efc-e8f75c1cb576 tempest-TestImageHashVerification-242503956 None] Lock "cinder-7b2d4c48-fa51-461d-9dee-b80c93ce98a6-delete_volume" released by "delete_volume" :: held 1.173s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:36:39 devstack cinder-volume[86574]: DEBUG oslo_service.periodic_task [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86574) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:36:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:36:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:36:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:36:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:36:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:36:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:39 devstack sudo[104145]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:36:39 devstack sudo[104145]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:40 devstack sudo[104145]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.308s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:40 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:36:40 devstack cinder-volume[86574]: DEBUG oslo_service.periodic_task [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running periodic task VolumeManager._thread_info {{(pid=86574) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:36:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] thread count: 28 {{(pid=86574) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 12:36:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] thread info: [<_MainThread(MainThread, started 131331184930944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86574) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 12:36:41 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:UPDATE=8,cinder:SELECT=4,cinder:INSERT=1 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:36:41 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:SELECT=7,cinder:UPDATE=9,cinder:INSERT=3,cinder:DELETE=1 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:36:45 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-2fe028e4-8924-446e-8cf0-af929160ce18 tempest-CreateVolumesFromImageTest-2036161004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:36:45 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2fe028e4-8924-446e-8cf0-af929160ce18 tempest-CreateVolumesFromImageTest-2036161004 None] Flow 'volume_create_manager' (96b97b44-88d3-4542-af4e-e7eb94f1ad20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:36:45 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2fe028e4-8924-446e-8cf0-af929160ce18 tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d45c4bcc-ba73-4ec2-9219-39080e7f39ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:45 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2fe028e4-8924-446e-8cf0-af929160ce18 tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d45c4bcc-ba73-4ec2-9219-39080e7f39ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-741555525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0dcc121-0949-4a43-aed0-0eafae131b84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95815241f33b4307a53b2d4b6b9ac216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:36:46Z,use_quota=True,user_id='5e1da834910849a09be155b53308b35d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:45 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2fe028e4-8924-446e-8cf0-af929160ce18 tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5316692b-a5d8-461a-b0cd-f1c1bfce27fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2fe028e4-8924-446e-8cf0-af929160ce18 tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5316692b-a5d8-461a-b0cd-f1c1bfce27fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2fe028e4-8924-446e-8cf0-af929160ce18 tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4822db7b-1514-44dc-97c6-38d952035ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2fe028e4-8924-446e-8cf0-af929160ce18 tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4822db7b-1514-44dc-97c6-38d952035ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0dcc121-0949-4a43-aed0-0eafae131b84', 'volume_name': 'volume-f0dcc121-0949-4a43-aed0-0eafae131b84', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2fe028e4-8924-446e-8cf0-af929160ce18 tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (855419de-cdb2-4805-b626-5301b7a0eba6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2fe028e4-8924-446e-8cf0-af929160ce18 tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (855419de-cdb2-4805-b626-5301b7a0eba6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2fe028e4-8924-446e-8cf0-af929160ce18 tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ced6329-9841-4589-9ae6-70d73f37bf32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:46 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-2fe028e4-8924-446e-8cf0-af929160ce18 tempest-CreateVolumesFromImageTest-2036161004 None] Volume f0dcc121-0949-4a43-aed0-0eafae131b84: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0dcc121-0949-4a43-aed0-0eafae131b84', 'volume_size': 1} Nov 01 12:36:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-2fe028e4-8924-446e-8cf0-af929160ce18 tempest-CreateVolumesFromImageTest-2036161004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:36:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-2fe028e4-8924-446e-8cf0-af929160ce18 tempest-CreateVolumesFromImageTest-2036161004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:36:46 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-2fe028e4-8924-446e-8cf0-af929160ce18 tempest-CreateVolumesFromImageTest-2036161004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-741555525',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0dcc121-0949-4a43-aed0-0eafae131b84,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95815241f33b4307a53b2d4b6b9ac216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:36:46Z,use_quota=True,user_id='5e1da834910849a09be155b53308b35d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:36:46 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-2fe028e4-8924-446e-8cf0-af929160ce18 tempest-CreateVolumesFromImageTest-2036161004 None] Creating volume f0dcc121-0949-4a43-aed0-0eafae131b84 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:36:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-2fe028e4-8924-446e-8cf0-af929160ce18 tempest-CreateVolumesFromImageTest-2036161004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:36:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-2fe028e4-8924-446e-8cf0-af929160ce18 tempest-CreateVolumesFromImageTest-2036161004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:36:46 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-2fe028e4-8924-446e-8cf0-af929160ce18 tempest-CreateVolumesFromImageTest-2036161004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:36:46 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-2fe028e4-8924-446e-8cf0-af929160ce18 tempest-CreateVolumesFromImageTest-2036161004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:36:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-2fe028e4-8924-446e-8cf0-af929160ce18 tempest-CreateVolumesFromImageTest-2036161004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:36:46 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-2fe028e4-8924-446e-8cf0-af929160ce18 tempest-CreateVolumesFromImageTest-2036161004 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:36:46 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-2fe028e4-8924-446e-8cf0-af929160ce18 tempest-CreateVolumesFromImageTest-2036161004 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:36:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2fe028e4-8924-446e-8cf0-af929160ce18 tempest-CreateVolumesFromImageTest-2036161004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0dcc121-0949-4a43-aed0-0eafae131b84 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:46 devstack sudo[104262]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0dcc121-0949-4a43-aed0-0eafae131b84 1073741824 Nov 01 12:36:46 devstack sudo[104262]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:46 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-65e7d633-34a2-41c2-8c60-4b271ba3470b tempest-CreateVolumesFromImageTest-2036161004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:36:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-65e7d633-34a2-41c2-8c60-4b271ba3470b tempest-CreateVolumesFromImageTest-2036161004 None] Flow 'volume_create_manager' (4d43f523-c756-40d2-b69f-01301341e383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:36:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-65e7d633-34a2-41c2-8c60-4b271ba3470b tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36846f4a-2ac6-4546-9b45-158afeab66f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-65e7d633-34a2-41c2-8c60-4b271ba3470b tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (36846f4a-2ac6-4546-9b45-158afeab66f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-494717607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=192d8c81-3022-48e4-b89c-902b6c3526c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95815241f33b4307a53b2d4b6b9ac216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:36:46Z,use_quota=True,user_id='5e1da834910849a09be155b53308b35d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-65e7d633-34a2-41c2-8c60-4b271ba3470b tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b536e6a0-36ab-4d27-9f27-556ac4f20257) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-65e7d633-34a2-41c2-8c60-4b271ba3470b tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b536e6a0-36ab-4d27-9f27-556ac4f20257) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-65e7d633-34a2-41c2-8c60-4b271ba3470b tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffc155f0-c1c0-48df-83c7-5504a9606f4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-65e7d633-34a2-41c2-8c60-4b271ba3470b tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffc155f0-c1c0-48df-83c7-5504a9606f4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '192d8c81-3022-48e4-b89c-902b6c3526c5', 'volume_name': 'volume-192d8c81-3022-48e4-b89c-902b6c3526c5', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-65e7d633-34a2-41c2-8c60-4b271ba3470b tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26dc8ea3-50ad-484a-8e07-3b4933dc7b91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-65e7d633-34a2-41c2-8c60-4b271ba3470b tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26dc8ea3-50ad-484a-8e07-3b4933dc7b91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-65e7d633-34a2-41c2-8c60-4b271ba3470b tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70276320-19d3-49f0-8523-da004dd02f4e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:46 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-65e7d633-34a2-41c2-8c60-4b271ba3470b tempest-CreateVolumesFromImageTest-2036161004 None] Volume 192d8c81-3022-48e4-b89c-902b6c3526c5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-192d8c81-3022-48e4-b89c-902b6c3526c5', 'volume_size': 1} Nov 01 12:36:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-65e7d633-34a2-41c2-8c60-4b271ba3470b tempest-CreateVolumesFromImageTest-2036161004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:36:46 devstack sudo[104262]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2fe028e4-8924-446e-8cf0-af929160ce18 tempest-CreateVolumesFromImageTest-2036161004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0dcc121-0949-4a43-aed0-0eafae131b84 1073741824" returned: 0 in 0.672s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2fe028e4-8924-446e-8cf0-af929160ce18 tempest-CreateVolumesFromImageTest-2036161004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0dcc121-0949-4a43-aed0-0eafae131b84 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:46 devstack sudo[104268]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0dcc121-0949-4a43-aed0-0eafae131b84 Nov 01 12:36:46 devstack sudo[104268]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:47 devstack sudo[104268]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2fe028e4-8924-446e-8cf0-af929160ce18 tempest-CreateVolumesFromImageTest-2036161004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0dcc121-0949-4a43-aed0-0eafae131b84" returned: 0 in 0.325s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:47 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-2fe028e4-8924-446e-8cf0-af929160ce18 tempest-CreateVolumesFromImageTest-2036161004 None] <== create_volume: return (1050ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:36:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-2fe028e4-8924-446e-8cf0-af929160ce18 tempest-CreateVolumesFromImageTest-2036161004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.054s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:36:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-65e7d633-34a2-41c2-8c60-4b271ba3470b tempest-CreateVolumesFromImageTest-2036161004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.519s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:36:47 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-65e7d633-34a2-41c2-8c60-4b271ba3470b tempest-CreateVolumesFromImageTest-2036161004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:36:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-494717607',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=192d8c81-3022-48e4-b89c-902b6c3526c5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95815241f33b4307a53b2d4b6b9ac216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:36:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:36:46Z,use_quota=True,user_id='5e1da834910849a09be155b53308b35d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:36:47 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-65e7d633-34a2-41c2-8c60-4b271ba3470b tempest-CreateVolumesFromImageTest-2036161004 None] Creating volume 192d8c81-3022-48e4-b89c-902b6c3526c5 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:36:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-65e7d633-34a2-41c2-8c60-4b271ba3470b tempest-CreateVolumesFromImageTest-2036161004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:36:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-65e7d633-34a2-41c2-8c60-4b271ba3470b tempest-CreateVolumesFromImageTest-2036161004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:36:47 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-65e7d633-34a2-41c2-8c60-4b271ba3470b tempest-CreateVolumesFromImageTest-2036161004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:36:47 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-65e7d633-34a2-41c2-8c60-4b271ba3470b tempest-CreateVolumesFromImageTest-2036161004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:36:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-65e7d633-34a2-41c2-8c60-4b271ba3470b tempest-CreateVolumesFromImageTest-2036161004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:36:47 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-65e7d633-34a2-41c2-8c60-4b271ba3470b tempest-CreateVolumesFromImageTest-2036161004 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:36:47 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-65e7d633-34a2-41c2-8c60-4b271ba3470b tempest-CreateVolumesFromImageTest-2036161004 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:36:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-65e7d633-34a2-41c2-8c60-4b271ba3470b tempest-CreateVolumesFromImageTest-2036161004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-192d8c81-3022-48e4-b89c-902b6c3526c5 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2fe028e4-8924-446e-8cf0-af929160ce18 tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8ced6329-9841-4589-9ae6-70d73f37bf32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0dcc121-0949-4a43-aed0-0eafae131b84', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:47 devstack sudo[104271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-192d8c81-3022-48e4-b89c-902b6c3526c5 1073741824 Nov 01 12:36:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2fe028e4-8924-446e-8cf0-af929160ce18 tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1a0f9fe-790c-4eaa-830c-7df83373f5df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:47 devstack sudo[104271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:47 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-2fe028e4-8924-446e-8cf0-af929160ce18 tempest-CreateVolumesFromImageTest-2036161004 None] Volume volume-f0dcc121-0949-4a43-aed0-0eafae131b84 (f0dcc121-0949-4a43-aed0-0eafae131b84): created successfully Nov 01 12:36:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2fe028e4-8924-446e-8cf0-af929160ce18 tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1a0f9fe-790c-4eaa-830c-7df83373f5df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2fe028e4-8924-446e-8cf0-af929160ce18 tempest-CreateVolumesFromImageTest-2036161004 None] Flow 'volume_create_manager' (96b97b44-88d3-4542-af4e-e7eb94f1ad20) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:36:47 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-2fe028e4-8924-446e-8cf0-af929160ce18 tempest-CreateVolumesFromImageTest-2036161004 None] Created volume successfully. Nov 01 12:36:47 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fd79cf3-d308-4de7-972e-cae4982de8f5 tempest-CreateVolumesFromImageTest-2036161004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:36:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4fd79cf3-d308-4de7-972e-cae4982de8f5 tempest-CreateVolumesFromImageTest-2036161004 None] Flow 'volume_create_manager' (70c6f051-9506-4162-b5a1-a30d9ff32c39) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:36:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4fd79cf3-d308-4de7-972e-cae4982de8f5 tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ec62d7c-ce59-4f29-a12b-62ff0922f258) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4fd79cf3-d308-4de7-972e-cae4982de8f5 tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ec62d7c-ce59-4f29-a12b-62ff0922f258) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-172890103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d10246f7-c78e-4a0c-959a-e1fcd63a23bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95815241f33b4307a53b2d4b6b9ac216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:36:47Z,use_quota=True,user_id='5e1da834910849a09be155b53308b35d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4fd79cf3-d308-4de7-972e-cae4982de8f5 tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39cacd1c-3000-479e-beab-74ba402504c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4fd79cf3-d308-4de7-972e-cae4982de8f5 tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (39cacd1c-3000-479e-beab-74ba402504c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4fd79cf3-d308-4de7-972e-cae4982de8f5 tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cf0121d-f40b-4a39-922e-fee295515972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4fd79cf3-d308-4de7-972e-cae4982de8f5 tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3cf0121d-f40b-4a39-922e-fee295515972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd10246f7-c78e-4a0c-959a-e1fcd63a23bd', 'volume_name': 'volume-d10246f7-c78e-4a0c-959a-e1fcd63a23bd', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4fd79cf3-d308-4de7-972e-cae4982de8f5 tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (134a551a-3314-4faa-931b-17d93a24d76f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4fd79cf3-d308-4de7-972e-cae4982de8f5 tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (134a551a-3314-4faa-931b-17d93a24d76f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4fd79cf3-d308-4de7-972e-cae4982de8f5 tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeaf55cc-c462-400b-ba93-583e842ef5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:47 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-4fd79cf3-d308-4de7-972e-cae4982de8f5 tempest-CreateVolumesFromImageTest-2036161004 None] Volume d10246f7-c78e-4a0c-959a-e1fcd63a23bd: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d10246f7-c78e-4a0c-959a-e1fcd63a23bd', 'volume_size': 1} Nov 01 12:36:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4fd79cf3-d308-4de7-972e-cae4982de8f5 tempest-CreateVolumesFromImageTest-2036161004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:36:47 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-0a845e71-844a-43e4-a6aa-c996b1f80b99 tempest-CreateVolumesFromImageTest-2036161004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:36:47 devstack sudo[104271]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0a845e71-844a-43e4-a6aa-c996b1f80b99 tempest-CreateVolumesFromImageTest-2036161004 None] Flow 'volume_create_manager' (35f057a8-4d6b-4fac-8c84-008dfb3a7da9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:36:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0a845e71-844a-43e4-a6aa-c996b1f80b99 tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dca1915-bdbb-4795-9aed-43cbee6eba5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-65e7d633-34a2-41c2-8c60-4b271ba3470b tempest-CreateVolumesFromImageTest-2036161004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-192d8c81-3022-48e4-b89c-902b6c3526c5 1073741824" returned: 0 in 0.715s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0a845e71-844a-43e4-a6aa-c996b1f80b99 tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dca1915-bdbb-4795-9aed-43cbee6eba5b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1307769962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef3068e3-733f-4b8a-824e-e397cf676ff8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95815241f33b4307a53b2d4b6b9ac216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:36:48Z,use_quota=True,user_id='5e1da834910849a09be155b53308b35d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0a845e71-844a-43e4-a6aa-c996b1f80b99 tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f67c056f-00d3-4fba-8ab2-292103d946d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0a845e71-844a-43e4-a6aa-c996b1f80b99 tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f67c056f-00d3-4fba-8ab2-292103d946d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0a845e71-844a-43e4-a6aa-c996b1f80b99 tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c35820e6-084f-49d8-8926-6d953479a4ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0a845e71-844a-43e4-a6aa-c996b1f80b99 tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c35820e6-084f-49d8-8926-6d953479a4ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ef3068e3-733f-4b8a-824e-e397cf676ff8', 'volume_name': 'volume-ef3068e3-733f-4b8a-824e-e397cf676ff8', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0a845e71-844a-43e4-a6aa-c996b1f80b99 tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf954c24-6a05-4c28-823a-d96a725b303f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0a845e71-844a-43e4-a6aa-c996b1f80b99 tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cf954c24-6a05-4c28-823a-d96a725b303f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0a845e71-844a-43e4-a6aa-c996b1f80b99 tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a423168-1cd5-40cb-990d-84c43eeefa32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:47 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-0a845e71-844a-43e4-a6aa-c996b1f80b99 tempest-CreateVolumesFromImageTest-2036161004 None] Volume ef3068e3-733f-4b8a-824e-e397cf676ff8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ef3068e3-733f-4b8a-824e-e397cf676ff8', 'volume_size': 1} Nov 01 12:36:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0a845e71-844a-43e4-a6aa-c996b1f80b99 tempest-CreateVolumesFromImageTest-2036161004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:36:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-65e7d633-34a2-41c2-8c60-4b271ba3470b tempest-CreateVolumesFromImageTest-2036161004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-192d8c81-3022-48e4-b89c-902b6c3526c5 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:47 devstack sudo[104277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-192d8c81-3022-48e4-b89c-902b6c3526c5 Nov 01 12:36:47 devstack sudo[104277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:48 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-f911558b-7f1f-4d84-b8c1-dd2c4960b744 tempest-CreateVolumesFromImageTest-2036161004 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:36:48 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f911558b-7f1f-4d84-b8c1-dd2c4960b744 tempest-CreateVolumesFromImageTest-2036161004 None] Flow 'volume_create_manager' (1a173bf3-48e9-4a7b-9c3f-c2fe10b34bc2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:36:48 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f911558b-7f1f-4d84-b8c1-dd2c4960b744 tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf9963a7-0d9f-4884-9ef6-948e9c74b9de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:48 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f911558b-7f1f-4d84-b8c1-dd2c4960b744 tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cf9963a7-0d9f-4884-9ef6-948e9c74b9de) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-494779369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d3ef186-6817-41cf-ae0e-af7ba35b9cf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95815241f33b4307a53b2d4b6b9ac216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:36:48Z,use_quota=True,user_id='5e1da834910849a09be155b53308b35d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:48 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f911558b-7f1f-4d84-b8c1-dd2c4960b744 tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51be0c6f-2bdd-4b15-b94d-7b2dc1fe7489) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:48 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f911558b-7f1f-4d84-b8c1-dd2c4960b744 tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51be0c6f-2bdd-4b15-b94d-7b2dc1fe7489) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:48 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f911558b-7f1f-4d84-b8c1-dd2c4960b744 tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d6f8c42-c69b-4d08-a820-73df8a6563cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:48 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f911558b-7f1f-4d84-b8c1-dd2c4960b744 tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d6f8c42-c69b-4d08-a820-73df8a6563cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6d3ef186-6817-41cf-ae0e-af7ba35b9cf1', 'volume_name': 'volume-6d3ef186-6817-41cf-ae0e-af7ba35b9cf1', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:48 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f911558b-7f1f-4d84-b8c1-dd2c4960b744 tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73266ece-ad5a-43da-8e0a-a2a9a1890beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:48 devstack sudo[104277]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:48 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f911558b-7f1f-4d84-b8c1-dd2c4960b744 tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (73266ece-ad5a-43da-8e0a-a2a9a1890beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:48 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f911558b-7f1f-4d84-b8c1-dd2c4960b744 tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04df3d08-37f7-4e83-82d9-69bca4668b94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:48 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-f911558b-7f1f-4d84-b8c1-dd2c4960b744 tempest-CreateVolumesFromImageTest-2036161004 None] Volume 6d3ef186-6817-41cf-ae0e-af7ba35b9cf1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6d3ef186-6817-41cf-ae0e-af7ba35b9cf1', 'volume_size': 1} Nov 01 12:36:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f911558b-7f1f-4d84-b8c1-dd2c4960b744 tempest-CreateVolumesFromImageTest-2036161004 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:36:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-65e7d633-34a2-41c2-8c60-4b271ba3470b tempest-CreateVolumesFromImageTest-2036161004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-192d8c81-3022-48e4-b89c-902b6c3526c5" returned: 0 in 0.322s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:48 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-65e7d633-34a2-41c2-8c60-4b271ba3470b tempest-CreateVolumesFromImageTest-2036161004 None] <== create_volume: return (1140ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:36:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-65e7d633-34a2-41c2-8c60-4b271ba3470b tempest-CreateVolumesFromImageTest-2036161004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.144s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:36:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4fd79cf3-d308-4de7-972e-cae4982de8f5 tempest-CreateVolumesFromImageTest-2036161004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.848s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:36:48 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-4fd79cf3-d308-4de7-972e-cae4982de8f5 tempest-CreateVolumesFromImageTest-2036161004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-172890103',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d10246f7-c78e-4a0c-959a-e1fcd63a23bd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95815241f33b4307a53b2d4b6b9ac216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:36:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:36:47Z,use_quota=True,user_id='5e1da834910849a09be155b53308b35d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:36:48 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-4fd79cf3-d308-4de7-972e-cae4982de8f5 tempest-CreateVolumesFromImageTest-2036161004 None] Creating volume d10246f7-c78e-4a0c-959a-e1fcd63a23bd {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:36:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4fd79cf3-d308-4de7-972e-cae4982de8f5 tempest-CreateVolumesFromImageTest-2036161004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:36:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4fd79cf3-d308-4de7-972e-cae4982de8f5 tempest-CreateVolumesFromImageTest-2036161004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:36:48 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-4fd79cf3-d308-4de7-972e-cae4982de8f5 tempest-CreateVolumesFromImageTest-2036161004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:36:48 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-4fd79cf3-d308-4de7-972e-cae4982de8f5 tempest-CreateVolumesFromImageTest-2036161004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:36:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4fd79cf3-d308-4de7-972e-cae4982de8f5 tempest-CreateVolumesFromImageTest-2036161004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:36:48 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-4fd79cf3-d308-4de7-972e-cae4982de8f5 tempest-CreateVolumesFromImageTest-2036161004 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:36:48 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-4fd79cf3-d308-4de7-972e-cae4982de8f5 tempest-CreateVolumesFromImageTest-2036161004 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:36:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4fd79cf3-d308-4de7-972e-cae4982de8f5 tempest-CreateVolumesFromImageTest-2036161004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d10246f7-c78e-4a0c-959a-e1fcd63a23bd 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:48 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-65e7d633-34a2-41c2-8c60-4b271ba3470b tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (70276320-19d3-49f0-8523-da004dd02f4e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-192d8c81-3022-48e4-b89c-902b6c3526c5', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:48 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-65e7d633-34a2-41c2-8c60-4b271ba3470b tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2922845b-6896-4536-ae55-54605bb73423) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:48 devstack sudo[104280]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d10246f7-c78e-4a0c-959a-e1fcd63a23bd 1073741824 Nov 01 12:36:48 devstack sudo[104280]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:48 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-65e7d633-34a2-41c2-8c60-4b271ba3470b tempest-CreateVolumesFromImageTest-2036161004 None] Volume volume-192d8c81-3022-48e4-b89c-902b6c3526c5 (192d8c81-3022-48e4-b89c-902b6c3526c5): created successfully Nov 01 12:36:48 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-65e7d633-34a2-41c2-8c60-4b271ba3470b tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2922845b-6896-4536-ae55-54605bb73423) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:48 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-65e7d633-34a2-41c2-8c60-4b271ba3470b tempest-CreateVolumesFromImageTest-2036161004 None] Flow 'volume_create_manager' (4d43f523-c756-40d2-b69f-01301341e383) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:36:48 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-65e7d633-34a2-41c2-8c60-4b271ba3470b tempest-CreateVolumesFromImageTest-2036161004 None] Created volume successfully. Nov 01 12:36:48 devstack sudo[104280]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4fd79cf3-d308-4de7-972e-cae4982de8f5 tempest-CreateVolumesFromImageTest-2036161004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d10246f7-c78e-4a0c-959a-e1fcd63a23bd 1073741824" returned: 0 in 0.443s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4fd79cf3-d308-4de7-972e-cae4982de8f5 tempest-CreateVolumesFromImageTest-2036161004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d10246f7-c78e-4a0c-959a-e1fcd63a23bd {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:48 devstack sudo[104287]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d10246f7-c78e-4a0c-959a-e1fcd63a23bd Nov 01 12:36:48 devstack sudo[104287]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:48 devstack sudo[104287]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4fd79cf3-d308-4de7-972e-cae4982de8f5 tempest-CreateVolumesFromImageTest-2036161004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d10246f7-c78e-4a0c-959a-e1fcd63a23bd" returned: 0 in 0.264s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:48 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-4fd79cf3-d308-4de7-972e-cae4982de8f5 tempest-CreateVolumesFromImageTest-2036161004 None] <== create_volume: return (753ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:36:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4fd79cf3-d308-4de7-972e-cae4982de8f5 tempest-CreateVolumesFromImageTest-2036161004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:36:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0a845e71-844a-43e4-a6aa-c996b1f80b99 tempest-CreateVolumesFromImageTest-2036161004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.122s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:36:49 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-0a845e71-844a-43e4-a6aa-c996b1f80b99 tempest-CreateVolumesFromImageTest-2036161004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:36:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1307769962',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ef3068e3-733f-4b8a-824e-e397cf676ff8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95815241f33b4307a53b2d4b6b9ac216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:36:48Z,use_quota=True,user_id='5e1da834910849a09be155b53308b35d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:36:49 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-0a845e71-844a-43e4-a6aa-c996b1f80b99 tempest-CreateVolumesFromImageTest-2036161004 None] Creating volume ef3068e3-733f-4b8a-824e-e397cf676ff8 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:36:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0a845e71-844a-43e4-a6aa-c996b1f80b99 tempest-CreateVolumesFromImageTest-2036161004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:36:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0a845e71-844a-43e4-a6aa-c996b1f80b99 tempest-CreateVolumesFromImageTest-2036161004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:36:49 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-0a845e71-844a-43e4-a6aa-c996b1f80b99 tempest-CreateVolumesFromImageTest-2036161004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:36:49 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-0a845e71-844a-43e4-a6aa-c996b1f80b99 tempest-CreateVolumesFromImageTest-2036161004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:36:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0a845e71-844a-43e4-a6aa-c996b1f80b99 tempest-CreateVolumesFromImageTest-2036161004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:36:49 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-0a845e71-844a-43e4-a6aa-c996b1f80b99 tempest-CreateVolumesFromImageTest-2036161004 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:36:49 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-0a845e71-844a-43e4-a6aa-c996b1f80b99 tempest-CreateVolumesFromImageTest-2036161004 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:36:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0a845e71-844a-43e4-a6aa-c996b1f80b99 tempest-CreateVolumesFromImageTest-2036161004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ef3068e3-733f-4b8a-824e-e397cf676ff8 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:49 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4fd79cf3-d308-4de7-972e-cae4982de8f5 tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eeaf55cc-c462-400b-ba93-583e842ef5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d10246f7-c78e-4a0c-959a-e1fcd63a23bd', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:49 devstack sudo[104290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ef3068e3-733f-4b8a-824e-e397cf676ff8 1073741824 Nov 01 12:36:49 devstack sudo[104290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:49 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4fd79cf3-d308-4de7-972e-cae4982de8f5 tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6503b7a-8426-456b-a31c-2bbdb034b298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:49 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-4fd79cf3-d308-4de7-972e-cae4982de8f5 tempest-CreateVolumesFromImageTest-2036161004 None] Volume volume-d10246f7-c78e-4a0c-959a-e1fcd63a23bd (d10246f7-c78e-4a0c-959a-e1fcd63a23bd): created successfully Nov 01 12:36:49 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4fd79cf3-d308-4de7-972e-cae4982de8f5 tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f6503b7a-8426-456b-a31c-2bbdb034b298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:49 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4fd79cf3-d308-4de7-972e-cae4982de8f5 tempest-CreateVolumesFromImageTest-2036161004 None] Flow 'volume_create_manager' (70c6f051-9506-4162-b5a1-a30d9ff32c39) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:36:49 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-4fd79cf3-d308-4de7-972e-cae4982de8f5 tempest-CreateVolumesFromImageTest-2036161004 None] Created volume successfully. Nov 01 12:36:49 devstack sudo[104290]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0a845e71-844a-43e4-a6aa-c996b1f80b99 tempest-CreateVolumesFromImageTest-2036161004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ef3068e3-733f-4b8a-824e-e397cf676ff8 1073741824" returned: 0 in 0.447s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0a845e71-844a-43e4-a6aa-c996b1f80b99 tempest-CreateVolumesFromImageTest-2036161004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ef3068e3-733f-4b8a-824e-e397cf676ff8 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:49 devstack sudo[104296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ef3068e3-733f-4b8a-824e-e397cf676ff8 Nov 01 12:36:49 devstack sudo[104296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:49 devstack sudo[104296]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0a845e71-844a-43e4-a6aa-c996b1f80b99 tempest-CreateVolumesFromImageTest-2036161004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ef3068e3-733f-4b8a-824e-e397cf676ff8" returned: 0 in 0.249s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:49 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-0a845e71-844a-43e4-a6aa-c996b1f80b99 tempest-CreateVolumesFromImageTest-2036161004 None] <== create_volume: return (736ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:36:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0a845e71-844a-43e4-a6aa-c996b1f80b99 tempest-CreateVolumesFromImageTest-2036161004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.741s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:36:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f911558b-7f1f-4d84-b8c1-dd2c4960b744 tempest-CreateVolumesFromImageTest-2036161004 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.517s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:36:49 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f911558b-7f1f-4d84-b8c1-dd2c4960b744 tempest-CreateVolumesFromImageTest-2036161004 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:36:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-494779369',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6d3ef186-6817-41cf-ae0e-af7ba35b9cf1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='95815241f33b4307a53b2d4b6b9ac216',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:36:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:36:48Z,use_quota=True,user_id='5e1da834910849a09be155b53308b35d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:36:49 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-f911558b-7f1f-4d84-b8c1-dd2c4960b744 tempest-CreateVolumesFromImageTest-2036161004 None] Creating volume 6d3ef186-6817-41cf-ae0e-af7ba35b9cf1 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:36:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f911558b-7f1f-4d84-b8c1-dd2c4960b744 tempest-CreateVolumesFromImageTest-2036161004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:36:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f911558b-7f1f-4d84-b8c1-dd2c4960b744 tempest-CreateVolumesFromImageTest-2036161004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:36:49 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f911558b-7f1f-4d84-b8c1-dd2c4960b744 tempest-CreateVolumesFromImageTest-2036161004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:36:49 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f911558b-7f1f-4d84-b8c1-dd2c4960b744 tempest-CreateVolumesFromImageTest-2036161004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:36:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f911558b-7f1f-4d84-b8c1-dd2c4960b744 tempest-CreateVolumesFromImageTest-2036161004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:36:49 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f911558b-7f1f-4d84-b8c1-dd2c4960b744 tempest-CreateVolumesFromImageTest-2036161004 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:36:49 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-f911558b-7f1f-4d84-b8c1-dd2c4960b744 tempest-CreateVolumesFromImageTest-2036161004 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:36:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f911558b-7f1f-4d84-b8c1-dd2c4960b744 tempest-CreateVolumesFromImageTest-2036161004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6d3ef186-6817-41cf-ae0e-af7ba35b9cf1 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:49 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0a845e71-844a-43e4-a6aa-c996b1f80b99 tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1a423168-1cd5-40cb-990d-84c43eeefa32) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ef3068e3-733f-4b8a-824e-e397cf676ff8', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:49 devstack sudo[104299]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6d3ef186-6817-41cf-ae0e-af7ba35b9cf1 1073741824 Nov 01 12:36:49 devstack sudo[104299]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:49 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0a845e71-844a-43e4-a6aa-c996b1f80b99 tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87bdaca0-43f2-4be7-a5a6-f6e4b367f378) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:49 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-0a845e71-844a-43e4-a6aa-c996b1f80b99 tempest-CreateVolumesFromImageTest-2036161004 None] Volume volume-ef3068e3-733f-4b8a-824e-e397cf676ff8 (ef3068e3-733f-4b8a-824e-e397cf676ff8): created successfully Nov 01 12:36:49 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0a845e71-844a-43e4-a6aa-c996b1f80b99 tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (87bdaca0-43f2-4be7-a5a6-f6e4b367f378) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:49 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0a845e71-844a-43e4-a6aa-c996b1f80b99 tempest-CreateVolumesFromImageTest-2036161004 None] Flow 'volume_create_manager' (35f057a8-4d6b-4fac-8c84-008dfb3a7da9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:36:49 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-0a845e71-844a-43e4-a6aa-c996b1f80b99 tempest-CreateVolumesFromImageTest-2036161004 None] Created volume successfully. Nov 01 12:36:50 devstack sudo[104299]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f911558b-7f1f-4d84-b8c1-dd2c4960b744 tempest-CreateVolumesFromImageTest-2036161004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6d3ef186-6817-41cf-ae0e-af7ba35b9cf1 1073741824" returned: 0 in 0.440s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f911558b-7f1f-4d84-b8c1-dd2c4960b744 tempest-CreateVolumesFromImageTest-2036161004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6d3ef186-6817-41cf-ae0e-af7ba35b9cf1 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:50 devstack sudo[104304]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6d3ef186-6817-41cf-ae0e-af7ba35b9cf1 Nov 01 12:36:50 devstack sudo[104304]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:50 devstack sudo[104304]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f911558b-7f1f-4d84-b8c1-dd2c4960b744 tempest-CreateVolumesFromImageTest-2036161004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6d3ef186-6817-41cf-ae0e-af7ba35b9cf1" returned: 0 in 0.262s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:50 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f911558b-7f1f-4d84-b8c1-dd2c4960b744 tempest-CreateVolumesFromImageTest-2036161004 None] <== create_volume: return (751ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:36:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f911558b-7f1f-4d84-b8c1-dd2c4960b744 tempest-CreateVolumesFromImageTest-2036161004 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:36:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f911558b-7f1f-4d84-b8c1-dd2c4960b744 tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (04df3d08-37f7-4e83-82d9-69bca4668b94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6d3ef186-6817-41cf-ae0e-af7ba35b9cf1', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f911558b-7f1f-4d84-b8c1-dd2c4960b744 tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6888ee74-d3e1-42e8-bc72-d2afa4c29a72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:36:50 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-f911558b-7f1f-4d84-b8c1-dd2c4960b744 tempest-CreateVolumesFromImageTest-2036161004 None] Volume volume-6d3ef186-6817-41cf-ae0e-af7ba35b9cf1 (6d3ef186-6817-41cf-ae0e-af7ba35b9cf1): created successfully Nov 01 12:36:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f911558b-7f1f-4d84-b8c1-dd2c4960b744 tempest-CreateVolumesFromImageTest-2036161004 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6888ee74-d3e1-42e8-bc72-d2afa4c29a72) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:36:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-f911558b-7f1f-4d84-b8c1-dd2c4960b744 tempest-CreateVolumesFromImageTest-2036161004 None] Flow 'volume_create_manager' (1a173bf3-48e9-4a7b-9c3f-c2fe10b34bc2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:36:50 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-f911558b-7f1f-4d84-b8c1-dd2c4960b744 tempest-CreateVolumesFromImageTest-2036161004 None] Created volume successfully. Nov 01 12:36:51 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-189a550b-8fee-41f2-8c1f-285edadf581d tempest-CreateVolumesFromImageTest-2036161004 None] Acquiring lock "cinder-6d3ef186-6817-41cf-ae0e-af7ba35b9cf1-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:36:51 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-189a550b-8fee-41f2-8c1f-285edadf581d tempest-CreateVolumesFromImageTest-2036161004 None] Lock "cinder-6d3ef186-6817-41cf-ae0e-af7ba35b9cf1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:36:51 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-189a550b-8fee-41f2-8c1f-285edadf581d tempest-CreateVolumesFromImageTest-2036161004 None] Acquiring lock "cinder-quobyte-6d3ef186-6817-41cf-ae0e-af7ba35b9cf1" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:36:51 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-189a550b-8fee-41f2-8c1f-285edadf581d tempest-CreateVolumesFromImageTest-2036161004 None] Lock "cinder-quobyte-6d3ef186-6817-41cf-ae0e-af7ba35b9cf1" acquired by "delete_volume" :: waited 0.016s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:36:51 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[e0e03876-0073-4a3a-9fe2-ee48e8402a60]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:36:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-189a550b-8fee-41f2-8c1f-285edadf581d tempest-CreateVolumesFromImageTest-2036161004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6d3ef186-6817-41cf-ae0e-af7ba35b9cf1 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:51 devstack sudo[104307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6d3ef186-6817-41cf-ae0e-af7ba35b9cf1 Nov 01 12:36:51 devstack sudo[104307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:52 devstack sudo[104307]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-189a550b-8fee-41f2-8c1f-285edadf581d tempest-CreateVolumesFromImageTest-2036161004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6d3ef186-6817-41cf-ae0e-af7ba35b9cf1" returned: 0 in 0.359s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-189a550b-8fee-41f2-8c1f-285edadf581d tempest-CreateVolumesFromImageTest-2036161004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6d3ef186-6817-41cf-ae0e-af7ba35b9cf1 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:52 devstack sudo[104312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6d3ef186-6817-41cf-ae0e-af7ba35b9cf1 Nov 01 12:36:52 devstack sudo[104312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:52 devstack sudo[104312]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-189a550b-8fee-41f2-8c1f-285edadf581d tempest-CreateVolumesFromImageTest-2036161004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6d3ef186-6817-41cf-ae0e-af7ba35b9cf1" returned: 0 in 0.246s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:52 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-189a550b-8fee-41f2-8c1f-285edadf581d tempest-CreateVolumesFromImageTest-2036161004 None] Lock "cinder-quobyte-6d3ef186-6817-41cf-ae0e-af7ba35b9cf1" released by "delete_volume" :: held 0.653s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:36:52 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-189a550b-8fee-41f2-8c1f-285edadf581d tempest-CreateVolumesFromImageTest-2036161004 None] Created reservations ['9af9b85b-5aff-4471-bc2b-3e06851a45ed', 'd8e552c6-f9f9-4c52-9bd5-505ac1a61e84', '8e711991-b105-47f5-9ab4-32c31c348c2c', '034de47d-d6b1-43fa-8dd9-8da7a8c15358'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:36:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-189a550b-8fee-41f2-8c1f-285edadf581d tempest-CreateVolumesFromImageTest-2036161004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:36:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-189a550b-8fee-41f2-8c1f-285edadf581d tempest-CreateVolumesFromImageTest-2036161004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:36:52 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-189a550b-8fee-41f2-8c1f-285edadf581d tempest-CreateVolumesFromImageTest-2036161004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:36:52 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-189a550b-8fee-41f2-8c1f-285edadf581d tempest-CreateVolumesFromImageTest-2036161004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:36:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-189a550b-8fee-41f2-8c1f-285edadf581d tempest-CreateVolumesFromImageTest-2036161004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:36:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-189a550b-8fee-41f2-8c1f-285edadf581d tempest-CreateVolumesFromImageTest-2036161004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:52 devstack sudo[104315]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:36:52 devstack sudo[104315]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:52 devstack sudo[104315]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-189a550b-8fee-41f2-8c1f-285edadf581d tempest-CreateVolumesFromImageTest-2036161004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.249s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:52 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-189a550b-8fee-41f2-8c1f-285edadf581d tempest-CreateVolumesFromImageTest-2036161004 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:36:52 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-189a550b-8fee-41f2-8c1f-285edadf581d tempest-CreateVolumesFromImageTest-2036161004 None] Deleted volume successfully. Nov 01 12:36:52 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-189a550b-8fee-41f2-8c1f-285edadf581d tempest-CreateVolumesFromImageTest-2036161004 None] Lock "cinder-6d3ef186-6817-41cf-ae0e-af7ba35b9cf1-delete_volume" released by "delete_volume" :: held 1.103s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:36:52 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-343c0e1d-7202-4679-a66c-244aa928bfcd tempest-CreateVolumesFromImageTest-2036161004 None] Acquiring lock "cinder-ef3068e3-733f-4b8a-824e-e397cf676ff8-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:36:52 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-343c0e1d-7202-4679-a66c-244aa928bfcd tempest-CreateVolumesFromImageTest-2036161004 None] Lock "cinder-ef3068e3-733f-4b8a-824e-e397cf676ff8-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:36:52 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-343c0e1d-7202-4679-a66c-244aa928bfcd tempest-CreateVolumesFromImageTest-2036161004 None] Acquiring lock "cinder-quobyte-ef3068e3-733f-4b8a-824e-e397cf676ff8" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:36:52 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-343c0e1d-7202-4679-a66c-244aa928bfcd tempest-CreateVolumesFromImageTest-2036161004 None] Lock "cinder-quobyte-ef3068e3-733f-4b8a-824e-e397cf676ff8" acquired by "delete_volume" :: waited 0.016s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:36:52 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ae11329-f00b-44eb-9596-fa4ed6561c83]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:36:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-343c0e1d-7202-4679-a66c-244aa928bfcd tempest-CreateVolumesFromImageTest-2036161004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ef3068e3-733f-4b8a-824e-e397cf676ff8 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:52 devstack sudo[104318]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ef3068e3-733f-4b8a-824e-e397cf676ff8 Nov 01 12:36:52 devstack sudo[104318]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:53 devstack sudo[104318]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-343c0e1d-7202-4679-a66c-244aa928bfcd tempest-CreateVolumesFromImageTest-2036161004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ef3068e3-733f-4b8a-824e-e397cf676ff8" returned: 0 in 0.356s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-343c0e1d-7202-4679-a66c-244aa928bfcd tempest-CreateVolumesFromImageTest-2036161004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ef3068e3-733f-4b8a-824e-e397cf676ff8 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:53 devstack sudo[104323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ef3068e3-733f-4b8a-824e-e397cf676ff8 Nov 01 12:36:53 devstack sudo[104323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:53 devstack sudo[104323]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-343c0e1d-7202-4679-a66c-244aa928bfcd tempest-CreateVolumesFromImageTest-2036161004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ef3068e3-733f-4b8a-824e-e397cf676ff8" returned: 0 in 0.252s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:53 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-343c0e1d-7202-4679-a66c-244aa928bfcd tempest-CreateVolumesFromImageTest-2036161004 None] Lock "cinder-quobyte-ef3068e3-733f-4b8a-824e-e397cf676ff8" released by "delete_volume" :: held 0.648s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:36:53 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-343c0e1d-7202-4679-a66c-244aa928bfcd tempest-CreateVolumesFromImageTest-2036161004 None] Created reservations ['0d4006d4-711d-4f83-9cb0-c2aa62036d2b', 'e0d7c07d-b8c2-4a1b-97bb-09d0f0589cca', '919d5afa-ff17-4fd9-b9a0-3767053f7ba8', '266ffae0-b205-4059-9adc-43e64ba7733c'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:36:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-343c0e1d-7202-4679-a66c-244aa928bfcd tempest-CreateVolumesFromImageTest-2036161004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:36:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-343c0e1d-7202-4679-a66c-244aa928bfcd tempest-CreateVolumesFromImageTest-2036161004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:36:53 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-343c0e1d-7202-4679-a66c-244aa928bfcd tempest-CreateVolumesFromImageTest-2036161004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:36:53 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-343c0e1d-7202-4679-a66c-244aa928bfcd tempest-CreateVolumesFromImageTest-2036161004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:36:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-343c0e1d-7202-4679-a66c-244aa928bfcd tempest-CreateVolumesFromImageTest-2036161004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:36:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-343c0e1d-7202-4679-a66c-244aa928bfcd tempest-CreateVolumesFromImageTest-2036161004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:53 devstack sudo[104326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:36:53 devstack sudo[104326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:53 devstack sudo[104326]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-343c0e1d-7202-4679-a66c-244aa928bfcd tempest-CreateVolumesFromImageTest-2036161004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.244s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:53 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-343c0e1d-7202-4679-a66c-244aa928bfcd tempest-CreateVolumesFromImageTest-2036161004 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:36:53 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-343c0e1d-7202-4679-a66c-244aa928bfcd tempest-CreateVolumesFromImageTest-2036161004 None] Deleted volume successfully. Nov 01 12:36:53 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-343c0e1d-7202-4679-a66c-244aa928bfcd tempest-CreateVolumesFromImageTest-2036161004 None] Lock "cinder-ef3068e3-733f-4b8a-824e-e397cf676ff8-delete_volume" released by "delete_volume" :: held 1.108s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:36:53 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-dcbe0496-d836-417c-a72f-1413b37e3a23 tempest-CreateVolumesFromImageTest-2036161004 None] Acquiring lock "cinder-d10246f7-c78e-4a0c-959a-e1fcd63a23bd-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:36:53 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-dcbe0496-d836-417c-a72f-1413b37e3a23 tempest-CreateVolumesFromImageTest-2036161004 None] Lock "cinder-d10246f7-c78e-4a0c-959a-e1fcd63a23bd-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:36:53 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-dcbe0496-d836-417c-a72f-1413b37e3a23 tempest-CreateVolumesFromImageTest-2036161004 None] Acquiring lock "cinder-quobyte-d10246f7-c78e-4a0c-959a-e1fcd63a23bd" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:36:54 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-dcbe0496-d836-417c-a72f-1413b37e3a23 tempest-CreateVolumesFromImageTest-2036161004 None] Lock "cinder-quobyte-d10246f7-c78e-4a0c-959a-e1fcd63a23bd" acquired by "delete_volume" :: waited 0.020s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:36:54 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[c12d9e62-9a4e-435c-b7c5-58d4fbffd402]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:36:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-dcbe0496-d836-417c-a72f-1413b37e3a23 tempest-CreateVolumesFromImageTest-2036161004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d10246f7-c78e-4a0c-959a-e1fcd63a23bd {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:54 devstack sudo[104329]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d10246f7-c78e-4a0c-959a-e1fcd63a23bd Nov 01 12:36:54 devstack sudo[104329]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:54 devstack sudo[104329]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-dcbe0496-d836-417c-a72f-1413b37e3a23 tempest-CreateVolumesFromImageTest-2036161004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d10246f7-c78e-4a0c-959a-e1fcd63a23bd" returned: 0 in 0.370s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-dcbe0496-d836-417c-a72f-1413b37e3a23 tempest-CreateVolumesFromImageTest-2036161004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d10246f7-c78e-4a0c-959a-e1fcd63a23bd {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:54 devstack sudo[104334]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d10246f7-c78e-4a0c-959a-e1fcd63a23bd Nov 01 12:36:54 devstack sudo[104334]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:54 devstack sudo[104334]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-dcbe0496-d836-417c-a72f-1413b37e3a23 tempest-CreateVolumesFromImageTest-2036161004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d10246f7-c78e-4a0c-959a-e1fcd63a23bd" returned: 0 in 0.259s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:54 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-dcbe0496-d836-417c-a72f-1413b37e3a23 tempest-CreateVolumesFromImageTest-2036161004 None] Lock "cinder-quobyte-d10246f7-c78e-4a0c-959a-e1fcd63a23bd" released by "delete_volume" :: held 0.670s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:36:54 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-dcbe0496-d836-417c-a72f-1413b37e3a23 tempest-CreateVolumesFromImageTest-2036161004 None] Created reservations ['dea62170-bb37-4553-9e8c-ae565c500b8c', '3f545984-905d-4220-a996-61e8e1662583', '93114bb7-27d8-495c-81f5-983f23f06dd3', 'a367c24f-b3a4-436c-981e-280ab9e26ce8'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:36:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dcbe0496-d836-417c-a72f-1413b37e3a23 tempest-CreateVolumesFromImageTest-2036161004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:36:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dcbe0496-d836-417c-a72f-1413b37e3a23 tempest-CreateVolumesFromImageTest-2036161004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:36:54 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-dcbe0496-d836-417c-a72f-1413b37e3a23 tempest-CreateVolumesFromImageTest-2036161004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:36:54 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-dcbe0496-d836-417c-a72f-1413b37e3a23 tempest-CreateVolumesFromImageTest-2036161004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:36:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dcbe0496-d836-417c-a72f-1413b37e3a23 tempest-CreateVolumesFromImageTest-2036161004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:36:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-dcbe0496-d836-417c-a72f-1413b37e3a23 tempest-CreateVolumesFromImageTest-2036161004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:54 devstack sudo[104337]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:36:54 devstack sudo[104337]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:55 devstack sudo[104337]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-dcbe0496-d836-417c-a72f-1413b37e3a23 tempest-CreateVolumesFromImageTest-2036161004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.277s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:55 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-dcbe0496-d836-417c-a72f-1413b37e3a23 tempest-CreateVolumesFromImageTest-2036161004 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:36:55 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-dcbe0496-d836-417c-a72f-1413b37e3a23 tempest-CreateVolumesFromImageTest-2036161004 None] Deleted volume successfully. Nov 01 12:36:55 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-dcbe0496-d836-417c-a72f-1413b37e3a23 tempest-CreateVolumesFromImageTest-2036161004 None] Lock "cinder-d10246f7-c78e-4a0c-959a-e1fcd63a23bd-delete_volume" released by "delete_volume" :: held 1.155s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:36:55 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-8139d54e-9019-4dd2-a6b2-9d10942b2f26 tempest-CreateVolumesFromImageTest-2036161004 None] Acquiring lock "cinder-192d8c81-3022-48e4-b89c-902b6c3526c5-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:36:55 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-8139d54e-9019-4dd2-a6b2-9d10942b2f26 tempest-CreateVolumesFromImageTest-2036161004 None] Lock "cinder-192d8c81-3022-48e4-b89c-902b6c3526c5-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:36:55 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-8139d54e-9019-4dd2-a6b2-9d10942b2f26 tempest-CreateVolumesFromImageTest-2036161004 None] Acquiring lock "cinder-quobyte-192d8c81-3022-48e4-b89c-902b6c3526c5" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:36:55 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-8139d54e-9019-4dd2-a6b2-9d10942b2f26 tempest-CreateVolumesFromImageTest-2036161004 None] Lock "cinder-quobyte-192d8c81-3022-48e4-b89c-902b6c3526c5" acquired by "delete_volume" :: waited 0.016s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:36:55 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fb7f070-94e6-465f-8375-ac01f34c8fb1]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:36:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8139d54e-9019-4dd2-a6b2-9d10942b2f26 tempest-CreateVolumesFromImageTest-2036161004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-192d8c81-3022-48e4-b89c-902b6c3526c5 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:55 devstack sudo[104359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-192d8c81-3022-48e4-b89c-902b6c3526c5 Nov 01 12:36:55 devstack sudo[104359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:55 devstack sudo[104359]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8139d54e-9019-4dd2-a6b2-9d10942b2f26 tempest-CreateVolumesFromImageTest-2036161004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-192d8c81-3022-48e4-b89c-902b6c3526c5" returned: 0 in 0.364s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8139d54e-9019-4dd2-a6b2-9d10942b2f26 tempest-CreateVolumesFromImageTest-2036161004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-192d8c81-3022-48e4-b89c-902b6c3526c5 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:55 devstack sudo[104364]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-192d8c81-3022-48e4-b89c-902b6c3526c5 Nov 01 12:36:55 devstack sudo[104364]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:55 devstack sudo[104364]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8139d54e-9019-4dd2-a6b2-9d10942b2f26 tempest-CreateVolumesFromImageTest-2036161004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-192d8c81-3022-48e4-b89c-902b6c3526c5" returned: 0 in 0.241s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:55 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-8139d54e-9019-4dd2-a6b2-9d10942b2f26 tempest-CreateVolumesFromImageTest-2036161004 None] Lock "cinder-quobyte-192d8c81-3022-48e4-b89c-902b6c3526c5" released by "delete_volume" :: held 0.653s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:36:55 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-8139d54e-9019-4dd2-a6b2-9d10942b2f26 tempest-CreateVolumesFromImageTest-2036161004 None] Created reservations ['600c53c3-d0b7-4d54-9751-184e83a89262', '5b9e70bb-91b5-4f32-afff-31a879b1ed0e', 'e049e224-697e-481a-81cb-530afc22115e', '5e5735dc-4636-4dff-b69d-d635682d594a'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:36:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8139d54e-9019-4dd2-a6b2-9d10942b2f26 tempest-CreateVolumesFromImageTest-2036161004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:36:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8139d54e-9019-4dd2-a6b2-9d10942b2f26 tempest-CreateVolumesFromImageTest-2036161004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:36:55 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-8139d54e-9019-4dd2-a6b2-9d10942b2f26 tempest-CreateVolumesFromImageTest-2036161004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:36:55 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-8139d54e-9019-4dd2-a6b2-9d10942b2f26 tempest-CreateVolumesFromImageTest-2036161004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:36:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8139d54e-9019-4dd2-a6b2-9d10942b2f26 tempest-CreateVolumesFromImageTest-2036161004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:36:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8139d54e-9019-4dd2-a6b2-9d10942b2f26 tempest-CreateVolumesFromImageTest-2036161004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:55 devstack sudo[104367]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:36:55 devstack sudo[104367]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:56 devstack sudo[104367]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8139d54e-9019-4dd2-a6b2-9d10942b2f26 tempest-CreateVolumesFromImageTest-2036161004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.241s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:56 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-8139d54e-9019-4dd2-a6b2-9d10942b2f26 tempest-CreateVolumesFromImageTest-2036161004 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:36:56 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-8139d54e-9019-4dd2-a6b2-9d10942b2f26 tempest-CreateVolumesFromImageTest-2036161004 None] Deleted volume successfully. Nov 01 12:36:56 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-8139d54e-9019-4dd2-a6b2-9d10942b2f26 tempest-CreateVolumesFromImageTest-2036161004 None] Lock "cinder-192d8c81-3022-48e4-b89c-902b6c3526c5-delete_volume" released by "delete_volume" :: held 1.094s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:36:56 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-3bdbe426-4d44-42b9-8424-a576e50ad28b tempest-CreateVolumesFromImageTest-2036161004 None] Acquiring lock "cinder-f0dcc121-0949-4a43-aed0-0eafae131b84-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:36:56 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-3bdbe426-4d44-42b9-8424-a576e50ad28b tempest-CreateVolumesFromImageTest-2036161004 None] Lock "cinder-f0dcc121-0949-4a43-aed0-0eafae131b84-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:36:56 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-3bdbe426-4d44-42b9-8424-a576e50ad28b tempest-CreateVolumesFromImageTest-2036161004 None] Acquiring lock "cinder-quobyte-f0dcc121-0949-4a43-aed0-0eafae131b84" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:36:56 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-3bdbe426-4d44-42b9-8424-a576e50ad28b tempest-CreateVolumesFromImageTest-2036161004 None] Lock "cinder-quobyte-f0dcc121-0949-4a43-aed0-0eafae131b84" acquired by "delete_volume" :: waited 0.014s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:36:56 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f8878bd-def3-421e-b798-95cf9ca51881]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:36:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3bdbe426-4d44-42b9-8424-a576e50ad28b tempest-CreateVolumesFromImageTest-2036161004 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0dcc121-0949-4a43-aed0-0eafae131b84 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:56 devstack sudo[104370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0dcc121-0949-4a43-aed0-0eafae131b84 Nov 01 12:36:56 devstack sudo[104370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:56 devstack sudo[104370]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3bdbe426-4d44-42b9-8424-a576e50ad28b tempest-CreateVolumesFromImageTest-2036161004 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0dcc121-0949-4a43-aed0-0eafae131b84" returned: 0 in 0.346s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3bdbe426-4d44-42b9-8424-a576e50ad28b tempest-CreateVolumesFromImageTest-2036161004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0dcc121-0949-4a43-aed0-0eafae131b84 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:56 devstack sudo[104375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0dcc121-0949-4a43-aed0-0eafae131b84 Nov 01 12:36:56 devstack sudo[104375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:56 devstack sudo[104375]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3bdbe426-4d44-42b9-8424-a576e50ad28b tempest-CreateVolumesFromImageTest-2036161004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0dcc121-0949-4a43-aed0-0eafae131b84" returned: 0 in 0.244s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:56 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-3bdbe426-4d44-42b9-8424-a576e50ad28b tempest-CreateVolumesFromImageTest-2036161004 None] Lock "cinder-quobyte-f0dcc121-0949-4a43-aed0-0eafae131b84" released by "delete_volume" :: held 0.632s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:36:57 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-3bdbe426-4d44-42b9-8424-a576e50ad28b tempest-CreateVolumesFromImageTest-2036161004 None] Created reservations ['1be7f759-16aa-4fe4-9429-a20c1f706872', 'e1125af7-16ee-4fae-9354-c4475df2bdb5', '27fc65d3-029f-4150-b9a4-085b0746fe31', 'bf92f02c-89fd-4865-bd14-2cfee7ec55df'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:36:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-3bdbe426-4d44-42b9-8424-a576e50ad28b tempest-CreateVolumesFromImageTest-2036161004 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:36:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-3bdbe426-4d44-42b9-8424-a576e50ad28b tempest-CreateVolumesFromImageTest-2036161004 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:36:57 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-3bdbe426-4d44-42b9-8424-a576e50ad28b tempest-CreateVolumesFromImageTest-2036161004 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:36:57 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-3bdbe426-4d44-42b9-8424-a576e50ad28b tempest-CreateVolumesFromImageTest-2036161004 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:36:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-3bdbe426-4d44-42b9-8424-a576e50ad28b tempest-CreateVolumesFromImageTest-2036161004 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:36:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3bdbe426-4d44-42b9-8424-a576e50ad28b tempest-CreateVolumesFromImageTest-2036161004 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:36:57 devstack sudo[104378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:36:57 devstack sudo[104378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:36:57 devstack sudo[104378]: pam_unix(sudo:session): session closed for user root Nov 01 12:36:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3bdbe426-4d44-42b9-8424-a576e50ad28b tempest-CreateVolumesFromImageTest-2036161004 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.246s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:36:57 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-3bdbe426-4d44-42b9-8424-a576e50ad28b tempest-CreateVolumesFromImageTest-2036161004 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:36:57 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-3bdbe426-4d44-42b9-8424-a576e50ad28b tempest-CreateVolumesFromImageTest-2036161004 None] Deleted volume successfully. Nov 01 12:36:57 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-3bdbe426-4d44-42b9-8424-a576e50ad28b tempest-CreateVolumesFromImageTest-2036161004 None] Lock "cinder-f0dcc121-0949-4a43-aed0-0eafae131b84-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:37:00 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-0381fd03-2c3b-48c8-b22f-44ef38052c8a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:37:00 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0381fd03-2c3b-48c8-b22f-44ef38052c8a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Flow 'volume_create_manager' (07b3029a-115d-45dd-8e42-e7eb58fc4192) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:37:00 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0381fd03-2c3b-48c8-b22f-44ef38052c8a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (488c4330-d664-42ed-8682-a370c4afe7d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:00 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0381fd03-2c3b-48c8-b22f-44ef38052c8a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (488c4330-d664-42ed-8682-a370c4afe7d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1527802505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f34cee6-e651-4278-9fc9-1493f693924b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0273f2c7eeb3460b8e55c61c5cc1f479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:37:00Z,use_quota=True,user_id='518cd9ff51b64019ac6dcdb6811ee69b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:00 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0381fd03-2c3b-48c8-b22f-44ef38052c8a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (529786f7-51cc-4476-bcf4-48675b207d8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:00 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0381fd03-2c3b-48c8-b22f-44ef38052c8a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (529786f7-51cc-4476-bcf4-48675b207d8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:00 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0381fd03-2c3b-48c8-b22f-44ef38052c8a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43ed15be-6513-44ab-99ea-b69d80e8d5f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:00 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0381fd03-2c3b-48c8-b22f-44ef38052c8a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43ed15be-6513-44ab-99ea-b69d80e8d5f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4f34cee6-e651-4278-9fc9-1493f693924b', 'volume_name': 'volume-4f34cee6-e651-4278-9fc9-1493f693924b', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:00 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0381fd03-2c3b-48c8-b22f-44ef38052c8a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3ebb41f-819f-4caa-8367-42d2a668eddc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:00 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0381fd03-2c3b-48c8-b22f-44ef38052c8a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3ebb41f-819f-4caa-8367-42d2a668eddc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:00 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0381fd03-2c3b-48c8-b22f-44ef38052c8a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0c3d6ad-7b36-4e49-9380-849fdd603b18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:00 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-0381fd03-2c3b-48c8-b22f-44ef38052c8a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Volume 4f34cee6-e651-4278-9fc9-1493f693924b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4f34cee6-e651-4278-9fc9-1493f693924b', 'volume_size': 1} Nov 01 12:37:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0381fd03-2c3b-48c8-b22f-44ef38052c8a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0381fd03-2c3b-48c8-b22f-44ef38052c8a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:00 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-0381fd03-2c3b-48c8-b22f-44ef38052c8a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:37:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1527802505',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4f34cee6-e651-4278-9fc9-1493f693924b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0273f2c7eeb3460b8e55c61c5cc1f479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:37:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:37:00Z,use_quota=True,user_id='518cd9ff51b64019ac6dcdb6811ee69b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:37:00 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-0381fd03-2c3b-48c8-b22f-44ef38052c8a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Creating volume 4f34cee6-e651-4278-9fc9-1493f693924b {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:37:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0381fd03-2c3b-48c8-b22f-44ef38052c8a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0381fd03-2c3b-48c8-b22f-44ef38052c8a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:00 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-0381fd03-2c3b-48c8-b22f-44ef38052c8a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:37:00 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-0381fd03-2c3b-48c8-b22f-44ef38052c8a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:37:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0381fd03-2c3b-48c8-b22f-44ef38052c8a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:00 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-0381fd03-2c3b-48c8-b22f-44ef38052c8a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:37:00 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-0381fd03-2c3b-48c8-b22f-44ef38052c8a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:37:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0381fd03-2c3b-48c8-b22f-44ef38052c8a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4f34cee6-e651-4278-9fc9-1493f693924b 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:00 devstack sudo[104383]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4f34cee6-e651-4278-9fc9-1493f693924b 1073741824 Nov 01 12:37:00 devstack sudo[104383]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:00 devstack sudo[104383]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0381fd03-2c3b-48c8-b22f-44ef38052c8a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4f34cee6-e651-4278-9fc9-1493f693924b 1073741824" returned: 0 in 0.407s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0381fd03-2c3b-48c8-b22f-44ef38052c8a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4f34cee6-e651-4278-9fc9-1493f693924b {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:00 devstack sudo[104389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4f34cee6-e651-4278-9fc9-1493f693924b Nov 01 12:37:00 devstack sudo[104389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:01 devstack sudo[104389]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0381fd03-2c3b-48c8-b22f-44ef38052c8a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4f34cee6-e651-4278-9fc9-1493f693924b" returned: 0 in 0.247s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:01 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-0381fd03-2c3b-48c8-b22f-44ef38052c8a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] <== create_volume: return (694ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:37:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0381fd03-2c3b-48c8-b22f-44ef38052c8a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.697s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:01 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0381fd03-2c3b-48c8-b22f-44ef38052c8a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b0c3d6ad-7b36-4e49-9380-849fdd603b18) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4f34cee6-e651-4278-9fc9-1493f693924b', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:01 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0381fd03-2c3b-48c8-b22f-44ef38052c8a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb7558f7-7df1-44f4-ad98-5380906ce66b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:01 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-0381fd03-2c3b-48c8-b22f-44ef38052c8a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Volume volume-4f34cee6-e651-4278-9fc9-1493f693924b (4f34cee6-e651-4278-9fc9-1493f693924b): created successfully Nov 01 12:37:01 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0381fd03-2c3b-48c8-b22f-44ef38052c8a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bb7558f7-7df1-44f4-ad98-5380906ce66b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:01 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0381fd03-2c3b-48c8-b22f-44ef38052c8a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Flow 'volume_create_manager' (07b3029a-115d-45dd-8e42-e7eb58fc4192) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:37:01 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-0381fd03-2c3b-48c8-b22f-44ef38052c8a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Created volume successfully. Nov 01 12:37:01 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5091a8b-9fd6-4c1d-8730-f6ecc86e8e59 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:37:01 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e5091a8b-9fd6-4c1d-8730-f6ecc86e8e59 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Flow 'volume_create_manager' (b5014146-3178-46d0-8ae4-6a4d1542387d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:37:01 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e5091a8b-9fd6-4c1d-8730-f6ecc86e8e59 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0099d04d-9193-489e-be63-9634423e99ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:01 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e5091a8b-9fd6-4c1d-8730-f6ecc86e8e59 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0099d04d-9193-489e-be63-9634423e99ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2140536485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5709e45-7a5c-4453-b4f7-41b2df9dbee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0273f2c7eeb3460b8e55c61c5cc1f479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:37:02Z,use_quota=True,user_id='518cd9ff51b64019ac6dcdb6811ee69b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:01 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e5091a8b-9fd6-4c1d-8730-f6ecc86e8e59 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c499777-0e48-4819-a098-74dae2130e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:01 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e5091a8b-9fd6-4c1d-8730-f6ecc86e8e59 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5c499777-0e48-4819-a098-74dae2130e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:01 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e5091a8b-9fd6-4c1d-8730-f6ecc86e8e59 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece13177-cdb9-4407-92f1-acefb7c46570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:01 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e5091a8b-9fd6-4c1d-8730-f6ecc86e8e59 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ece13177-cdb9-4407-92f1-acefb7c46570) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e5709e45-7a5c-4453-b4f7-41b2df9dbee1', 'volume_name': 'volume-e5709e45-7a5c-4453-b4f7-41b2df9dbee1', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:01 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e5091a8b-9fd6-4c1d-8730-f6ecc86e8e59 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4af12ea7-4657-46fd-8d50-4c05f0c14383) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:01 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e5091a8b-9fd6-4c1d-8730-f6ecc86e8e59 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4af12ea7-4657-46fd-8d50-4c05f0c14383) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:01 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e5091a8b-9fd6-4c1d-8730-f6ecc86e8e59 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c64e4c4-f2c6-4dc1-96a7-8524e838199c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:01 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-e5091a8b-9fd6-4c1d-8730-f6ecc86e8e59 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Volume e5709e45-7a5c-4453-b4f7-41b2df9dbee1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e5709e45-7a5c-4453-b4f7-41b2df9dbee1', 'volume_size': 1} Nov 01 12:37:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e5091a8b-9fd6-4c1d-8730-f6ecc86e8e59 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e5091a8b-9fd6-4c1d-8730-f6ecc86e8e59 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:01 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e5091a8b-9fd6-4c1d-8730-f6ecc86e8e59 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:37:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2140536485',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e5709e45-7a5c-4453-b4f7-41b2df9dbee1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0273f2c7eeb3460b8e55c61c5cc1f479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:37:02Z,use_quota=True,user_id='518cd9ff51b64019ac6dcdb6811ee69b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:37:01 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-e5091a8b-9fd6-4c1d-8730-f6ecc86e8e59 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Creating volume e5709e45-7a5c-4453-b4f7-41b2df9dbee1 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:37:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e5091a8b-9fd6-4c1d-8730-f6ecc86e8e59 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e5091a8b-9fd6-4c1d-8730-f6ecc86e8e59 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:01 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e5091a8b-9fd6-4c1d-8730-f6ecc86e8e59 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:37:01 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e5091a8b-9fd6-4c1d-8730-f6ecc86e8e59 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:37:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e5091a8b-9fd6-4c1d-8730-f6ecc86e8e59 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:01 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e5091a8b-9fd6-4c1d-8730-f6ecc86e8e59 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:37:01 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-e5091a8b-9fd6-4c1d-8730-f6ecc86e8e59 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:37:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e5091a8b-9fd6-4c1d-8730-f6ecc86e8e59 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e5709e45-7a5c-4453-b4f7-41b2df9dbee1 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:01 devstack sudo[104392]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e5709e45-7a5c-4453-b4f7-41b2df9dbee1 1073741824 Nov 01 12:37:01 devstack sudo[104392]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:02 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-3b076d35-1545-463f-8378-e567ca42e025 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:37:02 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-3b076d35-1545-463f-8378-e567ca42e025 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Flow 'volume_create_manager' (4b4ccf1f-4ab8-471f-bbb9-6a3a84aafd59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:37:02 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-3b076d35-1545-463f-8378-e567ca42e025 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ff0582e-1dd2-4f3b-be43-f52a291fd376) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:02 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-3b076d35-1545-463f-8378-e567ca42e025 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8ff0582e-1dd2-4f3b-be43-f52a291fd376) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:37:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1962806421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b31b9232-68a5-47b3-ab69-4caaa7e8e054,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0273f2c7eeb3460b8e55c61c5cc1f479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:37:02Z,use_quota=True,user_id='518cd9ff51b64019ac6dcdb6811ee69b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:02 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-3b076d35-1545-463f-8378-e567ca42e025 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (899471b3-f52f-45a3-ae0f-607ee0fb13ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:02 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-3b076d35-1545-463f-8378-e567ca42e025 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (899471b3-f52f-45a3-ae0f-607ee0fb13ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:02 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-3b076d35-1545-463f-8378-e567ca42e025 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e94d899f-0254-45cb-8838-3b6a247a68ee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:02 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-3b076d35-1545-463f-8378-e567ca42e025 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e94d899f-0254-45cb-8838-3b6a247a68ee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b31b9232-68a5-47b3-ab69-4caaa7e8e054', 'volume_name': 'volume-b31b9232-68a5-47b3-ab69-4caaa7e8e054', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:02 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-3b076d35-1545-463f-8378-e567ca42e025 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9375ffd3-b8f0-495d-ae8c-ee620dfa6d14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:02 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-3b076d35-1545-463f-8378-e567ca42e025 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9375ffd3-b8f0-495d-ae8c-ee620dfa6d14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:02 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-3b076d35-1545-463f-8378-e567ca42e025 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bc0b1e0-43c1-414f-80d0-bf78f5f52f99) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:02 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-3b076d35-1545-463f-8378-e567ca42e025 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Volume b31b9232-68a5-47b3-ab69-4caaa7e8e054: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b31b9232-68a5-47b3-ab69-4caaa7e8e054', 'volume_size': 1} Nov 01 12:37:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-3b076d35-1545-463f-8378-e567ca42e025 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:02 devstack sudo[104392]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e5091a8b-9fd6-4c1d-8730-f6ecc86e8e59 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e5709e45-7a5c-4453-b4f7-41b2df9dbee1 1073741824" returned: 0 in 0.622s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:02 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-385568fb-3119-4f6e-b540-1cf6ef6ffaba tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:37:02 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-385568fb-3119-4f6e-b540-1cf6ef6ffaba tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Flow 'volume_create_manager' (87cec750-092d-4f1a-a8e1-927c70857ed9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:37:02 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-385568fb-3119-4f6e-b540-1cf6ef6ffaba tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdca185f-b9cd-417a-aef4-8cc344351100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e5091a8b-9fd6-4c1d-8730-f6ecc86e8e59 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e5709e45-7a5c-4453-b4f7-41b2df9dbee1 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:02 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-385568fb-3119-4f6e-b540-1cf6ef6ffaba tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdca185f-b9cd-417a-aef4-8cc344351100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:37:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1061617350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c44c39cf-2464-48db-957c-e0c45ce3bc30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0273f2c7eeb3460b8e55c61c5cc1f479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:37:03Z,use_quota=True,user_id='518cd9ff51b64019ac6dcdb6811ee69b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:02 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-385568fb-3119-4f6e-b540-1cf6ef6ffaba tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b264cbf3-b4fd-4290-832f-bec339f30c90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:02 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-385568fb-3119-4f6e-b540-1cf6ef6ffaba tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b264cbf3-b4fd-4290-832f-bec339f30c90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:02 devstack sudo[104398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e5709e45-7a5c-4453-b4f7-41b2df9dbee1 Nov 01 12:37:02 devstack sudo[104398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:02 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-385568fb-3119-4f6e-b540-1cf6ef6ffaba tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52f3d321-c1eb-4724-a232-4c63de9e690c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:02 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-385568fb-3119-4f6e-b540-1cf6ef6ffaba tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (52f3d321-c1eb-4724-a232-4c63de9e690c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c44c39cf-2464-48db-957c-e0c45ce3bc30', 'volume_name': 'volume-c44c39cf-2464-48db-957c-e0c45ce3bc30', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:02 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-385568fb-3119-4f6e-b540-1cf6ef6ffaba tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (864e199d-cc9a-41d4-bc71-155be4f25f96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:02 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-385568fb-3119-4f6e-b540-1cf6ef6ffaba tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (864e199d-cc9a-41d4-bc71-155be4f25f96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:02 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-385568fb-3119-4f6e-b540-1cf6ef6ffaba tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d3a277a-72c4-4517-ae7c-80f2e1345a83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:02 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-385568fb-3119-4f6e-b540-1cf6ef6ffaba tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Volume c44c39cf-2464-48db-957c-e0c45ce3bc30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c44c39cf-2464-48db-957c-e0c45ce3bc30', 'volume_size': 1} Nov 01 12:37:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-385568fb-3119-4f6e-b540-1cf6ef6ffaba tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:02 devstack sudo[104398]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e5091a8b-9fd6-4c1d-8730-f6ecc86e8e59 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e5709e45-7a5c-4453-b4f7-41b2df9dbee1" returned: 0 in 0.377s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:02 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e5091a8b-9fd6-4c1d-8730-f6ecc86e8e59 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] <== create_volume: return (1090ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:37:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e5091a8b-9fd6-4c1d-8730-f6ecc86e8e59 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-3b076d35-1545-463f-8378-e567ca42e025 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.681s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-3b076d35-1545-463f-8378-e567ca42e025 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:37:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1962806421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b31b9232-68a5-47b3-ab69-4caaa7e8e054,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0273f2c7eeb3460b8e55c61c5cc1f479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:37:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:37:02Z,use_quota=True,user_id='518cd9ff51b64019ac6dcdb6811ee69b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-3b076d35-1545-463f-8378-e567ca42e025 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Creating volume b31b9232-68a5-47b3-ab69-4caaa7e8e054 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-3b076d35-1545-463f-8378-e567ca42e025 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-3b076d35-1545-463f-8378-e567ca42e025 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-3b076d35-1545-463f-8378-e567ca42e025 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-3b076d35-1545-463f-8378-e567ca42e025 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-3b076d35-1545-463f-8378-e567ca42e025 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-3b076d35-1545-463f-8378-e567ca42e025 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:37:03 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-3b076d35-1545-463f-8378-e567ca42e025 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3b076d35-1545-463f-8378-e567ca42e025 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b31b9232-68a5-47b3-ab69-4caaa7e8e054 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:03 devstack sudo[104401]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b31b9232-68a5-47b3-ab69-4caaa7e8e054 1073741824 Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-ba991911-b9ed-45f3-b377-ea2f9066ce40 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:37:03 devstack sudo[104401]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ba991911-b9ed-45f3-b377-ea2f9066ce40 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Flow 'volume_create_manager' (ea8f8ad2-15c5-4963-b8ea-a44022512a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ba991911-b9ed-45f3-b377-ea2f9066ce40 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a13a67ad-3b58-4aa7-afe3-2fb7d58dbb87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e5091a8b-9fd6-4c1d-8730-f6ecc86e8e59 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6c64e4c4-f2c6-4dc1-96a7-8524e838199c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e5709e45-7a5c-4453-b4f7-41b2df9dbee1', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e5091a8b-9fd6-4c1d-8730-f6ecc86e8e59 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d578868b-2fef-4162-95a4-9a58eb043f8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:03 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-e5091a8b-9fd6-4c1d-8730-f6ecc86e8e59 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Volume volume-e5709e45-7a5c-4453-b4f7-41b2df9dbee1 (e5709e45-7a5c-4453-b4f7-41b2df9dbee1): created successfully Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e5091a8b-9fd6-4c1d-8730-f6ecc86e8e59 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d578868b-2fef-4162-95a4-9a58eb043f8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e5091a8b-9fd6-4c1d-8730-f6ecc86e8e59 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Flow 'volume_create_manager' (b5014146-3178-46d0-8ae4-6a4d1542387d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ba991911-b9ed-45f3-b377-ea2f9066ce40 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a13a67ad-3b58-4aa7-afe3-2fb7d58dbb87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1306868606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c963875e-cd97-4cd5-a3c7-91e73f86dc52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0273f2c7eeb3460b8e55c61c5cc1f479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:37:03Z,use_quota=True,user_id='518cd9ff51b64019ac6dcdb6811ee69b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ba991911-b9ed-45f3-b377-ea2f9066ce40 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aba0d709-07f7-4a14-baee-9cb712aa67da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ba991911-b9ed-45f3-b377-ea2f9066ce40 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (aba0d709-07f7-4a14-baee-9cb712aa67da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ba991911-b9ed-45f3-b377-ea2f9066ce40 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (540c4ef4-d48f-4032-bc5f-ec186959674f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ba991911-b9ed-45f3-b377-ea2f9066ce40 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (540c4ef4-d48f-4032-bc5f-ec186959674f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c963875e-cd97-4cd5-a3c7-91e73f86dc52', 'volume_name': 'volume-c963875e-cd97-4cd5-a3c7-91e73f86dc52', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ba991911-b9ed-45f3-b377-ea2f9066ce40 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3e5b261-caca-4b5c-863c-38f98884df60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ba991911-b9ed-45f3-b377-ea2f9066ce40 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d3e5b261-caca-4b5c-863c-38f98884df60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ba991911-b9ed-45f3-b377-ea2f9066ce40 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c07c8b57-be62-4285-8b03-90951c780d7f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:03 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-ba991911-b9ed-45f3-b377-ea2f9066ce40 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Volume c963875e-cd97-4cd5-a3c7-91e73f86dc52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c963875e-cd97-4cd5-a3c7-91e73f86dc52', 'volume_size': 1} Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ba991911-b9ed-45f3-b377-ea2f9066ce40 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:03 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-e5091a8b-9fd6-4c1d-8730-f6ecc86e8e59 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Created volume successfully. Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-603c4ec3-daff-41e1-a994-269b68e08827 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-603c4ec3-daff-41e1-a994-269b68e08827 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Flow 'volume_create_manager' (8afc0e7f-a087-40a5-ad1c-26599ee5156c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-603c4ec3-daff-41e1-a994-269b68e08827 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcc704d5-729a-4fad-afc8-f51e634f75bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-603c4ec3-daff-41e1-a994-269b68e08827 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bcc704d5-729a-4fad-afc8-f51e634f75bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1755126262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=756f9800-b4a2-4690-9311-f42fc94bf53f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0273f2c7eeb3460b8e55c61c5cc1f479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:37:03Z,use_quota=True,user_id='518cd9ff51b64019ac6dcdb6811ee69b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-603c4ec3-daff-41e1-a994-269b68e08827 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd7ca719-c383-4b2b-8de3-5784d5ea3b26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-603c4ec3-daff-41e1-a994-269b68e08827 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dd7ca719-c383-4b2b-8de3-5784d5ea3b26) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-603c4ec3-daff-41e1-a994-269b68e08827 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5231751f-7c32-4c2e-9941-adbb657fa307) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-603c4ec3-daff-41e1-a994-269b68e08827 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5231751f-7c32-4c2e-9941-adbb657fa307) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '756f9800-b4a2-4690-9311-f42fc94bf53f', 'volume_name': 'volume-756f9800-b4a2-4690-9311-f42fc94bf53f', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-603c4ec3-daff-41e1-a994-269b68e08827 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80f48937-00fd-4350-b560-7adb1eecfd13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-603c4ec3-daff-41e1-a994-269b68e08827 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80f48937-00fd-4350-b560-7adb1eecfd13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-603c4ec3-daff-41e1-a994-269b68e08827 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28606969-c68f-4878-9425-355a7f863599) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:03 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-603c4ec3-daff-41e1-a994-269b68e08827 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Volume 756f9800-b4a2-4690-9311-f42fc94bf53f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-756f9800-b4a2-4690-9311-f42fc94bf53f', 'volume_size': 1} Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-603c4ec3-daff-41e1-a994-269b68e08827 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:03 devstack sudo[104401]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3b076d35-1545-463f-8378-e567ca42e025 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b31b9232-68a5-47b3-ab69-4caaa7e8e054 1073741824" returned: 0 in 0.534s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3b076d35-1545-463f-8378-e567ca42e025 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b31b9232-68a5-47b3-ab69-4caaa7e8e054 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:03 devstack sudo[104406]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b31b9232-68a5-47b3-ab69-4caaa7e8e054 Nov 01 12:37:03 devstack sudo[104406]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:03 devstack sudo[104406]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3b076d35-1545-463f-8378-e567ca42e025 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b31b9232-68a5-47b3-ab69-4caaa7e8e054" returned: 0 in 0.243s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-3b076d35-1545-463f-8378-e567ca42e025 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] <== create_volume: return (817ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-3b076d35-1545-463f-8378-e567ca42e025 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.822s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-385568fb-3119-4f6e-b540-1cf6ef6ffaba tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.140s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-385568fb-3119-4f6e-b540-1cf6ef6ffaba tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:37:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1061617350',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c44c39cf-2464-48db-957c-e0c45ce3bc30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0273f2c7eeb3460b8e55c61c5cc1f479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:37:03Z,use_quota=True,user_id='518cd9ff51b64019ac6dcdb6811ee69b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-385568fb-3119-4f6e-b540-1cf6ef6ffaba tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Creating volume c44c39cf-2464-48db-957c-e0c45ce3bc30 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-385568fb-3119-4f6e-b540-1cf6ef6ffaba tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-385568fb-3119-4f6e-b540-1cf6ef6ffaba tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-385568fb-3119-4f6e-b540-1cf6ef6ffaba tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-385568fb-3119-4f6e-b540-1cf6ef6ffaba tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-385568fb-3119-4f6e-b540-1cf6ef6ffaba tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-385568fb-3119-4f6e-b540-1cf6ef6ffaba tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:37:03 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-385568fb-3119-4f6e-b540-1cf6ef6ffaba tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-385568fb-3119-4f6e-b540-1cf6ef6ffaba tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c44c39cf-2464-48db-957c-e0c45ce3bc30 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-3b076d35-1545-463f-8378-e567ca42e025 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3bc0b1e0-43c1-414f-80d0-bf78f5f52f99) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b31b9232-68a5-47b3-ab69-4caaa7e8e054', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:03 devstack sudo[104409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c44c39cf-2464-48db-957c-e0c45ce3bc30 1073741824 Nov 01 12:37:03 devstack sudo[104409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-3b076d35-1545-463f-8378-e567ca42e025 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d9ea4ff-24a0-4a67-9a91-dd62670dc2fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:03 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-3b076d35-1545-463f-8378-e567ca42e025 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Volume volume-b31b9232-68a5-47b3-ab69-4caaa7e8e054 (b31b9232-68a5-47b3-ab69-4caaa7e8e054): created successfully Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-3b076d35-1545-463f-8378-e567ca42e025 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d9ea4ff-24a0-4a67-9a91-dd62670dc2fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:03 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-3b076d35-1545-463f-8378-e567ca42e025 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Flow 'volume_create_manager' (4b4ccf1f-4ab8-471f-bbb9-6a3a84aafd59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:37:03 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-3b076d35-1545-463f-8378-e567ca42e025 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Created volume successfully. Nov 01 12:37:04 devstack sudo[104409]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-385568fb-3119-4f6e-b540-1cf6ef6ffaba tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c44c39cf-2464-48db-957c-e0c45ce3bc30 1073741824" returned: 0 in 0.403s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-385568fb-3119-4f6e-b540-1cf6ef6ffaba tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c44c39cf-2464-48db-957c-e0c45ce3bc30 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:04 devstack sudo[104416]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c44c39cf-2464-48db-957c-e0c45ce3bc30 Nov 01 12:37:04 devstack sudo[104416]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:04 devstack sudo[104416]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-385568fb-3119-4f6e-b540-1cf6ef6ffaba tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c44c39cf-2464-48db-957c-e0c45ce3bc30" returned: 0 in 0.250s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:04 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-385568fb-3119-4f6e-b540-1cf6ef6ffaba tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] <== create_volume: return (689ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:37:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-385568fb-3119-4f6e-b540-1cf6ef6ffaba tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.692s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ba991911-b9ed-45f3-b377-ea2f9066ce40 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.323s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:04 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ba991911-b9ed-45f3-b377-ea2f9066ce40 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1306868606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c963875e-cd97-4cd5-a3c7-91e73f86dc52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0273f2c7eeb3460b8e55c61c5cc1f479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:37:03Z,use_quota=True,user_id='518cd9ff51b64019ac6dcdb6811ee69b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:37:04 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-ba991911-b9ed-45f3-b377-ea2f9066ce40 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Creating volume c963875e-cd97-4cd5-a3c7-91e73f86dc52 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:37:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ba991911-b9ed-45f3-b377-ea2f9066ce40 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ba991911-b9ed-45f3-b377-ea2f9066ce40 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:04 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ba991911-b9ed-45f3-b377-ea2f9066ce40 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:37:04 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ba991911-b9ed-45f3-b377-ea2f9066ce40 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:37:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ba991911-b9ed-45f3-b377-ea2f9066ce40 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:04 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ba991911-b9ed-45f3-b377-ea2f9066ce40 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:37:04 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-ba991911-b9ed-45f3-b377-ea2f9066ce40 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:37:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ba991911-b9ed-45f3-b377-ea2f9066ce40 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c963875e-cd97-4cd5-a3c7-91e73f86dc52 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:04 devstack sudo[104419]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c963875e-cd97-4cd5-a3c7-91e73f86dc52 1073741824 Nov 01 12:37:04 devstack sudo[104419]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-385568fb-3119-4f6e-b540-1cf6ef6ffaba tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d3a277a-72c4-4517-ae7c-80f2e1345a83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c44c39cf-2464-48db-957c-e0c45ce3bc30', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-385568fb-3119-4f6e-b540-1cf6ef6ffaba tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9497c7c3-fafd-46f8-9d12-b206b39799eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:04 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-385568fb-3119-4f6e-b540-1cf6ef6ffaba tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Volume volume-c44c39cf-2464-48db-957c-e0c45ce3bc30 (c44c39cf-2464-48db-957c-e0c45ce3bc30): created successfully Nov 01 12:37:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-385568fb-3119-4f6e-b540-1cf6ef6ffaba tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9497c7c3-fafd-46f8-9d12-b206b39799eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:04 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-385568fb-3119-4f6e-b540-1cf6ef6ffaba tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Flow 'volume_create_manager' (87cec750-092d-4f1a-a8e1-927c70857ed9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:37:04 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-385568fb-3119-4f6e-b540-1cf6ef6ffaba tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Created volume successfully. Nov 01 12:37:04 devstack sudo[104419]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ba991911-b9ed-45f3-b377-ea2f9066ce40 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c963875e-cd97-4cd5-a3c7-91e73f86dc52 1073741824" returned: 0 in 0.443s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ba991911-b9ed-45f3-b377-ea2f9066ce40 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c963875e-cd97-4cd5-a3c7-91e73f86dc52 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:05 devstack sudo[104427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c963875e-cd97-4cd5-a3c7-91e73f86dc52 Nov 01 12:37:05 devstack sudo[104427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:05 devstack sudo[104427]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ba991911-b9ed-45f3-b377-ea2f9066ce40 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c963875e-cd97-4cd5-a3c7-91e73f86dc52" returned: 0 in 0.265s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:05 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ba991911-b9ed-45f3-b377-ea2f9066ce40 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] <== create_volume: return (782ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:37:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ba991911-b9ed-45f3-b377-ea2f9066ce40 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.784s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-603c4ec3-daff-41e1-a994-269b68e08827 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.788s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:05 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-603c4ec3-daff-41e1-a994-269b68e08827 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:37:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1755126262',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=756f9800-b4a2-4690-9311-f42fc94bf53f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0273f2c7eeb3460b8e55c61c5cc1f479',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:37:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:37:03Z,use_quota=True,user_id='518cd9ff51b64019ac6dcdb6811ee69b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:37:05 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-603c4ec3-daff-41e1-a994-269b68e08827 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Creating volume 756f9800-b4a2-4690-9311-f42fc94bf53f {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:37:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-603c4ec3-daff-41e1-a994-269b68e08827 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-603c4ec3-daff-41e1-a994-269b68e08827 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:05 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-603c4ec3-daff-41e1-a994-269b68e08827 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:37:05 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-603c4ec3-daff-41e1-a994-269b68e08827 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:37:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-603c4ec3-daff-41e1-a994-269b68e08827 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:05 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-603c4ec3-daff-41e1-a994-269b68e08827 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:37:05 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-603c4ec3-daff-41e1-a994-269b68e08827 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:37:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-603c4ec3-daff-41e1-a994-269b68e08827 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-756f9800-b4a2-4690-9311-f42fc94bf53f 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:05 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ba991911-b9ed-45f3-b377-ea2f9066ce40 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c07c8b57-be62-4285-8b03-90951c780d7f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c963875e-cd97-4cd5-a3c7-91e73f86dc52', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:05 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ba991911-b9ed-45f3-b377-ea2f9066ce40 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5ef9fb1-3d04-4676-8e77-77dd3d63d0ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:05 devstack sudo[104430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-756f9800-b4a2-4690-9311-f42fc94bf53f 1073741824 Nov 01 12:37:05 devstack sudo[104430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:05 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-ba991911-b9ed-45f3-b377-ea2f9066ce40 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Volume volume-c963875e-cd97-4cd5-a3c7-91e73f86dc52 (c963875e-cd97-4cd5-a3c7-91e73f86dc52): created successfully Nov 01 12:37:05 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ba991911-b9ed-45f3-b377-ea2f9066ce40 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f5ef9fb1-3d04-4676-8e77-77dd3d63d0ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:05 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ba991911-b9ed-45f3-b377-ea2f9066ce40 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Flow 'volume_create_manager' (ea8f8ad2-15c5-4963-b8ea-a44022512a12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:37:05 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-ba991911-b9ed-45f3-b377-ea2f9066ce40 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Created volume successfully. Nov 01 12:37:05 devstack sudo[104430]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-603c4ec3-daff-41e1-a994-269b68e08827 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-756f9800-b4a2-4690-9311-f42fc94bf53f 1073741824" returned: 0 in 0.527s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-603c4ec3-daff-41e1-a994-269b68e08827 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-756f9800-b4a2-4690-9311-f42fc94bf53f {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:05 devstack sudo[104436]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-756f9800-b4a2-4690-9311-f42fc94bf53f Nov 01 12:37:05 devstack sudo[104436]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:06 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cd56b6c-e7ec-4ee6-ac2d-e1bd9d69187f tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:37:06 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-1cd56b6c-e7ec-4ee6-ac2d-e1bd9d69187f tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Flow 'volume_create_manager' (95852c5b-1531-4a95-9ad2-fa916d4b5091) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:37:06 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-1cd56b6c-e7ec-4ee6-ac2d-e1bd9d69187f tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ccbaa8c-3240-48dc-bd44-91b9440524e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:06 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-1cd56b6c-e7ec-4ee6-ac2d-e1bd9d69187f tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ccbaa8c-3240-48dc-bd44-91b9440524e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1963755856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ea2d9e7-6e33-495c-bbc3-927ccda7f56c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f6391dd27e54eee90a49f6e5ef009db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:37:06Z,use_quota=True,user_id='8d2e4750e06945609d029abe2f08ffe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:06 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-1cd56b6c-e7ec-4ee6-ac2d-e1bd9d69187f tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87ae18ba-8c4e-4465-bd96-a3791e7d3ea8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:06 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-1cd56b6c-e7ec-4ee6-ac2d-e1bd9d69187f tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87ae18ba-8c4e-4465-bd96-a3791e7d3ea8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:06 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-1cd56b6c-e7ec-4ee6-ac2d-e1bd9d69187f tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa91271c-f85b-4633-989b-cd5af2328be8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:06 devstack sudo[104436]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:06 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-1cd56b6c-e7ec-4ee6-ac2d-e1bd9d69187f tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa91271c-f85b-4633-989b-cd5af2328be8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8ea2d9e7-6e33-495c-bbc3-927ccda7f56c', 'volume_name': 'volume-8ea2d9e7-6e33-495c-bbc3-927ccda7f56c', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:06 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-1cd56b6c-e7ec-4ee6-ac2d-e1bd9d69187f tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6259405a-b56e-4a09-9680-d309f063a340) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:06 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-1cd56b6c-e7ec-4ee6-ac2d-e1bd9d69187f tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6259405a-b56e-4a09-9680-d309f063a340) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:06 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-1cd56b6c-e7ec-4ee6-ac2d-e1bd9d69187f tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0fbfa2f-8d0b-47ab-b81e-7f3dcfee63ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:06 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-1cd56b6c-e7ec-4ee6-ac2d-e1bd9d69187f tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Volume 8ea2d9e7-6e33-495c-bbc3-927ccda7f56c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8ea2d9e7-6e33-495c-bbc3-927ccda7f56c', 'volume_size': 1} Nov 01 12:37:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-1cd56b6c-e7ec-4ee6-ac2d-e1bd9d69187f tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-603c4ec3-daff-41e1-a994-269b68e08827 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-756f9800-b4a2-4690-9311-f42fc94bf53f" returned: 0 in 0.280s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:06 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-603c4ec3-daff-41e1-a994-269b68e08827 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] <== create_volume: return (858ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:37:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-603c4ec3-daff-41e1-a994-269b68e08827 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.861s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-1cd56b6c-e7ec-4ee6-ac2d-e1bd9d69187f tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:06 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-1cd56b6c-e7ec-4ee6-ac2d-e1bd9d69187f tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:37:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-1963755856',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8ea2d9e7-6e33-495c-bbc3-927ccda7f56c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='0f6391dd27e54eee90a49f6e5ef009db',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:37:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:37:06Z,use_quota=True,user_id='8d2e4750e06945609d029abe2f08ffe6',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:37:06 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-1cd56b6c-e7ec-4ee6-ac2d-e1bd9d69187f tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Creating volume 8ea2d9e7-6e33-495c-bbc3-927ccda7f56c {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:37:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-1cd56b6c-e7ec-4ee6-ac2d-e1bd9d69187f tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-1cd56b6c-e7ec-4ee6-ac2d-e1bd9d69187f tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:06 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-1cd56b6c-e7ec-4ee6-ac2d-e1bd9d69187f tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:37:06 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-1cd56b6c-e7ec-4ee6-ac2d-e1bd9d69187f tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:37:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-1cd56b6c-e7ec-4ee6-ac2d-e1bd9d69187f tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:06 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-1cd56b6c-e7ec-4ee6-ac2d-e1bd9d69187f tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:37:06 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-1cd56b6c-e7ec-4ee6-ac2d-e1bd9d69187f tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:37:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1cd56b6c-e7ec-4ee6-ac2d-e1bd9d69187f tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8ea2d9e7-6e33-495c-bbc3-927ccda7f56c 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:06 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-603c4ec3-daff-41e1-a994-269b68e08827 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28606969-c68f-4878-9425-355a7f863599) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-756f9800-b4a2-4690-9311-f42fc94bf53f', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:06 devstack sudo[104439]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8ea2d9e7-6e33-495c-bbc3-927ccda7f56c 1073741824 Nov 01 12:37:06 devstack sudo[104439]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:06 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-603c4ec3-daff-41e1-a994-269b68e08827 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (673dc5ef-ea4d-487f-ac31-5f59524bf439) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:06 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-603c4ec3-daff-41e1-a994-269b68e08827 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Volume volume-756f9800-b4a2-4690-9311-f42fc94bf53f (756f9800-b4a2-4690-9311-f42fc94bf53f): created successfully Nov 01 12:37:06 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-603c4ec3-daff-41e1-a994-269b68e08827 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (673dc5ef-ea4d-487f-ac31-5f59524bf439) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:06 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-603c4ec3-daff-41e1-a994-269b68e08827 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Flow 'volume_create_manager' (8afc0e7f-a087-40a5-ad1c-26599ee5156c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:37:06 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-603c4ec3-daff-41e1-a994-269b68e08827 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Created volume successfully. Nov 01 12:37:06 devstack sudo[104439]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1cd56b6c-e7ec-4ee6-ac2d-e1bd9d69187f tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8ea2d9e7-6e33-495c-bbc3-927ccda7f56c 1073741824" returned: 0 in 0.412s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1cd56b6c-e7ec-4ee6-ac2d-e1bd9d69187f tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8ea2d9e7-6e33-495c-bbc3-927ccda7f56c {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:06 devstack sudo[104446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8ea2d9e7-6e33-495c-bbc3-927ccda7f56c Nov 01 12:37:06 devstack sudo[104446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:06 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-59161df7-a11b-42e0-ada0-5af80efb4a63 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Acquiring lock "cinder-756f9800-b4a2-4690-9311-f42fc94bf53f-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:37:06 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-59161df7-a11b-42e0-ada0-5af80efb4a63 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "cinder-756f9800-b4a2-4690-9311-f42fc94bf53f-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:37:06 devstack sudo[104446]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1cd56b6c-e7ec-4ee6-ac2d-e1bd9d69187f tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8ea2d9e7-6e33-495c-bbc3-927ccda7f56c" returned: 0 in 0.270s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:06 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-1cd56b6c-e7ec-4ee6-ac2d-e1bd9d69187f tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] <== create_volume: return (720ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:37:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-1cd56b6c-e7ec-4ee6-ac2d-e1bd9d69187f tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:06 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-59161df7-a11b-42e0-ada0-5af80efb4a63 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Acquiring lock "cinder-quobyte-756f9800-b4a2-4690-9311-f42fc94bf53f" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:37:06 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-1cd56b6c-e7ec-4ee6-ac2d-e1bd9d69187f tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e0fbfa2f-8d0b-47ab-b81e-7f3dcfee63ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8ea2d9e7-6e33-495c-bbc3-927ccda7f56c', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:06 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-1cd56b6c-e7ec-4ee6-ac2d-e1bd9d69187f tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fe530d0-e7b8-4418-843b-fd990ba82c98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:06 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-59161df7-a11b-42e0-ada0-5af80efb4a63 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "cinder-quobyte-756f9800-b4a2-4690-9311-f42fc94bf53f" acquired by "delete_volume" :: waited 0.030s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:37:06 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-1cd56b6c-e7ec-4ee6-ac2d-e1bd9d69187f tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Volume volume-8ea2d9e7-6e33-495c-bbc3-927ccda7f56c (8ea2d9e7-6e33-495c-bbc3-927ccda7f56c): created successfully Nov 01 12:37:06 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-1cd56b6c-e7ec-4ee6-ac2d-e1bd9d69187f tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4fe530d0-e7b8-4418-843b-fd990ba82c98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:06 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-1cd56b6c-e7ec-4ee6-ac2d-e1bd9d69187f tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Flow 'volume_create_manager' (95852c5b-1531-4a95-9ad2-fa916d4b5091) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:37:06 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[d87c8874-8281-4951-84ce-a689d1defd61]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:37:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-59161df7-a11b-42e0-ada0-5af80efb4a63 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-756f9800-b4a2-4690-9311-f42fc94bf53f {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:06 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-1cd56b6c-e7ec-4ee6-ac2d-e1bd9d69187f tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Created volume successfully. Nov 01 12:37:07 devstack sudo[104449]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-756f9800-b4a2-4690-9311-f42fc94bf53f Nov 01 12:37:07 devstack sudo[104449]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:07 devstack sudo[104449]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-59161df7-a11b-42e0-ada0-5af80efb4a63 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-756f9800-b4a2-4690-9311-f42fc94bf53f" returned: 0 in 0.375s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-59161df7-a11b-42e0-ada0-5af80efb4a63 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-756f9800-b4a2-4690-9311-f42fc94bf53f {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:07 devstack sudo[104457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-756f9800-b4a2-4690-9311-f42fc94bf53f Nov 01 12:37:07 devstack sudo[104457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:07 devstack sudo[104457]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-59161df7-a11b-42e0-ada0-5af80efb4a63 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-756f9800-b4a2-4690-9311-f42fc94bf53f" returned: 0 in 0.254s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:07 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-59161df7-a11b-42e0-ada0-5af80efb4a63 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "cinder-quobyte-756f9800-b4a2-4690-9311-f42fc94bf53f" released by "delete_volume" :: held 0.681s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:37:07 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-59161df7-a11b-42e0-ada0-5af80efb4a63 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Created reservations ['2f7ca20c-7f12-4697-8e2c-3a3e983ba948', 'd1ac1c20-3ca5-498a-af31-47e0a04fecdf', 'e525a8ec-ff5c-4210-b6e7-976b4ecd9221', '0eed8f7e-a998-4ae5-a0e2-20d361c65b54'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:37:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-59161df7-a11b-42e0-ada0-5af80efb4a63 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-59161df7-a11b-42e0-ada0-5af80efb4a63 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:07 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-59161df7-a11b-42e0-ada0-5af80efb4a63 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:37:07 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-59161df7-a11b-42e0-ada0-5af80efb4a63 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:37:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-59161df7-a11b-42e0-ada0-5af80efb4a63 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-59161df7-a11b-42e0-ada0-5af80efb4a63 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:07 devstack sudo[104460]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:37:07 devstack sudo[104460]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:08 devstack sudo[104460]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-59161df7-a11b-42e0-ada0-5af80efb4a63 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.270s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:08 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-59161df7-a11b-42e0-ada0-5af80efb4a63 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:37:08 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-148b83cc-171c-4f24-9dce-cbcc533ed73a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Acquiring lock "cinder-c963875e-cd97-4cd5-a3c7-91e73f86dc52-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:37:08 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-59161df7-a11b-42e0-ada0-5af80efb4a63 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Deleted volume successfully. Nov 01 12:37:08 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-148b83cc-171c-4f24-9dce-cbcc533ed73a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "cinder-c963875e-cd97-4cd5-a3c7-91e73f86dc52-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:37:08 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-59161df7-a11b-42e0-ada0-5af80efb4a63 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "cinder-756f9800-b4a2-4690-9311-f42fc94bf53f-delete_volume" released by "delete_volume" :: held 1.222s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:37:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-09849a63-3a80-4cd4-a839-94c4d3f18ace req-2266181e-9e0a-4bff-881a-8768cd7acceb tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-09849a63-3a80-4cd4-a839-94c4d3f18ace req-2266181e-9e0a-4bff-881a-8768cd7acceb tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [req-09849a63-3a80-4cd4-a839-94c4d3f18ace req-2266181e-9e0a-4bff-881a-8768cd7acceb tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.013s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:08 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-148b83cc-171c-4f24-9dce-cbcc533ed73a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Acquiring lock "cinder-quobyte-c963875e-cd97-4cd5-a3c7-91e73f86dc52" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:37:08 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-148b83cc-171c-4f24-9dce-cbcc533ed73a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "cinder-quobyte-c963875e-cd97-4cd5-a3c7-91e73f86dc52" acquired by "delete_volume" :: waited 0.019s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:37:08 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-09849a63-3a80-4cd4-a839-94c4d3f18ace req-2266181e-9e0a-4bff-881a-8768cd7acceb tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Connection info returned from driver {'export': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb', 'name': 'volume-8ea2d9e7-6e33-495c-bbc3-927ccda7f56c', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '1abcc0fa-bcb5-4dc5-a35a-23f5ea971968', 'enforce_multipath': True} {{(pid=86574) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4924}} Nov 01 12:37:08 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[a7959bfd-0887-4600-9359-71cd36cd184f]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:37:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-148b83cc-171c-4f24-9dce-cbcc533ed73a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c963875e-cd97-4cd5-a3c7-91e73f86dc52 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:08 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-09849a63-3a80-4cd4-a839-94c4d3f18ace req-2266181e-9e0a-4bff-881a-8768cd7acceb tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] attachment_update completed successfully. Nov 01 12:37:08 devstack sudo[104471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c963875e-cd97-4cd5-a3c7-91e73f86dc52 Nov 01 12:37:08 devstack sudo[104471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:08 devstack sudo[104471]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-148b83cc-171c-4f24-9dce-cbcc533ed73a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c963875e-cd97-4cd5-a3c7-91e73f86dc52" returned: 0 in 0.382s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-148b83cc-171c-4f24-9dce-cbcc533ed73a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c963875e-cd97-4cd5-a3c7-91e73f86dc52 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:08 devstack sudo[104825]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c963875e-cd97-4cd5-a3c7-91e73f86dc52 Nov 01 12:37:08 devstack sudo[104825]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:08 devstack sudo[104825]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-148b83cc-171c-4f24-9dce-cbcc533ed73a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c963875e-cd97-4cd5-a3c7-91e73f86dc52" returned: 0 in 0.289s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:08 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-148b83cc-171c-4f24-9dce-cbcc533ed73a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "cinder-quobyte-c963875e-cd97-4cd5-a3c7-91e73f86dc52" released by "delete_volume" :: held 0.728s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:37:08 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-148b83cc-171c-4f24-9dce-cbcc533ed73a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Created reservations ['4e66d1e1-3980-4924-b7b3-e4fafd99886b', 'e3f418c0-f466-418f-968e-2b68ee3b2a63', '5eeebcca-277c-41c9-a45f-8cfcd6c6eded', '94d9a908-cb78-4ab6-8cc5-eb46beb985d6'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:37:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-148b83cc-171c-4f24-9dce-cbcc533ed73a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-148b83cc-171c-4f24-9dce-cbcc533ed73a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:08 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-148b83cc-171c-4f24-9dce-cbcc533ed73a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:37:08 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-148b83cc-171c-4f24-9dce-cbcc533ed73a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:37:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-148b83cc-171c-4f24-9dce-cbcc533ed73a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-148b83cc-171c-4f24-9dce-cbcc533ed73a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:09 devstack sudo[104895]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:37:09 devstack sudo[104895]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:09 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a3ccaee3-88af-4cf5-a236-3a4f2c92ad12 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Acquiring lock "cinder-c44c39cf-2464-48db-957c-e0c45ce3bc30-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:37:09 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a3ccaee3-88af-4cf5-a236-3a4f2c92ad12 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "cinder-c44c39cf-2464-48db-957c-e0c45ce3bc30-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:37:09 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a3ccaee3-88af-4cf5-a236-3a4f2c92ad12 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Acquiring lock "cinder-quobyte-c44c39cf-2464-48db-957c-e0c45ce3bc30" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:37:09 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a3ccaee3-88af-4cf5-a236-3a4f2c92ad12 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "cinder-quobyte-c44c39cf-2464-48db-957c-e0c45ce3bc30" acquired by "delete_volume" :: waited 0.017s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:37:09 devstack sudo[104895]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-148b83cc-171c-4f24-9dce-cbcc533ed73a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.281s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:09 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-148b83cc-171c-4f24-9dce-cbcc533ed73a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:37:09 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-148b83cc-171c-4f24-9dce-cbcc533ed73a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Deleted volume successfully. Nov 01 12:37:09 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4028046-9810-444e-a099-3f6705200270]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:37:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a3ccaee3-88af-4cf5-a236-3a4f2c92ad12 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c44c39cf-2464-48db-957c-e0c45ce3bc30 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:09 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-148b83cc-171c-4f24-9dce-cbcc533ed73a tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "cinder-c963875e-cd97-4cd5-a3c7-91e73f86dc52-delete_volume" released by "delete_volume" :: held 1.259s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:37:09 devstack sudo[104898]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c44c39cf-2464-48db-957c-e0c45ce3bc30 Nov 01 12:37:09 devstack sudo[104898]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:09 devstack sudo[104898]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a3ccaee3-88af-4cf5-a236-3a4f2c92ad12 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c44c39cf-2464-48db-957c-e0c45ce3bc30" returned: 0 in 0.360s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a3ccaee3-88af-4cf5-a236-3a4f2c92ad12 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c44c39cf-2464-48db-957c-e0c45ce3bc30 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:09 devstack sudo[104903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c44c39cf-2464-48db-957c-e0c45ce3bc30 Nov 01 12:37:09 devstack sudo[104903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:09 devstack sudo[104903]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a3ccaee3-88af-4cf5-a236-3a4f2c92ad12 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c44c39cf-2464-48db-957c-e0c45ce3bc30" returned: 0 in 0.242s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:09 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a3ccaee3-88af-4cf5-a236-3a4f2c92ad12 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "cinder-quobyte-c44c39cf-2464-48db-957c-e0c45ce3bc30" released by "delete_volume" :: held 0.656s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:37:09 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-a3ccaee3-88af-4cf5-a236-3a4f2c92ad12 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Created reservations ['3570a2c8-b66b-4137-b66e-e0d44b561519', '87137953-3714-4b23-b451-a956a9677f29', '35ac4a5b-3eba-49d7-b68e-04d2f711ce55', '3512c87c-5ac2-4a4a-a9f8-a68703b308b4'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:37:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a3ccaee3-88af-4cf5-a236-3a4f2c92ad12 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a3ccaee3-88af-4cf5-a236-3a4f2c92ad12 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:10 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a3ccaee3-88af-4cf5-a236-3a4f2c92ad12 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:37:10 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a3ccaee3-88af-4cf5-a236-3a4f2c92ad12 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:37:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a3ccaee3-88af-4cf5-a236-3a4f2c92ad12 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a3ccaee3-88af-4cf5-a236-3a4f2c92ad12 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:10 devstack sudo[104906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:37:10 devstack sudo[104906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:10 devstack sudo[104906]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a3ccaee3-88af-4cf5-a236-3a4f2c92ad12 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.261s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:10 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-a3ccaee3-88af-4cf5-a236-3a4f2c92ad12 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:37:10 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-a3ccaee3-88af-4cf5-a236-3a4f2c92ad12 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Deleted volume successfully. Nov 01 12:37:10 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a3ccaee3-88af-4cf5-a236-3a4f2c92ad12 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "cinder-c44c39cf-2464-48db-957c-e0c45ce3bc30-delete_volume" released by "delete_volume" :: held 1.134s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:37:10 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d5b183d9-5fdb-45f2-903a-cde66a811d47 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Acquiring lock "cinder-b31b9232-68a5-47b3-ab69-4caaa7e8e054-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:37:10 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d5b183d9-5fdb-45f2-903a-cde66a811d47 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "cinder-b31b9232-68a5-47b3-ab69-4caaa7e8e054-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:37:10 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d5b183d9-5fdb-45f2-903a-cde66a811d47 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Acquiring lock "cinder-quobyte-b31b9232-68a5-47b3-ab69-4caaa7e8e054" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:37:10 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d5b183d9-5fdb-45f2-903a-cde66a811d47 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "cinder-quobyte-b31b9232-68a5-47b3-ab69-4caaa7e8e054" acquired by "delete_volume" :: waited 0.015s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:37:10 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c6e4215-df6c-445a-bb56-a6436bbe36a2]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:37:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d5b183d9-5fdb-45f2-903a-cde66a811d47 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b31b9232-68a5-47b3-ab69-4caaa7e8e054 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:10 devstack sudo[104909]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b31b9232-68a5-47b3-ab69-4caaa7e8e054 Nov 01 12:37:10 devstack sudo[104909]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:10 devstack sudo[104909]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d5b183d9-5fdb-45f2-903a-cde66a811d47 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b31b9232-68a5-47b3-ab69-4caaa7e8e054" returned: 0 in 0.385s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d5b183d9-5fdb-45f2-903a-cde66a811d47 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b31b9232-68a5-47b3-ab69-4caaa7e8e054 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:10 devstack sudo[104915]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b31b9232-68a5-47b3-ab69-4caaa7e8e054 Nov 01 12:37:10 devstack sudo[104915]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:11 devstack sudo[104915]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d5b183d9-5fdb-45f2-903a-cde66a811d47 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b31b9232-68a5-47b3-ab69-4caaa7e8e054" returned: 0 in 0.289s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:11 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d5b183d9-5fdb-45f2-903a-cde66a811d47 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "cinder-quobyte-b31b9232-68a5-47b3-ab69-4caaa7e8e054" released by "delete_volume" :: held 0.743s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:37:11 devstack cinder-volume[86574]: INFO cinder.volume.manager [req-374cad4e-00de-47f7-a03f-13b106565f34 req-8352511c-4e13-411d-8c00-bd7131756427 tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Terminate volume connection completed successfully. Nov 01 12:37:11 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [req-374cad4e-00de-47f7-a03f-13b106565f34 req-8352511c-4e13-411d-8c00-bd7131756427 tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Deleting attachment 1abcc0fa-bcb5-4dc5-a35a-23f5ea971968. {{(pid=86574) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5055}} Nov 01 12:37:11 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-d5b183d9-5fdb-45f2-903a-cde66a811d47 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Created reservations ['4bfa884f-f009-43a1-aeab-1a5cb0dda43d', '5de8ab0e-7672-49e5-a9ce-a311f04ac73c', '46983fb5-38ab-456a-9f05-ac74947c6e7b', '9c47a785-338a-45f3-a08e-b5ff221730e6'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:37:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d5b183d9-5fdb-45f2-903a-cde66a811d47 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d5b183d9-5fdb-45f2-903a-cde66a811d47 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:11 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d5b183d9-5fdb-45f2-903a-cde66a811d47 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:37:11 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d5b183d9-5fdb-45f2-903a-cde66a811d47 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:37:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d5b183d9-5fdb-45f2-903a-cde66a811d47 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d5b183d9-5fdb-45f2-903a-cde66a811d47 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:11 devstack sudo[104944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:37:11 devstack sudo[104944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:11 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-9c05a592-2415-4991-91ec-c479f7eee760 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Acquiring lock "cinder-e5709e45-7a5c-4453-b4f7-41b2df9dbee1-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:37:11 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-9c05a592-2415-4991-91ec-c479f7eee760 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "cinder-e5709e45-7a5c-4453-b4f7-41b2df9dbee1-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:37:11 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-9c05a592-2415-4991-91ec-c479f7eee760 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Acquiring lock "cinder-quobyte-e5709e45-7a5c-4453-b4f7-41b2df9dbee1" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:37:11 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-9c05a592-2415-4991-91ec-c479f7eee760 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "cinder-quobyte-e5709e45-7a5c-4453-b4f7-41b2df9dbee1" acquired by "delete_volume" :: waited 0.017s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:37:11 devstack sudo[104944]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d5b183d9-5fdb-45f2-903a-cde66a811d47 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.300s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:11 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-d5b183d9-5fdb-45f2-903a-cde66a811d47 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:37:11 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-d5b183d9-5fdb-45f2-903a-cde66a811d47 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Deleted volume successfully. Nov 01 12:37:11 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[97c331fc-997c-436f-9308-5652a91b7012]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:37:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9c05a592-2415-4991-91ec-c479f7eee760 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e5709e45-7a5c-4453-b4f7-41b2df9dbee1 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:11 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d5b183d9-5fdb-45f2-903a-cde66a811d47 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "cinder-b31b9232-68a5-47b3-ab69-4caaa7e8e054-delete_volume" released by "delete_volume" :: held 1.286s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:37:11 devstack sudo[104947]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e5709e45-7a5c-4453-b4f7-41b2df9dbee1 Nov 01 12:37:11 devstack sudo[104947]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:12 devstack sudo[104947]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9c05a592-2415-4991-91ec-c479f7eee760 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e5709e45-7a5c-4453-b4f7-41b2df9dbee1" returned: 0 in 0.378s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9c05a592-2415-4991-91ec-c479f7eee760 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e5709e45-7a5c-4453-b4f7-41b2df9dbee1 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:12 devstack sudo[104953]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e5709e45-7a5c-4453-b4f7-41b2df9dbee1 Nov 01 12:37:12 devstack sudo[104953]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:12 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-7540e506-cff4-4b95-acf4-644e151e85bb tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Acquiring lock "cinder-8ea2d9e7-6e33-495c-bbc3-927ccda7f56c-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:37:12 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-7540e506-cff4-4b95-acf4-644e151e85bb tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Lock "cinder-8ea2d9e7-6e33-495c-bbc3-927ccda7f56c-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:37:12 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-7540e506-cff4-4b95-acf4-644e151e85bb tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Acquiring lock "cinder-quobyte-8ea2d9e7-6e33-495c-bbc3-927ccda7f56c" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:37:12 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-7540e506-cff4-4b95-acf4-644e151e85bb tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Lock "cinder-quobyte-8ea2d9e7-6e33-495c-bbc3-927ccda7f56c" acquired by "delete_volume" :: waited 0.020s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:37:12 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[e6730e0a-14c6-4e8f-b27b-d4c9a335c874]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:37:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7540e506-cff4-4b95-acf4-644e151e85bb tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8ea2d9e7-6e33-495c-bbc3-927ccda7f56c {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:12 devstack sudo[104955]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8ea2d9e7-6e33-495c-bbc3-927ccda7f56c Nov 01 12:37:12 devstack sudo[104955]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:12 devstack sudo[104953]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9c05a592-2415-4991-91ec-c479f7eee760 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e5709e45-7a5c-4453-b4f7-41b2df9dbee1" returned: 0 in 0.284s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:12 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-9c05a592-2415-4991-91ec-c479f7eee760 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "cinder-quobyte-e5709e45-7a5c-4453-b4f7-41b2df9dbee1" released by "delete_volume" :: held 0.713s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:37:12 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-9c05a592-2415-4991-91ec-c479f7eee760 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Created reservations ['000bbe76-6a67-4860-ae1b-fad406112290', 'e9cb193d-5f85-4b62-b1ae-04672df75df4', '5ed19e9e-ba1b-4208-a9ee-41f502afc19b', '4b295ed9-c295-4253-a84a-123fcdd29ca1'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:37:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-9c05a592-2415-4991-91ec-c479f7eee760 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-9c05a592-2415-4991-91ec-c479f7eee760 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:12 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-9c05a592-2415-4991-91ec-c479f7eee760 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:37:12 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-9c05a592-2415-4991-91ec-c479f7eee760 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:37:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-9c05a592-2415-4991-91ec-c479f7eee760 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9c05a592-2415-4991-91ec-c479f7eee760 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:12 devstack sudo[104958]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:37:12 devstack sudo[104958]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:12 devstack sudo[104955]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7540e506-cff4-4b95-acf4-644e151e85bb tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8ea2d9e7-6e33-495c-bbc3-927ccda7f56c" returned: 0 in 0.374s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7540e506-cff4-4b95-acf4-644e151e85bb tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8ea2d9e7-6e33-495c-bbc3-927ccda7f56c {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:12 devstack sudo[104963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8ea2d9e7-6e33-495c-bbc3-927ccda7f56c Nov 01 12:37:12 devstack sudo[104963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:12 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f1d2431c-be8d-48b6-a90f-4ead51278bde tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Acquiring lock "cinder-4f34cee6-e651-4278-9fc9-1493f693924b-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:37:12 devstack sudo[104958]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9c05a592-2415-4991-91ec-c479f7eee760 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.278s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:12 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-9c05a592-2415-4991-91ec-c479f7eee760 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:37:12 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-9c05a592-2415-4991-91ec-c479f7eee760 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Deleted volume successfully. Nov 01 12:37:12 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f1d2431c-be8d-48b6-a90f-4ead51278bde tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "cinder-4f34cee6-e651-4278-9fc9-1493f693924b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:37:12 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-9c05a592-2415-4991-91ec-c479f7eee760 tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "cinder-e5709e45-7a5c-4453-b4f7-41b2df9dbee1-delete_volume" released by "delete_volume" :: held 1.213s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:37:12 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f1d2431c-be8d-48b6-a90f-4ead51278bde tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Acquiring lock "cinder-quobyte-4f34cee6-e651-4278-9fc9-1493f693924b" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:37:12 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f1d2431c-be8d-48b6-a90f-4ead51278bde tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "cinder-quobyte-4f34cee6-e651-4278-9fc9-1493f693924b" acquired by "delete_volume" :: waited 0.016s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:37:12 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[ad926ae5-029d-4408-9e60-e5245b32b675]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:37:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f1d2431c-be8d-48b6-a90f-4ead51278bde tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4f34cee6-e651-4278-9fc9-1493f693924b {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:12 devstack sudo[104963]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7540e506-cff4-4b95-acf4-644e151e85bb tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8ea2d9e7-6e33-495c-bbc3-927ccda7f56c" returned: 0 in 0.307s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:12 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-7540e506-cff4-4b95-acf4-644e151e85bb tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Lock "cinder-quobyte-8ea2d9e7-6e33-495c-bbc3-927ccda7f56c" released by "delete_volume" :: held 0.725s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:37:12 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-7540e506-cff4-4b95-acf4-644e151e85bb tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Created reservations ['2318bdb7-e8f3-4dcf-9939-170d0f08b676', '5e464440-e680-4255-b9d2-76a785919827', '160e7aa4-e1ee-48b3-bc40-c02ae12e77d9', 'df6ef31e-265e-4173-9c71-7f48190dff46'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:37:12 devstack sudo[104967]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4f34cee6-e651-4278-9fc9-1493f693924b Nov 01 12:37:12 devstack sudo[104967]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-7540e506-cff4-4b95-acf4-644e151e85bb tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-7540e506-cff4-4b95-acf4-644e151e85bb tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:13 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-7540e506-cff4-4b95-acf4-644e151e85bb tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:37:13 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-7540e506-cff4-4b95-acf4-644e151e85bb tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:37:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-7540e506-cff4-4b95-acf4-644e151e85bb tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7540e506-cff4-4b95-acf4-644e151e85bb tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:13 devstack sudo[104969]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:37:13 devstack sudo[104969]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:13 devstack sudo[104967]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f1d2431c-be8d-48b6-a90f-4ead51278bde tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4f34cee6-e651-4278-9fc9-1493f693924b" returned: 0 in 0.399s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f1d2431c-be8d-48b6-a90f-4ead51278bde tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4f34cee6-e651-4278-9fc9-1493f693924b {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:13 devstack sudo[104975]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4f34cee6-e651-4278-9fc9-1493f693924b Nov 01 12:37:13 devstack sudo[104975]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:13 devstack sudo[104969]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7540e506-cff4-4b95-acf4-644e151e85bb tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.268s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:13 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-7540e506-cff4-4b95-acf4-644e151e85bb tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:37:13 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-7540e506-cff4-4b95-acf4-644e151e85bb tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Deleted volume successfully. Nov 01 12:37:13 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-7540e506-cff4-4b95-acf4-644e151e85bb tempest-TestServerVolumeAttachScenarioOldVersion-1281829554 None] Lock "cinder-8ea2d9e7-6e33-495c-bbc3-927ccda7f56c-delete_volume" released by "delete_volume" :: held 1.217s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:37:13 devstack sudo[104975]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f1d2431c-be8d-48b6-a90f-4ead51278bde tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4f34cee6-e651-4278-9fc9-1493f693924b" returned: 0 in 0.289s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:13 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f1d2431c-be8d-48b6-a90f-4ead51278bde tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "cinder-quobyte-4f34cee6-e651-4278-9fc9-1493f693924b" released by "delete_volume" :: held 0.733s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:37:13 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-f1d2431c-be8d-48b6-a90f-4ead51278bde tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Created reservations ['ae07eec5-22f0-4e7e-853c-d5b8e944abde', '1e04fc2e-a245-4588-8f64-9133435ea487', '44d310a0-ddd6-495c-8cb2-57bad5e883a8', 'b3f6f2c8-7008-417c-b086-3e5ad4366606'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:37:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f1d2431c-be8d-48b6-a90f-4ead51278bde tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f1d2431c-be8d-48b6-a90f-4ead51278bde tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:13 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f1d2431c-be8d-48b6-a90f-4ead51278bde tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:37:13 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f1d2431c-be8d-48b6-a90f-4ead51278bde tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:37:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f1d2431c-be8d-48b6-a90f-4ead51278bde tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f1d2431c-be8d-48b6-a90f-4ead51278bde tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:13 devstack sudo[104979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:37:13 devstack sudo[104979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:14 devstack sudo[104979]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:14 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f1d2431c-be8d-48b6-a90f-4ead51278bde tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.372s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:14 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-f1d2431c-be8d-48b6-a90f-4ead51278bde tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:37:14 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-f1d2431c-be8d-48b6-a90f-4ead51278bde tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Deleted volume successfully. Nov 01 12:37:14 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f1d2431c-be8d-48b6-a90f-4ead51278bde tempest-CreateVolumesFromSourceVolumeTest-2077938074 None] Lock "cinder-4f34cee6-e651-4278-9fc9-1493f693924b-delete_volume" released by "delete_volume" :: held 1.326s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:37:23 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:UPDATE=130,cinder:SELECT=89,cinder:INSERT=32,cinder:DELETE=10 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:37:24 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:SELECT=95,cinder:UPDATE=138,cinder:DELETE=14,cinder:INSERT=28 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:37:28 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-ecc4c643-4300-4315-8e0a-0c84d741f62e tempest-VolumeDependencyTests-624009065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:37:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ecc4c643-4300-4315-8e0a-0c84d741f62e tempest-VolumeDependencyTests-624009065 None] Flow 'volume_create_manager' (e3b298b3-b8fb-4918-8678-43cbf56f3dc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:37:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ecc4c643-4300-4315-8e0a-0c84d741f62e tempest-VolumeDependencyTests-624009065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10799077-059e-4e60-b00d-bc9314febc2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ecc4c643-4300-4315-8e0a-0c84d741f62e tempest-VolumeDependencyTests-624009065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (10799077-059e-4e60-b00d-bc9314febc2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2108969940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c547999-933e-4350-ac18-3186aefefff1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87728e615387400b9eaf7cc06b3f9dcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:37:28Z,use_quota=True,user_id='b310c1906ca14541aac2327dab66f144',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ecc4c643-4300-4315-8e0a-0c84d741f62e tempest-VolumeDependencyTests-624009065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66312b02-fe12-41d4-82d0-da8cf46d9faa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ecc4c643-4300-4315-8e0a-0c84d741f62e tempest-VolumeDependencyTests-624009065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (66312b02-fe12-41d4-82d0-da8cf46d9faa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ecc4c643-4300-4315-8e0a-0c84d741f62e tempest-VolumeDependencyTests-624009065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4df89b8-cc5d-42c4-9fcc-76d394c892c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ecc4c643-4300-4315-8e0a-0c84d741f62e tempest-VolumeDependencyTests-624009065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d4df89b8-cc5d-42c4-9fcc-76d394c892c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9c547999-933e-4350-ac18-3186aefefff1', 'volume_name': 'volume-9c547999-933e-4350-ac18-3186aefefff1', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ecc4c643-4300-4315-8e0a-0c84d741f62e tempest-VolumeDependencyTests-624009065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a1fc69f-ee3d-4bbd-8062-37a4eecda32a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ecc4c643-4300-4315-8e0a-0c84d741f62e tempest-VolumeDependencyTests-624009065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a1fc69f-ee3d-4bbd-8062-37a4eecda32a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ecc4c643-4300-4315-8e0a-0c84d741f62e tempest-VolumeDependencyTests-624009065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28fc427f-f4c3-4a26-a380-087f7ef34276) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:28 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-ecc4c643-4300-4315-8e0a-0c84d741f62e tempest-VolumeDependencyTests-624009065 None] Volume 9c547999-933e-4350-ac18-3186aefefff1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9c547999-933e-4350-ac18-3186aefefff1', 'volume_size': 1} Nov 01 12:37:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ecc4c643-4300-4315-8e0a-0c84d741f62e tempest-VolumeDependencyTests-624009065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ecc4c643-4300-4315-8e0a-0c84d741f62e tempest-VolumeDependencyTests-624009065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:28 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ecc4c643-4300-4315-8e0a-0c84d741f62e tempest-VolumeDependencyTests-624009065 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-2108969940',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9c547999-933e-4350-ac18-3186aefefff1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87728e615387400b9eaf7cc06b3f9dcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:37:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:37:28Z,use_quota=True,user_id='b310c1906ca14541aac2327dab66f144',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:37:28 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-ecc4c643-4300-4315-8e0a-0c84d741f62e tempest-VolumeDependencyTests-624009065 None] Creating volume 9c547999-933e-4350-ac18-3186aefefff1 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:37:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ecc4c643-4300-4315-8e0a-0c84d741f62e tempest-VolumeDependencyTests-624009065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ecc4c643-4300-4315-8e0a-0c84d741f62e tempest-VolumeDependencyTests-624009065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:28 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ecc4c643-4300-4315-8e0a-0c84d741f62e tempest-VolumeDependencyTests-624009065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:37:28 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ecc4c643-4300-4315-8e0a-0c84d741f62e tempest-VolumeDependencyTests-624009065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:37:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ecc4c643-4300-4315-8e0a-0c84d741f62e tempest-VolumeDependencyTests-624009065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:28 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ecc4c643-4300-4315-8e0a-0c84d741f62e tempest-VolumeDependencyTests-624009065 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:37:28 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-ecc4c643-4300-4315-8e0a-0c84d741f62e tempest-VolumeDependencyTests-624009065 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:37:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ecc4c643-4300-4315-8e0a-0c84d741f62e tempest-VolumeDependencyTests-624009065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:28 devstack sudo[105011]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1 1073741824 Nov 01 12:37:28 devstack sudo[105011]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:28 devstack sudo[105011]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ecc4c643-4300-4315-8e0a-0c84d741f62e tempest-VolumeDependencyTests-624009065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1 1073741824" returned: 0 in 0.405s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ecc4c643-4300-4315-8e0a-0c84d741f62e tempest-VolumeDependencyTests-624009065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:28 devstack sudo[105017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1 Nov 01 12:37:28 devstack sudo[105017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:29 devstack sudo[105017]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ecc4c643-4300-4315-8e0a-0c84d741f62e tempest-VolumeDependencyTests-624009065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1" returned: 0 in 0.241s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:29 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ecc4c643-4300-4315-8e0a-0c84d741f62e tempest-VolumeDependencyTests-624009065 None] <== create_volume: return (685ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:37:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ecc4c643-4300-4315-8e0a-0c84d741f62e tempest-VolumeDependencyTests-624009065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.688s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ecc4c643-4300-4315-8e0a-0c84d741f62e tempest-VolumeDependencyTests-624009065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (28fc427f-f4c3-4a26-a380-087f7ef34276) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9c547999-933e-4350-ac18-3186aefefff1', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ecc4c643-4300-4315-8e0a-0c84d741f62e tempest-VolumeDependencyTests-624009065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1bbb5d6-9b41-4e93-ba70-217154639b5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:29 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-ecc4c643-4300-4315-8e0a-0c84d741f62e tempest-VolumeDependencyTests-624009065 None] Volume volume-9c547999-933e-4350-ac18-3186aefefff1 (9c547999-933e-4350-ac18-3186aefefff1): created successfully Nov 01 12:37:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ecc4c643-4300-4315-8e0a-0c84d741f62e tempest-VolumeDependencyTests-624009065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1bbb5d6-9b41-4e93-ba70-217154639b5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-ecc4c643-4300-4315-8e0a-0c84d741f62e tempest-VolumeDependencyTests-624009065 None] Flow 'volume_create_manager' (e3b298b3-b8fb-4918-8678-43cbf56f3dc9) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:37:29 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-ecc4c643-4300-4315-8e0a-0c84d741f62e tempest-VolumeDependencyTests-624009065 None] Created volume successfully. Nov 01 12:37:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8a0a3b72-8069-41da-b3ea-7b99c7f0aed7 tempest-VolumeDependencyTests-624009065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8a0a3b72-8069-41da-b3ea-7b99c7f0aed7 tempest-VolumeDependencyTests-624009065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:29 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-8a0a3b72-8069-41da-b3ea-7b99c7f0aed7 tempest-VolumeDependencyTests-624009065 None] Creating offline snapshot 380a0c8a-457c-4e92-9d47-5bd0099f4078 of volume 9c547999-933e-4350-ac18-3186aefefff1 {{(pid=86574) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:37:29 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[e4e46922-3de6-44f3-b82f-521e7b8e3d8c]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:37:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8a0a3b72-8069-41da-b3ea-7b99c7f0aed7 tempest-VolumeDependencyTests-624009065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:29 devstack sudo[105020]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1 Nov 01 12:37:29 devstack sudo[105020]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:29 devstack sudo[105020]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8a0a3b72-8069-41da-b3ea-7b99c7f0aed7 tempest-VolumeDependencyTests-624009065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1" returned: 0 in 0.351s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8a0a3b72-8069-41da-b3ea-7b99c7f0aed7 tempest-VolumeDependencyTests-624009065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1.380a0c8a-457c-4e92-9d47-5bd0099f4078 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:29 devstack sudo[105025]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1.380a0c8a-457c-4e92-9d47-5bd0099f4078 1G Nov 01 12:37:29 devstack sudo[105025]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:30 devstack sudo[105025]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8a0a3b72-8069-41da-b3ea-7b99c7f0aed7 tempest-VolumeDependencyTests-624009065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1.380a0c8a-457c-4e92-9d47-5bd0099f4078 1G" returned: 0 in 0.372s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8a0a3b72-8069-41da-b3ea-7b99c7f0aed7 tempest-VolumeDependencyTests-624009065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c547999-933e-4350-ac18-3186aefefff1 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1.380a0c8a-457c-4e92-9d47-5bd0099f4078 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:30 devstack sudo[105030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c547999-933e-4350-ac18-3186aefefff1 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1.380a0c8a-457c-4e92-9d47-5bd0099f4078 Nov 01 12:37:30 devstack sudo[105030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:30 devstack sudo[105030]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8a0a3b72-8069-41da-b3ea-7b99c7f0aed7 tempest-VolumeDependencyTests-624009065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9c547999-933e-4350-ac18-3186aefefff1 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1.380a0c8a-457c-4e92-9d47-5bd0099f4078" returned: 0 in 0.289s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:30 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-8a0a3b72-8069-41da-b3ea-7b99c7f0aed7 tempest-VolumeDependencyTests-624009065 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1.380a0c8a-457c-4e92-9d47-5bd0099f4078 is being set with open permissions: ugo+rw Nov 01 12:37:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8a0a3b72-8069-41da-b3ea-7b99c7f0aed7 tempest-VolumeDependencyTests-624009065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1.380a0c8a-457c-4e92-9d47-5bd0099f4078 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:30 devstack sudo[105036]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1.380a0c8a-457c-4e92-9d47-5bd0099f4078 Nov 01 12:37:30 devstack sudo[105036]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:30 devstack sudo[105036]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8a0a3b72-8069-41da-b3ea-7b99c7f0aed7 tempest-VolumeDependencyTests-624009065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1.380a0c8a-457c-4e92-9d47-5bd0099f4078" returned: 0 in 0.247s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8a0a3b72-8069-41da-b3ea-7b99c7f0aed7 tempest-VolumeDependencyTests-624009065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:30 devstack sudo[105039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1.info Nov 01 12:37:30 devstack sudo[105039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:31 devstack sudo[105039]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8a0a3b72-8069-41da-b3ea-7b99c7f0aed7 tempest-VolumeDependencyTests-624009065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1.info" returned: 0 in 0.243s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:31 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-8a0a3b72-8069-41da-b3ea-7b99c7f0aed7 tempest-VolumeDependencyTests-624009065 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1.info is being set with open permissions: ugo+rw Nov 01 12:37:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8a0a3b72-8069-41da-b3ea-7b99c7f0aed7 tempest-VolumeDependencyTests-624009065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:31 devstack sudo[105042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1.info Nov 01 12:37:31 devstack sudo[105042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:31 devstack sudo[105042]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8a0a3b72-8069-41da-b3ea-7b99c7f0aed7 tempest-VolumeDependencyTests-624009065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1.info" returned: 0 in 0.235s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8a0a3b72-8069-41da-b3ea-7b99c7f0aed7 tempest-VolumeDependencyTests-624009065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.847s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:31 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-8a0a3b72-8069-41da-b3ea-7b99c7f0aed7 tempest-VolumeDependencyTests-624009065 None] Create snapshot completed successfully Nov 01 12:37:32 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:37:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] Flow 'volume_create_manager' (889dc5aa-2980-462c-8718-3803d40f45f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:37:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (014d9120-f8c4-4cdc-b020-3855c623f7ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (014d9120-f8c4-4cdc-b020-3855c623f7ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:37:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-995409246',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e9d95f0f-42d0-4bae-8089-ab1f4697510e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='87728e615387400b9eaf7cc06b3f9dcd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:37:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=380a0c8a-457c-4e92-9d47-5bd0099f4078,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:37:32Z,use_quota=True,user_id='b310c1906ca14541aac2327dab66f144',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b5d6b4b-47c1-4418-b529-289a57c0924f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8b5d6b4b-47c1-4418-b529-289a57c0924f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (472c6cb5-c168-401c-a9cb-44267fa9ad34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (472c6cb5-c168-401c-a9cb-44267fa9ad34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'e9d95f0f-42d0-4bae-8089-ab1f4697510e', 'volume_name': 'volume-e9d95f0f-42d0-4bae-8089-ab1f4697510e', 'volume_size': 1, 'snapshot_id': '380a0c8a-457c-4e92-9d47-5bd0099f4078'}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (903d2463-2cff-4b9a-b3b1-954f9c7da894) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (903d2463-2cff-4b9a-b3b1-954f9c7da894) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3ff8ce7-6cd3-4729-a0ff-88b8f1a74940) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:32 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] Volume e9d95f0f-42d0-4bae-8089-ab1f4697510e: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-e9d95f0f-42d0-4bae-8089-ab1f4697510e', 'volume_size': 1, 'snapshot_id': '380a0c8a-457c-4e92-9d47-5bd0099f4078'} Nov 01 12:37:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:32 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] Acquiring lock "cinder-quobyte-380a0c8a-457c-4e92-9d47-5bd0099f4078-e9d95f0f-42d0-4bae-8089-ab1f4697510e" by "_create_volume_from_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:37:32 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] Lock "cinder-quobyte-380a0c8a-457c-4e92-9d47-5bd0099f4078-e9d95f0f-42d0-4bae-8089-ab1f4697510e" acquired by "_create_volume_from_snapshot" :: waited 0.014s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:37:32 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] Creating volume e9d95f0f-42d0-4bae-8089-ab1f4697510e from snapshot 380a0c8a-457c-4e92-9d47-5bd0099f4078 {{(pid=86574) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 01 12:37:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:32 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:37:32 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:37:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:32 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:37:32 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] Acquiring lock "cinder-quobyte-e9d95f0f-42d0-4bae-8089-ab1f4697510e" by "_copy_volume_from_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:37:32 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] Lock "cinder-quobyte-e9d95f0f-42d0-4bae-8089-ab1f4697510e" acquired by "_copy_volume_from_snapshot" :: waited 0.012s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:37:32 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] snapshot: 380a0c8a-457c-4e92-9d47-5bd0099f4078, volume: e9d95f0f-42d0-4bae-8089-ab1f4697510e, {{(pid=86574) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 01 12:37:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:32 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:37:32 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:37:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:32 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e14d1d9-05e5-4844-a47f-e846c640f1b7]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:37:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1.380a0c8a-457c-4e92-9d47-5bd0099f4078 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:32 devstack sudo[105045]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1.380a0c8a-457c-4e92-9d47-5bd0099f4078 Nov 01 12:37:32 devstack sudo[105045]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:32 devstack sudo[105045]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1.380a0c8a-457c-4e92-9d47-5bd0099f4078" returned: 0 in 0.350s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:32 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c547999-933e-4350-ac18-3186aefefff1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:37:32 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[41fa87a5-1916-49cd-a3b2-43bef9fada52]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:37:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:32 devstack sudo[105050]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1 Nov 01 12:37:32 devstack sudo[105050]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:32 devstack sudo[105050]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1" returned: 0 in 0.350s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:32 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1 {{(pid=86574) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 01 12:37:32 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] Creating direct copy from snapshot {{(pid=86574) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 01 12:37:32 devstack cinder-volume[86574]: DEBUG cinder.utils [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] Path /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e9d95f0f-42d0-4bae-8089-ab1f4697510e not found in is_blk_device check {{(pid=86574) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 01 12:37:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e9d95f0f-42d0-4bae-8089-ab1f4697510e {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:32 devstack sudo[105055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e9d95f0f-42d0-4bae-8089-ab1f4697510e Nov 01 12:37:32 devstack sudo[105055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:38 devstack sudo[105055]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e9d95f0f-42d0-4bae-8089-ab1f4697510e" returned: 0 in 6.013s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:38 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] Image conversion details: src /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1, size 1024.00 MB, duration 6.01 sec, destination /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e9d95f0f-42d0-4bae-8089-ab1f4697510e {{(pid=86574) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 12:37:38 devstack cinder-volume[86574]: INFO cinder.image.image_utils [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] Converted 1024.00 MB image at 170.26 MB/s Nov 01 12:37:38 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e9d95f0f-42d0-4bae-8089-ab1f4697510e is being set with open permissions: ugo+rw Nov 01 12:37:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e9d95f0f-42d0-4bae-8089-ab1f4697510e {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:38 devstack sudo[105069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e9d95f0f-42d0-4bae-8089-ab1f4697510e Nov 01 12:37:38 devstack sudo[105069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:39 devstack sudo[105069]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e9d95f0f-42d0-4bae-8089-ab1f4697510e" returned: 0 in 0.236s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:39 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] Lock "cinder-quobyte-e9d95f0f-42d0-4bae-8089-ab1f4697510e" released by "_copy_volume_from_snapshot" :: held 7.030s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:37:39 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] Lock "cinder-quobyte-380a0c8a-457c-4e92-9d47-5bd0099f4078-e9d95f0f-42d0-4bae-8089-ab1f4697510e" released by "_create_volume_from_snapshot" :: held 7.086s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:37:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 7.102s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:39 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3ff8ce7-6cd3-4729-a0ff-88b8f1a74940) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e9d95f0f-42d0-4bae-8089-ab1f4697510e', 'volume_size': 1, 'snapshot_id': '380a0c8a-457c-4e92-9d47-5bd0099f4078'}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:39 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1381e8e-c4c5-4498-8597-623867a273f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:39 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] Volume volume-e9d95f0f-42d0-4bae-8089-ab1f4697510e (e9d95f0f-42d0-4bae-8089-ab1f4697510e): created successfully Nov 01 12:37:39 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a1381e8e-c4c5-4498-8597-623867a273f6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:39 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] Flow 'volume_create_manager' (889dc5aa-2980-462c-8718-3803d40f45f0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:37:39 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-be95c249-c45f-4a91-bcc8-ddafce56e51e tempest-VolumeDependencyTests-624009065 None] Created volume successfully. Nov 01 12:37:39 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-c336d2ec-716f-437b-9cdc-b643897c781a tempest-VolumeDependencyTests-624009065 None] Acquiring lock "cinder-380a0c8a-457c-4e92-9d47-5bd0099f4078-delete_snapshot" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:37:39 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-c336d2ec-716f-437b-9cdc-b643897c781a tempest-VolumeDependencyTests-624009065 None] Lock "cinder-380a0c8a-457c-4e92-9d47-5bd0099f4078-delete_snapshot" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:37:39 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-c336d2ec-716f-437b-9cdc-b643897c781a tempest-VolumeDependencyTests-624009065 None] Acquiring lock "cinder-quobyte-9c547999-933e-4350-ac18-3186aefefff1" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:37:39 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-c336d2ec-716f-437b-9cdc-b643897c781a tempest-VolumeDependencyTests-624009065 None] Lock "cinder-quobyte-9c547999-933e-4350-ac18-3186aefefff1" acquired by "delete_snapshot" :: waited 0.014s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:37:39 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-c336d2ec-716f-437b-9cdc-b643897c781a tempest-VolumeDependencyTests-624009065 None] Acquiring lock "cinder-quobyte-380a0c8a-457c-4e92-9d47-5bd0099f4078" by "_delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:37:39 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-c336d2ec-716f-437b-9cdc-b643897c781a tempest-VolumeDependencyTests-624009065 None] Lock "cinder-quobyte-380a0c8a-457c-4e92-9d47-5bd0099f4078" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:37:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-c336d2ec-716f-437b-9cdc-b643897c781a tempest-VolumeDependencyTests-624009065 None] Deleting offline snapshot 380a0c8a-457c-4e92-9d47-5bd0099f4078 of volume 9c547999-933e-4350-ac18-3186aefefff1 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:37:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-c336d2ec-716f-437b-9cdc-b643897c781a tempest-VolumeDependencyTests-624009065 None] snapshot_file for this snap is: volume-9c547999-933e-4350-ac18-3186aefefff1.380a0c8a-457c-4e92-9d47-5bd0099f4078 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:37:39 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[be57e1ea-11ee-4a4f-8014-fcd73c160877]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:37:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c336d2ec-716f-437b-9cdc-b643897c781a tempest-VolumeDependencyTests-624009065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1.380a0c8a-457c-4e92-9d47-5bd0099f4078 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:39 devstack sudo[105072]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1.380a0c8a-457c-4e92-9d47-5bd0099f4078 Nov 01 12:37:39 devstack sudo[105072]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:39 devstack cinder-volume[86574]: DEBUG oslo_service.periodic_task [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86574) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:37:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:37:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:37:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:39 devstack sudo[105077]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:37:39 devstack sudo[105077]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:39 devstack sudo[105072]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c336d2ec-716f-437b-9cdc-b643897c781a tempest-VolumeDependencyTests-624009065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1.380a0c8a-457c-4e92-9d47-5bd0099f4078" returned: 0 in 0.353s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-c336d2ec-716f-437b-9cdc-b643897c781a tempest-VolumeDependencyTests-624009065 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9c547999-933e-4350-ac18-3186aefefff1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:37:39 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb0ecfd6-a015-4f42-8da6-fa6d8c6f3f17]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:37:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c336d2ec-716f-437b-9cdc-b643897c781a tempest-VolumeDependencyTests-624009065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:40 devstack sudo[105079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1 Nov 01 12:37:40 devstack sudo[105079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:40 devstack sudo[105077]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.245s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:40 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:37:40 devstack cinder-volume[86574]: DEBUG oslo_service.periodic_task [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running periodic task VolumeManager._thread_info {{(pid=86574) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:37:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] thread count: 28 {{(pid=86574) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 12:37:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] thread info: [<_MainThread(MainThread, started 131331184930944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86574) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 12:37:40 devstack sudo[105079]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c336d2ec-716f-437b-9cdc-b643897c781a tempest-VolumeDependencyTests-624009065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1" returned: 0 in 0.531s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c336d2ec-716f-437b-9cdc-b643897c781a tempest-VolumeDependencyTests-624009065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1.380a0c8a-457c-4e92-9d47-5bd0099f4078 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:40 devstack sudo[105085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1.380a0c8a-457c-4e92-9d47-5bd0099f4078 Nov 01 12:37:40 devstack sudo[105085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:40 devstack sudo[105085]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c336d2ec-716f-437b-9cdc-b643897c781a tempest-VolumeDependencyTests-624009065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1.380a0c8a-457c-4e92-9d47-5bd0099f4078" returned: 0 in 0.336s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c336d2ec-716f-437b-9cdc-b643897c781a tempest-VolumeDependencyTests-624009065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1.380a0c8a-457c-4e92-9d47-5bd0099f4078 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:40 devstack sudo[105097]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1.380a0c8a-457c-4e92-9d47-5bd0099f4078 Nov 01 12:37:40 devstack sudo[105097]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:41 devstack sudo[105097]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c336d2ec-716f-437b-9cdc-b643897c781a tempest-VolumeDependencyTests-624009065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1.380a0c8a-457c-4e92-9d47-5bd0099f4078" returned: 0 in 0.241s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:41 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-c336d2ec-716f-437b-9cdc-b643897c781a tempest-VolumeDependencyTests-624009065 None] Lock "cinder-quobyte-380a0c8a-457c-4e92-9d47-5bd0099f4078" released by "_delete_snapshot" :: held 1.564s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:37:41 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-c336d2ec-716f-437b-9cdc-b643897c781a tempest-VolumeDependencyTests-624009065 None] Lock "cinder-quobyte-9c547999-933e-4350-ac18-3186aefefff1" released by "delete_snapshot" :: held 1.585s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:37:41 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-c336d2ec-716f-437b-9cdc-b643897c781a tempest-VolumeDependencyTests-624009065 None] Created reservations ['41b55e14-de60-4588-9e13-8ff943fa64bd', 'cd8f80c7-b6f5-4f06-bc4e-2440156dd30b', 'a7a9d2cd-f4ac-4c3d-b8c0-30c03fd86fca', '698372bc-9b9c-46cd-ae94-7877a3b1a58e'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:37:41 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-c336d2ec-716f-437b-9cdc-b643897c781a tempest-VolumeDependencyTests-624009065 None] Delete snapshot completed successfully. Nov 01 12:37:41 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-c336d2ec-716f-437b-9cdc-b643897c781a tempest-VolumeDependencyTests-624009065 None] Lock "cinder-380a0c8a-457c-4e92-9d47-5bd0099f4078-delete_snapshot" released by "delete_snapshot" :: held 1.702s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:37:41 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0cf783d0-532b-4670-9912-4325d6545ea4 tempest-VolumeDependencyTests-624009065 None] Acquiring lock "cinder-9c547999-933e-4350-ac18-3186aefefff1-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:37:41 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0cf783d0-532b-4670-9912-4325d6545ea4 tempest-VolumeDependencyTests-624009065 None] Lock "cinder-9c547999-933e-4350-ac18-3186aefefff1-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:37:41 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0cf783d0-532b-4670-9912-4325d6545ea4 tempest-VolumeDependencyTests-624009065 None] Acquiring lock "cinder-quobyte-9c547999-933e-4350-ac18-3186aefefff1" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:37:41 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0cf783d0-532b-4670-9912-4325d6545ea4 tempest-VolumeDependencyTests-624009065 None] Lock "cinder-quobyte-9c547999-933e-4350-ac18-3186aefefff1" acquired by "delete_volume" :: waited 0.018s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:37:41 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[450aaf9e-5427-483a-a53e-9cb75706bfd7]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:37:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0cf783d0-532b-4670-9912-4325d6545ea4 tempest-VolumeDependencyTests-624009065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:41 devstack sudo[105100]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1 Nov 01 12:37:41 devstack sudo[105100]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:42 devstack sudo[105100]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0cf783d0-532b-4670-9912-4325d6545ea4 tempest-VolumeDependencyTests-624009065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1" returned: 0 in 0.349s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0cf783d0-532b-4670-9912-4325d6545ea4 tempest-VolumeDependencyTests-624009065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:42 devstack sudo[105105]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1 Nov 01 12:37:42 devstack sudo[105105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:42 devstack sudo[105105]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0cf783d0-532b-4670-9912-4325d6545ea4 tempest-VolumeDependencyTests-624009065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9c547999-933e-4350-ac18-3186aefefff1" returned: 0 in 0.236s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:42 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0cf783d0-532b-4670-9912-4325d6545ea4 tempest-VolumeDependencyTests-624009065 None] Lock "cinder-quobyte-9c547999-933e-4350-ac18-3186aefefff1" released by "delete_volume" :: held 0.643s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:37:42 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-0cf783d0-532b-4670-9912-4325d6545ea4 tempest-VolumeDependencyTests-624009065 None] Created reservations ['0244956c-9eb5-45bf-9ce3-4d1fc5a8cafd', 'ed2a7ab6-8d88-4b34-aa71-d4b6644a1b89', '1d223165-b7cf-453c-af8a-1098a949a4fd', 'f1e383f8-5ae2-4920-804c-4aae3e66953e'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:37:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0cf783d0-532b-4670-9912-4325d6545ea4 tempest-VolumeDependencyTests-624009065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0cf783d0-532b-4670-9912-4325d6545ea4 tempest-VolumeDependencyTests-624009065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:42 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-0cf783d0-532b-4670-9912-4325d6545ea4 tempest-VolumeDependencyTests-624009065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:37:42 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-0cf783d0-532b-4670-9912-4325d6545ea4 tempest-VolumeDependencyTests-624009065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:37:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0cf783d0-532b-4670-9912-4325d6545ea4 tempest-VolumeDependencyTests-624009065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0cf783d0-532b-4670-9912-4325d6545ea4 tempest-VolumeDependencyTests-624009065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:42 devstack sudo[105108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:37:42 devstack sudo[105108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:42 devstack sudo[105108]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0cf783d0-532b-4670-9912-4325d6545ea4 tempest-VolumeDependencyTests-624009065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.236s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:42 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-0cf783d0-532b-4670-9912-4325d6545ea4 tempest-VolumeDependencyTests-624009065 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:37:42 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-0cf783d0-532b-4670-9912-4325d6545ea4 tempest-VolumeDependencyTests-624009065 None] Deleted volume successfully. Nov 01 12:37:42 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-0cf783d0-532b-4670-9912-4325d6545ea4 tempest-VolumeDependencyTests-624009065 None] Lock "cinder-9c547999-933e-4350-ac18-3186aefefff1-delete_volume" released by "delete_volume" :: held 1.087s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:37:42 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-5261ef88-4369-4168-9047-b2b65bb69c96 tempest-VolumeDependencyTests-624009065 None] Acquiring lock "cinder-e9d95f0f-42d0-4bae-8089-ab1f4697510e-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:37:42 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-5261ef88-4369-4168-9047-b2b65bb69c96 tempest-VolumeDependencyTests-624009065 None] Lock "cinder-e9d95f0f-42d0-4bae-8089-ab1f4697510e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:37:42 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-5261ef88-4369-4168-9047-b2b65bb69c96 tempest-VolumeDependencyTests-624009065 None] Acquiring lock "cinder-quobyte-e9d95f0f-42d0-4bae-8089-ab1f4697510e" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:37:42 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-5261ef88-4369-4168-9047-b2b65bb69c96 tempest-VolumeDependencyTests-624009065 None] Lock "cinder-quobyte-e9d95f0f-42d0-4bae-8089-ab1f4697510e" acquired by "delete_volume" :: waited 0.014s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:37:42 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[720b4fdd-6518-474b-a866-637bdaa9a767]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:37:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5261ef88-4369-4168-9047-b2b65bb69c96 tempest-VolumeDependencyTests-624009065 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e9d95f0f-42d0-4bae-8089-ab1f4697510e {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:43 devstack sudo[105111]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e9d95f0f-42d0-4bae-8089-ab1f4697510e Nov 01 12:37:43 devstack sudo[105111]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:43 devstack sudo[105111]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5261ef88-4369-4168-9047-b2b65bb69c96 tempest-VolumeDependencyTests-624009065 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e9d95f0f-42d0-4bae-8089-ab1f4697510e" returned: 0 in 0.354s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5261ef88-4369-4168-9047-b2b65bb69c96 tempest-VolumeDependencyTests-624009065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e9d95f0f-42d0-4bae-8089-ab1f4697510e {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:43 devstack sudo[105116]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e9d95f0f-42d0-4bae-8089-ab1f4697510e Nov 01 12:37:43 devstack sudo[105116]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:43 devstack sudo[105116]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5261ef88-4369-4168-9047-b2b65bb69c96 tempest-VolumeDependencyTests-624009065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-e9d95f0f-42d0-4bae-8089-ab1f4697510e" returned: 0 in 0.246s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:43 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-5261ef88-4369-4168-9047-b2b65bb69c96 tempest-VolumeDependencyTests-624009065 None] Lock "cinder-quobyte-e9d95f0f-42d0-4bae-8089-ab1f4697510e" released by "delete_volume" :: held 0.644s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:37:43 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-5261ef88-4369-4168-9047-b2b65bb69c96 tempest-VolumeDependencyTests-624009065 None] Created reservations ['88401239-1722-4989-9253-af93a08e1b28', '2354a5e8-8e1f-476d-989e-0be77d16603a', '23e1b9ce-8a13-4be1-a579-3254c359c027', 'c3e50189-9377-4a1e-8481-58f41b894f99'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:37:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5261ef88-4369-4168-9047-b2b65bb69c96 tempest-VolumeDependencyTests-624009065 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5261ef88-4369-4168-9047-b2b65bb69c96 tempest-VolumeDependencyTests-624009065 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:43 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-5261ef88-4369-4168-9047-b2b65bb69c96 tempest-VolumeDependencyTests-624009065 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:37:43 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-5261ef88-4369-4168-9047-b2b65bb69c96 tempest-VolumeDependencyTests-624009065 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:37:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5261ef88-4369-4168-9047-b2b65bb69c96 tempest-VolumeDependencyTests-624009065 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5261ef88-4369-4168-9047-b2b65bb69c96 tempest-VolumeDependencyTests-624009065 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:43 devstack sudo[105153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:37:43 devstack sudo[105153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:43 devstack sudo[105153]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5261ef88-4369-4168-9047-b2b65bb69c96 tempest-VolumeDependencyTests-624009065 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.258s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:43 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-5261ef88-4369-4168-9047-b2b65bb69c96 tempest-VolumeDependencyTests-624009065 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:37:43 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-5261ef88-4369-4168-9047-b2b65bb69c96 tempest-VolumeDependencyTests-624009065 None] Deleted volume successfully. Nov 01 12:37:43 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-5261ef88-4369-4168-9047-b2b65bb69c96 tempest-VolumeDependencyTests-624009065 None] Lock "cinder-e9d95f0f-42d0-4bae-8089-ab1f4697510e-delete_volume" released by "delete_volume" :: held 1.093s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:37:48 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:37:48 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Flow 'volume_create_manager' (9ca6c4a0-489b-49f8-a4d0-1f03ca433918) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:37:48 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9c02f95-8086-4090-8c2e-50fd394ddd25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:48 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e9c02f95-8086-4090-8c2e-50fd394ddd25) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:37:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7539722a-d26b-4659-86c4-5f6fc03d28e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7b96ccbc55a45e99628e82e3faa80a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:37:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:37:49Z,use_quota=True,user_id='4bba18d3150a4ea7a72c519658b7a9e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:48 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32636041-9cc3-470a-b5ee-0e35a1d09567) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:48 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (32636041-9cc3-470a-b5ee-0e35a1d09567) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:48 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79e1aaa9-a70e-42ac-b980-e09287011eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:48 devstack cinder-volume[86574]: DEBUG cinder.image.glance [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Creating Keystone auth plugin from conf {{(pid=86574) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 01 12:37:49 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79e1aaa9-a70e-42ac-b980-e09287011eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7539722a-d26b-4659-86c4-5f6fc03d28e0', 'volume_name': 'volume-7539722a-d26b-4659-86c4-5f6fc03d28e0', 'volume_size': 1, 'image_id': '63f081f1-0ed0-4033-b064-d86eccfaf520', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/63f081f1-0ed0-4033-b064-d86eccfaf520', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '65fce090c3b21fa9dc418bff24439a21', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b7b96ccbc55a45e99628e82e3faa80a0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b548c01acd4a5c128f10355333f083ff0851f5537e35f08711a625ce295ec9bcdb9a5e808c74e609ff4dad0d256f47d2ce0afdf0ee976ebacce07ccfd35a66ac', 'id': '63f081f1-0ed0-4033-b064-d86eccfaf520', 'created_at': datetime.datetime(2026, 11, 1, 11, 37, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 37, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/63f081f1-0ed0-4033-b064-d86eccfaf520/file', 'properties': {}}, 'image_service': }' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:49 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bae21181-1356-4537-bc9e-dde96aeb18d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:49 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bae21181-1356-4537-bc9e-dde96aeb18d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:49 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e47ec81-de6c-4ad7-b0b1-875c3dacdfc9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:49 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Volume 7539722a-d26b-4659-86c4-5f6fc03d28e0: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7539722a-d26b-4659-86c4-5f6fc03d28e0', 'volume_size': 1, 'image_id': '63f081f1-0ed0-4033-b064-d86eccfaf520', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/63f081f1-0ed0-4033-b064-d86eccfaf520', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '65fce090c3b21fa9dc418bff24439a21', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b7b96ccbc55a45e99628e82e3faa80a0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b548c01acd4a5c128f10355333f083ff0851f5537e35f08711a625ce295ec9bcdb9a5e808c74e609ff4dad0d256f47d2ce0afdf0ee976ebacce07ccfd35a66ac', 'id': '63f081f1-0ed0-4033-b064-d86eccfaf520', 'created_at': datetime.datetime(2026, 11, 1, 11, 37, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 37, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/63f081f1-0ed0-4033-b064-d86eccfaf520/file', 'properties': {}}, 'image_service': } Nov 01 12:37:49 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Trying to clone 7539722a-d26b-4659-86c4-5f6fc03d28e0 from image 63f081f1-0ed0-4033-b064-d86eccfaf520 at location (None, [{'url': 'file:///opt/stack/data/glance/images/63f081f1-0ed0-4033-b064-d86eccfaf520', 'metadata': {}}]). {{(pid=86574) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 01 12:37:49 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_63f081f1-0ed0-4033-b064-d86eccfaf520_o5ekcitfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86574) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 01 12:37:49 devstack cinder-volume[86574]: INFO cinder.image.image_utils [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Image download 0.00 MB at 0.00 MB/s Nov 01 12:37:49 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[a73dac99-a760-475f-8134-f12ddc928634]: (4, 'raw') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:37:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63f081f1-0ed0-4033-b064-d86eccfaf520_o5ekcitfdevstack@QuobyteHD {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:49 devstack sudo[105159]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63f081f1-0ed0-4033-b064-d86eccfaf520_o5ekcitfdevstack@QuobyteHD Nov 01 12:37:49 devstack sudo[105159]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:49 devstack sudo[105159]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63f081f1-0ed0-4033-b064-d86eccfaf520_o5ekcitfdevstack@QuobyteHD" returned: 0 in 0.322s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63f081f1-0ed0-4033-b064-d86eccfaf520_o5ekcitfdevstack@QuobyteHD {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:49 devstack sudo[105163]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63f081f1-0ed0-4033-b064-d86eccfaf520_o5ekcitfdevstack@QuobyteHD Nov 01 12:37:49 devstack sudo[105163]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:49 devstack sudo[105163]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63f081f1-0ed0-4033-b064-d86eccfaf520_o5ekcitfdevstack@QuobyteHD" returned: 1 in 0.327s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63f081f1-0ed0-4033-b064-d86eccfaf520_o5ekcitfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 12:37:49 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Temporary image 63f081f1-0ed0-4033-b064-d86eccfaf520 is fetched for user 4bba18d3150a4ea7a72c519658b7a9e7. {{(pid=86574) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 01 12:37:49 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd120423-30fe-4bff-b69b-f6fe03798834]: (4, 'raw') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:37:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63f081f1-0ed0-4033-b064-d86eccfaf520_o5ekcitfdevstack@QuobyteHD {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:50 devstack sudo[105168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63f081f1-0ed0-4033-b064-d86eccfaf520_o5ekcitfdevstack@QuobyteHD Nov 01 12:37:50 devstack sudo[105168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:50 devstack sudo[105168]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63f081f1-0ed0-4033-b064-d86eccfaf520_o5ekcitfdevstack@QuobyteHD" returned: 0 in 0.324s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63f081f1-0ed0-4033-b064-d86eccfaf520_o5ekcitfdevstack@QuobyteHD {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:50 devstack sudo[105172]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63f081f1-0ed0-4033-b064-d86eccfaf520_o5ekcitfdevstack@QuobyteHD Nov 01 12:37:50 devstack sudo[105172]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:50 devstack sudo[105172]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63f081f1-0ed0-4033-b064-d86eccfaf520_o5ekcitfdevstack@QuobyteHD" returned: 1 in 0.319s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63f081f1-0ed0-4033-b064-d86eccfaf520_o5ekcitfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 12:37:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:50 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:37:49Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7539722a-d26b-4659-86c4-5f6fc03d28e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b7b96ccbc55a45e99628e82e3faa80a0',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:37:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:37:49Z,use_quota=True,user_id='4bba18d3150a4ea7a72c519658b7a9e7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:37:50 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Creating volume 7539722a-d26b-4659-86c4-5f6fc03d28e0 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:37:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:50 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:37:50 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:37:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:50 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:37:50 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:37:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7539722a-d26b-4659-86c4-5f6fc03d28e0 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:50 devstack sudo[105177]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7539722a-d26b-4659-86c4-5f6fc03d28e0 1073741824 Nov 01 12:37:50 devstack sudo[105177]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:51 devstack sudo[105177]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7539722a-d26b-4659-86c4-5f6fc03d28e0 1073741824" returned: 0 in 0.428s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7539722a-d26b-4659-86c4-5f6fc03d28e0 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:51 devstack sudo[105183]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7539722a-d26b-4659-86c4-5f6fc03d28e0 Nov 01 12:37:51 devstack sudo[105183]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:51 devstack sudo[105183]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7539722a-d26b-4659-86c4-5f6fc03d28e0" returned: 0 in 0.242s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:51 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] <== create_volume: return (734ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:37:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.738s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:51 devstack cinder-volume[86574]: DEBUG cinder.volume.volume_utils [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Attempting download of 63f081f1-0ed0-4033-b064-d86eccfaf520 ((None, [{'url': 'file:///opt/stack/data/glance/images/63f081f1-0ed0-4033-b064-d86eccfaf520', 'metadata': {}}])) to volume 7539722a-d26b-4659-86c4-5f6fc03d28e0. {{(pid=86574) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 01 12:37:51 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e069e58-a620-4a42-ae86-33dcd4db7372]: (4, 'raw') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:37:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_63f081f1-0ed0-4033-b064-d86eccfaf520_0d6bqr3_ {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:51 devstack sudo[105186]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_63f081f1-0ed0-4033-b064-d86eccfaf520_0d6bqr3_ Nov 01 12:37:51 devstack sudo[105186]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:51 devstack sudo[105186]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_63f081f1-0ed0-4033-b064-d86eccfaf520_0d6bqr3_" returned: 0 in 0.318s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_63f081f1-0ed0-4033-b064-d86eccfaf520_0d6bqr3_ {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:51 devstack sudo[105190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_63f081f1-0ed0-4033-b064-d86eccfaf520_0d6bqr3_ Nov 01 12:37:51 devstack sudo[105190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:52 devstack sudo[105190]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_63f081f1-0ed0-4033-b064-d86eccfaf520_0d6bqr3_" returned: 1 in 0.315s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_63f081f1-0ed0-4033-b064-d86eccfaf520_0d6bqr3_' failed. Not Retrying. {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 12:37:52 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec167c1a-23c7-4957-80c6-d8ed66b24357]: (4, 'raw') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:37:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63f081f1-0ed0-4033-b064-d86eccfaf520_o5ekcitfdevstack@QuobyteHD {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:52 devstack sudo[105194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63f081f1-0ed0-4033-b064-d86eccfaf520_o5ekcitfdevstack@QuobyteHD Nov 01 12:37:52 devstack sudo[105194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:52 devstack sudo[105194]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_63f081f1-0ed0-4033-b064-d86eccfaf520_o5ekcitfdevstack@QuobyteHD" returned: 0 in 0.313s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63f081f1-0ed0-4033-b064-d86eccfaf520_o5ekcitfdevstack@QuobyteHD {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:52 devstack sudo[105198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63f081f1-0ed0-4033-b064-d86eccfaf520_o5ekcitfdevstack@QuobyteHD Nov 01 12:37:52 devstack sudo[105198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:52 devstack sudo[105198]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63f081f1-0ed0-4033-b064-d86eccfaf520_o5ekcitfdevstack@QuobyteHD" returned: 1 in 0.312s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_63f081f1-0ed0-4033-b064-d86eccfaf520_o5ekcitfdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 12:37:52 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] 63f081f1-0ed0-4033-b064-d86eccfaf520 was raw, converting to qcow2 {{(pid=86574) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 01 12:37:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_63f081f1-0ed0-4033-b064-d86eccfaf520_o5ekcitfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7539722a-d26b-4659-86c4-5f6fc03d28e0 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:52 devstack sudo[105203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_63f081f1-0ed0-4033-b064-d86eccfaf520_o5ekcitfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7539722a-d26b-4659-86c4-5f6fc03d28e0 Nov 01 12:37:52 devstack sudo[105203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:53 devstack sudo[105203]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_63f081f1-0ed0-4033-b064-d86eccfaf520_o5ekcitfdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7539722a-d26b-4659-86c4-5f6fc03d28e0" returned: 0 in 0.416s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:53 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_63f081f1-0ed0-4033-b064-d86eccfaf520_o5ekcitfdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7539722a-d26b-4659-86c4-5f6fc03d28e0 {{(pid=86574) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 12:37:53 devstack cinder-volume[86574]: INFO cinder.image.image_utils [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Converted 0.00 MB image at 0.00 MB/s Nov 01 12:37:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7539722a-d26b-4659-86c4-5f6fc03d28e0 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:53 devstack sudo[105209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7539722a-d26b-4659-86c4-5f6fc03d28e0 1G Nov 01 12:37:53 devstack sudo[105209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:53 devstack sudo[105209]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7539722a-d26b-4659-86c4-5f6fc03d28e0 1G" returned: 0 in 0.303s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:53 devstack cinder-volume[86574]: DEBUG cinder.volume.volume_utils [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Downloaded image 63f081f1-0ed0-4033-b064-d86eccfaf520 ((None, [{'url': 'file:///opt/stack/data/glance/images/63f081f1-0ed0-4033-b064-d86eccfaf520', 'metadata': {}}])) to volume 7539722a-d26b-4659-86c4-5f6fc03d28e0 successfully. {{(pid=86574) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 01 12:37:53 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Temporary image 63f081f1-0ed0-4033-b064-d86eccfaf520 for user 4bba18d3150a4ea7a72c519658b7a9e7 is deleted. {{(pid=86574) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 01 12:37:53 devstack cinder-volume[86574]: DEBUG cinder.volume.volume_utils [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Marking volume 7539722a-d26b-4659-86c4-5f6fc03d28e0 as bootable. {{(pid=86574) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 01 12:37:53 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Copying metadata from image 63f081f1-0ed0-4033-b064-d86eccfaf520 to 7539722a-d26b-4659-86c4-5f6fc03d28e0. {{(pid=86574) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 01 12:37:53 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Creating volume glance metadata for volume 7539722a-d26b-4659-86c4-5f6fc03d28e0 backed by image 63f081f1-0ed0-4033-b064-d86eccfaf520 with: {'image_id': '63f081f1-0ed0-4033-b064-d86eccfaf520', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '65fce090c3b21fa9dc418bff24439a21', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86574) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 01 12:37:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e47ec81-de6c-4ad7-b0b1-875c3dacdfc9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7539722a-d26b-4659-86c4-5f6fc03d28e0', 'volume_size': 1, 'image_id': '63f081f1-0ed0-4033-b064-d86eccfaf520', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/63f081f1-0ed0-4033-b064-d86eccfaf520', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '65fce090c3b21fa9dc418bff24439a21', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'b7b96ccbc55a45e99628e82e3faa80a0', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'b548c01acd4a5c128f10355333f083ff0851f5537e35f08711a625ce295ec9bcdb9a5e808c74e609ff4dad0d256f47d2ce0afdf0ee976ebacce07ccfd35a66ac', 'id': '63f081f1-0ed0-4033-b064-d86eccfaf520', 'created_at': datetime.datetime(2026, 11, 1, 11, 37, 47, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 37, 48, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/63f081f1-0ed0-4033-b064-d86eccfaf520/file', 'properties': {}}, 'image_service': }' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (def20441-ccbb-451d-bd3a-49df9b697224) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:53 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Volume volume-7539722a-d26b-4659-86c4-5f6fc03d28e0 (7539722a-d26b-4659-86c4-5f6fc03d28e0): created successfully Nov 01 12:37:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (def20441-ccbb-451d-bd3a-49df9b697224) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Flow 'volume_create_manager' (9ca6c4a0-489b-49f8-a4d0-1f03ca433918) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:37:53 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-32da1278-32b6-49a3-a709-b603aae69bf5 tempest-VolumeImageDependencyTests-1630286177 None] Created volume successfully. Nov 01 12:37:54 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ddfbd3da-db01-4b17-9fde-ff8551562693 tempest-VolumeImageDependencyTests-1630286177 None] Acquiring lock "cinder-7539722a-d26b-4659-86c4-5f6fc03d28e0-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:37:54 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ddfbd3da-db01-4b17-9fde-ff8551562693 tempest-VolumeImageDependencyTests-1630286177 None] Lock "cinder-7539722a-d26b-4659-86c4-5f6fc03d28e0-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:37:54 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ddfbd3da-db01-4b17-9fde-ff8551562693 tempest-VolumeImageDependencyTests-1630286177 None] Acquiring lock "cinder-quobyte-7539722a-d26b-4659-86c4-5f6fc03d28e0" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:37:54 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ddfbd3da-db01-4b17-9fde-ff8551562693 tempest-VolumeImageDependencyTests-1630286177 None] Lock "cinder-quobyte-7539722a-d26b-4659-86c4-5f6fc03d28e0" acquired by "delete_volume" :: waited 0.015s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:37:54 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[03502b86-6def-4005-b730-e33a85ab2bbc]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:37:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ddfbd3da-db01-4b17-9fde-ff8551562693 tempest-VolumeImageDependencyTests-1630286177 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7539722a-d26b-4659-86c4-5f6fc03d28e0 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:54 devstack sudo[105214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7539722a-d26b-4659-86c4-5f6fc03d28e0 Nov 01 12:37:54 devstack sudo[105214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:54 devstack sudo[105214]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ddfbd3da-db01-4b17-9fde-ff8551562693 tempest-VolumeImageDependencyTests-1630286177 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7539722a-d26b-4659-86c4-5f6fc03d28e0" returned: 0 in 0.355s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ddfbd3da-db01-4b17-9fde-ff8551562693 tempest-VolumeImageDependencyTests-1630286177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7539722a-d26b-4659-86c4-5f6fc03d28e0 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:54 devstack sudo[105219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7539722a-d26b-4659-86c4-5f6fc03d28e0 Nov 01 12:37:54 devstack sudo[105219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:54 devstack sudo[105219]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ddfbd3da-db01-4b17-9fde-ff8551562693 tempest-VolumeImageDependencyTests-1630286177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7539722a-d26b-4659-86c4-5f6fc03d28e0" returned: 0 in 0.238s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:54 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ddfbd3da-db01-4b17-9fde-ff8551562693 tempest-VolumeImageDependencyTests-1630286177 None] Lock "cinder-quobyte-7539722a-d26b-4659-86c4-5f6fc03d28e0" released by "delete_volume" :: held 0.633s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:37:54 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-ddfbd3da-db01-4b17-9fde-ff8551562693 tempest-VolumeImageDependencyTests-1630286177 None] Created reservations ['c1e2529d-0951-4e76-804c-448ac0a20630', '2674b151-be71-40ee-939c-d2015f7f503d', 'e6d16bcc-3d20-41bb-9267-34cb54fb77a5', '8169956b-2e20-485d-b79e-e95d949f659a'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:37:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ddfbd3da-db01-4b17-9fde-ff8551562693 tempest-VolumeImageDependencyTests-1630286177 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ddfbd3da-db01-4b17-9fde-ff8551562693 tempest-VolumeImageDependencyTests-1630286177 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:54 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ddfbd3da-db01-4b17-9fde-ff8551562693 tempest-VolumeImageDependencyTests-1630286177 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:37:54 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ddfbd3da-db01-4b17-9fde-ff8551562693 tempest-VolumeImageDependencyTests-1630286177 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:37:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ddfbd3da-db01-4b17-9fde-ff8551562693 tempest-VolumeImageDependencyTests-1630286177 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ddfbd3da-db01-4b17-9fde-ff8551562693 tempest-VolumeImageDependencyTests-1630286177 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:54 devstack sudo[105222]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:37:54 devstack sudo[105222]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:55 devstack sudo[105222]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ddfbd3da-db01-4b17-9fde-ff8551562693 tempest-VolumeImageDependencyTests-1630286177 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.240s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:55 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-ddfbd3da-db01-4b17-9fde-ff8551562693 tempest-VolumeImageDependencyTests-1630286177 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:37:55 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-ddfbd3da-db01-4b17-9fde-ff8551562693 tempest-VolumeImageDependencyTests-1630286177 None] Deleted volume successfully. Nov 01 12:37:55 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ddfbd3da-db01-4b17-9fde-ff8551562693 tempest-VolumeImageDependencyTests-1630286177 None] Lock "cinder-7539722a-d26b-4659-86c4-5f6fc03d28e0-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:37:58 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-80420e7c-558f-4e9e-bf1f-26d02e598725 tempest-CinderUnicodeTest-1702044844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:37:58 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-80420e7c-558f-4e9e-bf1f-26d02e598725 tempest-CinderUnicodeTest-1702044844 None] Flow 'volume_create_manager' (79c3579c-989d-4414-b827-4854d952872d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:37:58 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-80420e7c-558f-4e9e-bf1f-26d02e598725 tempest-CinderUnicodeTest-1702044844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0060c432-aeb8-41b4-8da7-22a054817079) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:58 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-80420e7c-558f-4e9e-bf1f-26d02e598725 tempest-CinderUnicodeTest-1702044844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0060c432-aeb8-41b4-8da7-22a054817079) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:37:58Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=255053a0-d88a-4733-89f0-3dc41dc8ff59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b3c84baad2640828180a14c6728b5c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:37:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:37:58Z,use_quota=True,user_id='0eb4d4af45c04917b9f8847b42130b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:58 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-80420e7c-558f-4e9e-bf1f-26d02e598725 tempest-CinderUnicodeTest-1702044844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f4f77f7-415c-4449-9ee4-39fcf337da95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:58 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-80420e7c-558f-4e9e-bf1f-26d02e598725 tempest-CinderUnicodeTest-1702044844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2f4f77f7-415c-4449-9ee4-39fcf337da95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:58 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-80420e7c-558f-4e9e-bf1f-26d02e598725 tempest-CinderUnicodeTest-1702044844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (810f7172-39ed-4571-a95a-57854c4ed82a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:58 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-80420e7c-558f-4e9e-bf1f-26d02e598725 tempest-CinderUnicodeTest-1702044844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (810f7172-39ed-4571-a95a-57854c4ed82a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '255053a0-d88a-4733-89f0-3dc41dc8ff59', 'volume_name': 'volume-255053a0-d88a-4733-89f0-3dc41dc8ff59', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:58 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-80420e7c-558f-4e9e-bf1f-26d02e598725 tempest-CinderUnicodeTest-1702044844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d533c0b-b2e0-4180-9dbf-b7098cbf9882) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:58 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-80420e7c-558f-4e9e-bf1f-26d02e598725 tempest-CinderUnicodeTest-1702044844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4d533c0b-b2e0-4180-9dbf-b7098cbf9882) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:58 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-80420e7c-558f-4e9e-bf1f-26d02e598725 tempest-CinderUnicodeTest-1702044844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90e93e41-293e-491f-b0ec-81876dc5f339) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:58 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-80420e7c-558f-4e9e-bf1f-26d02e598725 tempest-CinderUnicodeTest-1702044844 None] Volume 255053a0-d88a-4733-89f0-3dc41dc8ff59: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-255053a0-d88a-4733-89f0-3dc41dc8ff59', 'volume_size': 1} Nov 01 12:37:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-80420e7c-558f-4e9e-bf1f-26d02e598725 tempest-CinderUnicodeTest-1702044844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-80420e7c-558f-4e9e-bf1f-26d02e598725 tempest-CinderUnicodeTest-1702044844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:58 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-80420e7c-558f-4e9e-bf1f-26d02e598725 tempest-CinderUnicodeTest-1702044844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:37:58Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=255053a0-d88a-4733-89f0-3dc41dc8ff59,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b3c84baad2640828180a14c6728b5c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:37:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:37:58Z,use_quota=True,user_id='0eb4d4af45c04917b9f8847b42130b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:37:58 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-80420e7c-558f-4e9e-bf1f-26d02e598725 tempest-CinderUnicodeTest-1702044844 None] Creating volume 255053a0-d88a-4733-89f0-3dc41dc8ff59 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:37:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-80420e7c-558f-4e9e-bf1f-26d02e598725 tempest-CinderUnicodeTest-1702044844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-80420e7c-558f-4e9e-bf1f-26d02e598725 tempest-CinderUnicodeTest-1702044844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:58 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-80420e7c-558f-4e9e-bf1f-26d02e598725 tempest-CinderUnicodeTest-1702044844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:37:58 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-80420e7c-558f-4e9e-bf1f-26d02e598725 tempest-CinderUnicodeTest-1702044844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:37:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-80420e7c-558f-4e9e-bf1f-26d02e598725 tempest-CinderUnicodeTest-1702044844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:58 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-80420e7c-558f-4e9e-bf1f-26d02e598725 tempest-CinderUnicodeTest-1702044844 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:37:58 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-80420e7c-558f-4e9e-bf1f-26d02e598725 tempest-CinderUnicodeTest-1702044844 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:37:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-80420e7c-558f-4e9e-bf1f-26d02e598725 tempest-CinderUnicodeTest-1702044844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-255053a0-d88a-4733-89f0-3dc41dc8ff59 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:58 devstack sudo[105225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-255053a0-d88a-4733-89f0-3dc41dc8ff59 1073741824 Nov 01 12:37:58 devstack sudo[105225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:58 devstack sudo[105225]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-80420e7c-558f-4e9e-bf1f-26d02e598725 tempest-CinderUnicodeTest-1702044844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-255053a0-d88a-4733-89f0-3dc41dc8ff59 1073741824" returned: 0 in 0.407s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-80420e7c-558f-4e9e-bf1f-26d02e598725 tempest-CinderUnicodeTest-1702044844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-255053a0-d88a-4733-89f0-3dc41dc8ff59 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:58 devstack sudo[105231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-255053a0-d88a-4733-89f0-3dc41dc8ff59 Nov 01 12:37:58 devstack sudo[105231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:37:58 devstack sudo[105231]: pam_unix(sudo:session): session closed for user root Nov 01 12:37:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-80420e7c-558f-4e9e-bf1f-26d02e598725 tempest-CinderUnicodeTest-1702044844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-255053a0-d88a-4733-89f0-3dc41dc8ff59" returned: 0 in 0.251s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:37:58 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-80420e7c-558f-4e9e-bf1f-26d02e598725 tempest-CinderUnicodeTest-1702044844 None] <== create_volume: return (698ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:37:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-80420e7c-558f-4e9e-bf1f-26d02e598725 tempest-CinderUnicodeTest-1702044844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:58 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-80420e7c-558f-4e9e-bf1f-26d02e598725 tempest-CinderUnicodeTest-1702044844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (90e93e41-293e-491f-b0ec-81876dc5f339) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-255053a0-d88a-4733-89f0-3dc41dc8ff59', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:58 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-80420e7c-558f-4e9e-bf1f-26d02e598725 tempest-CinderUnicodeTest-1702044844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74fc4806-d02f-4f3d-a02f-ad31b5f7278c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:58 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-80420e7c-558f-4e9e-bf1f-26d02e598725 tempest-CinderUnicodeTest-1702044844 None] Volume volume-255053a0-d88a-4733-89f0-3dc41dc8ff59 (255053a0-d88a-4733-89f0-3dc41dc8ff59): created successfully Nov 01 12:37:58 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-80420e7c-558f-4e9e-bf1f-26d02e598725 tempest-CinderUnicodeTest-1702044844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (74fc4806-d02f-4f3d-a02f-ad31b5f7278c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:58 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-80420e7c-558f-4e9e-bf1f-26d02e598725 tempest-CinderUnicodeTest-1702044844 None] Flow 'volume_create_manager' (79c3579c-989d-4414-b827-4854d952872d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:37:58 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-80420e7c-558f-4e9e-bf1f-26d02e598725 tempest-CinderUnicodeTest-1702044844 None] Created volume successfully. Nov 01 12:37:59 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-6a27b58a-c1f6-4fb0-9859-2b0c514d83e3 tempest-CinderUnicodeTest-1702044844 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:37:59 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6a27b58a-c1f6-4fb0-9859-2b0c514d83e3 tempest-CinderUnicodeTest-1702044844 None] Flow 'volume_create_manager' (0ed525b9-b05a-4afa-87eb-0484ebe65463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:37:59 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6a27b58a-c1f6-4fb0-9859-2b0c514d83e3 tempest-CinderUnicodeTest-1702044844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5f53da6-b178-46df-84d7-56e32dffce66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:59 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6a27b58a-c1f6-4fb0-9859-2b0c514d83e3 tempest-CinderUnicodeTest-1702044844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a5f53da6-b178-46df-84d7-56e32dffce66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:37:59Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1549453323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a68f291-140d-45bf-9aa7-2c60336a2047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b3c84baad2640828180a14c6728b5c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:00Z,use_quota=True,user_id='0eb4d4af45c04917b9f8847b42130b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:59 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6a27b58a-c1f6-4fb0-9859-2b0c514d83e3 tempest-CinderUnicodeTest-1702044844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c43d73ed-c7a1-491b-95de-11b9ceab28ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:59 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6a27b58a-c1f6-4fb0-9859-2b0c514d83e3 tempest-CinderUnicodeTest-1702044844 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c43d73ed-c7a1-491b-95de-11b9ceab28ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:59 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6a27b58a-c1f6-4fb0-9859-2b0c514d83e3 tempest-CinderUnicodeTest-1702044844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c855413b-a37e-4278-825d-e6ed2ea4a4be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:59 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6a27b58a-c1f6-4fb0-9859-2b0c514d83e3 tempest-CinderUnicodeTest-1702044844 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c855413b-a37e-4278-825d-e6ed2ea4a4be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9a68f291-140d-45bf-9aa7-2c60336a2047', 'volume_name': 'volume-9a68f291-140d-45bf-9aa7-2c60336a2047', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:59 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6a27b58a-c1f6-4fb0-9859-2b0c514d83e3 tempest-CinderUnicodeTest-1702044844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ced001c-bf09-404f-a1fd-fd137eb43ec7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:59 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6a27b58a-c1f6-4fb0-9859-2b0c514d83e3 tempest-CinderUnicodeTest-1702044844 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ced001c-bf09-404f-a1fd-fd137eb43ec7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:37:59 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6a27b58a-c1f6-4fb0-9859-2b0c514d83e3 tempest-CinderUnicodeTest-1702044844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc476e2b-2166-43b0-ade9-70009fa334ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:37:59 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-6a27b58a-c1f6-4fb0-9859-2b0c514d83e3 tempest-CinderUnicodeTest-1702044844 None] Volume 9a68f291-140d-45bf-9aa7-2c60336a2047: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9a68f291-140d-45bf-9aa7-2c60336a2047', 'volume_size': 1} Nov 01 12:37:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-6a27b58a-c1f6-4fb0-9859-2b0c514d83e3 tempest-CinderUnicodeTest-1702044844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-6a27b58a-c1f6-4fb0-9859-2b0c514d83e3 tempest-CinderUnicodeTest-1702044844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:59 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-6a27b58a-c1f6-4fb0-9859-2b0c514d83e3 tempest-CinderUnicodeTest-1702044844 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:37:59Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1549453323',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9a68f291-140d-45bf-9aa7-2c60336a2047,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7b3c84baad2640828180a14c6728b5c8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:00Z,use_quota=True,user_id='0eb4d4af45c04917b9f8847b42130b1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:37:59 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-6a27b58a-c1f6-4fb0-9859-2b0c514d83e3 tempest-CinderUnicodeTest-1702044844 None] Creating volume 9a68f291-140d-45bf-9aa7-2c60336a2047 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:37:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-6a27b58a-c1f6-4fb0-9859-2b0c514d83e3 tempest-CinderUnicodeTest-1702044844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:37:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-6a27b58a-c1f6-4fb0-9859-2b0c514d83e3 tempest-CinderUnicodeTest-1702044844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:37:59 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-6a27b58a-c1f6-4fb0-9859-2b0c514d83e3 tempest-CinderUnicodeTest-1702044844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:37:59 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-6a27b58a-c1f6-4fb0-9859-2b0c514d83e3 tempest-CinderUnicodeTest-1702044844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:37:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-6a27b58a-c1f6-4fb0-9859-2b0c514d83e3 tempest-CinderUnicodeTest-1702044844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:37:59 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-6a27b58a-c1f6-4fb0-9859-2b0c514d83e3 tempest-CinderUnicodeTest-1702044844 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:37:59 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-6a27b58a-c1f6-4fb0-9859-2b0c514d83e3 tempest-CinderUnicodeTest-1702044844 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:37:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6a27b58a-c1f6-4fb0-9859-2b0c514d83e3 tempest-CinderUnicodeTest-1702044844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9a68f291-140d-45bf-9aa7-2c60336a2047 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:37:59 devstack sudo[105234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9a68f291-140d-45bf-9aa7-2c60336a2047 1073741824 Nov 01 12:37:59 devstack sudo[105234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:00 devstack sudo[105234]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6a27b58a-c1f6-4fb0-9859-2b0c514d83e3 tempest-CinderUnicodeTest-1702044844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9a68f291-140d-45bf-9aa7-2c60336a2047 1073741824" returned: 0 in 0.410s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6a27b58a-c1f6-4fb0-9859-2b0c514d83e3 tempest-CinderUnicodeTest-1702044844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9a68f291-140d-45bf-9aa7-2c60336a2047 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:00 devstack sudo[105239]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9a68f291-140d-45bf-9aa7-2c60336a2047 Nov 01 12:38:00 devstack sudo[105239]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:00 devstack sudo[105239]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6a27b58a-c1f6-4fb0-9859-2b0c514d83e3 tempest-CinderUnicodeTest-1702044844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9a68f291-140d-45bf-9aa7-2c60336a2047" returned: 0 in 0.240s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:00 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-6a27b58a-c1f6-4fb0-9859-2b0c514d83e3 tempest-CinderUnicodeTest-1702044844 None] <== create_volume: return (688ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:38:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-6a27b58a-c1f6-4fb0-9859-2b0c514d83e3 tempest-CinderUnicodeTest-1702044844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.691s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:00 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6a27b58a-c1f6-4fb0-9859-2b0c514d83e3 tempest-CinderUnicodeTest-1702044844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dc476e2b-2166-43b0-ade9-70009fa334ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9a68f291-140d-45bf-9aa7-2c60336a2047', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:00 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6a27b58a-c1f6-4fb0-9859-2b0c514d83e3 tempest-CinderUnicodeTest-1702044844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52e6e1b0-4bd9-45e2-b7e7-bc7bc4f2938d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:00 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-6a27b58a-c1f6-4fb0-9859-2b0c514d83e3 tempest-CinderUnicodeTest-1702044844 None] Volume volume-9a68f291-140d-45bf-9aa7-2c60336a2047 (9a68f291-140d-45bf-9aa7-2c60336a2047): created successfully Nov 01 12:38:00 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6a27b58a-c1f6-4fb0-9859-2b0c514d83e3 tempest-CinderUnicodeTest-1702044844 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52e6e1b0-4bd9-45e2-b7e7-bc7bc4f2938d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:00 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6a27b58a-c1f6-4fb0-9859-2b0c514d83e3 tempest-CinderUnicodeTest-1702044844 None] Flow 'volume_create_manager' (0ed525b9-b05a-4afa-87eb-0484ebe65463) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:00 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-6a27b58a-c1f6-4fb0-9859-2b0c514d83e3 tempest-CinderUnicodeTest-1702044844 None] Created volume successfully. Nov 01 12:38:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f4818a20-7440-46a9-bcbe-e7d95db95699 tempest-CinderUnicodeTest-1702044844 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f4818a20-7440-46a9-bcbe-e7d95db95699 tempest-CinderUnicodeTest-1702044844 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:00 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-f4818a20-7440-46a9-bcbe-e7d95db95699 tempest-CinderUnicodeTest-1702044844 None] Creating offline snapshot aab294e6-87f9-4148-9252-d8be9abcf3d3 of volume 9a68f291-140d-45bf-9aa7-2c60336a2047 {{(pid=86574) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:38:00 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[5bc5c738-62de-4ce5-bb76-38be7500be26]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f4818a20-7440-46a9-bcbe-e7d95db95699 tempest-CinderUnicodeTest-1702044844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9a68f291-140d-45bf-9aa7-2c60336a2047 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:00 devstack sudo[105242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9a68f291-140d-45bf-9aa7-2c60336a2047 Nov 01 12:38:00 devstack sudo[105242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:01 devstack sudo[105242]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f4818a20-7440-46a9-bcbe-e7d95db95699 tempest-CinderUnicodeTest-1702044844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9a68f291-140d-45bf-9aa7-2c60336a2047" returned: 0 in 0.350s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f4818a20-7440-46a9-bcbe-e7d95db95699 tempest-CinderUnicodeTest-1702044844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9a68f291-140d-45bf-9aa7-2c60336a2047,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9a68f291-140d-45bf-9aa7-2c60336a2047.aab294e6-87f9-4148-9252-d8be9abcf3d3 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:01 devstack sudo[105247]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9a68f291-140d-45bf-9aa7-2c60336a2047,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9a68f291-140d-45bf-9aa7-2c60336a2047.aab294e6-87f9-4148-9252-d8be9abcf3d3 1G Nov 01 12:38:01 devstack sudo[105247]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:01 devstack sudo[105247]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f4818a20-7440-46a9-bcbe-e7d95db95699 tempest-CinderUnicodeTest-1702044844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9a68f291-140d-45bf-9aa7-2c60336a2047,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9a68f291-140d-45bf-9aa7-2c60336a2047.aab294e6-87f9-4148-9252-d8be9abcf3d3 1G" returned: 0 in 0.382s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f4818a20-7440-46a9-bcbe-e7d95db95699 tempest-CinderUnicodeTest-1702044844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a68f291-140d-45bf-9aa7-2c60336a2047 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9a68f291-140d-45bf-9aa7-2c60336a2047.aab294e6-87f9-4148-9252-d8be9abcf3d3 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:01 devstack sudo[105252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a68f291-140d-45bf-9aa7-2c60336a2047 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9a68f291-140d-45bf-9aa7-2c60336a2047.aab294e6-87f9-4148-9252-d8be9abcf3d3 Nov 01 12:38:01 devstack sudo[105252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:01 devstack sudo[105252]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f4818a20-7440-46a9-bcbe-e7d95db95699 tempest-CinderUnicodeTest-1702044844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9a68f291-140d-45bf-9aa7-2c60336a2047 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9a68f291-140d-45bf-9aa7-2c60336a2047.aab294e6-87f9-4148-9252-d8be9abcf3d3" returned: 0 in 0.282s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:01 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-f4818a20-7440-46a9-bcbe-e7d95db95699 tempest-CinderUnicodeTest-1702044844 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9a68f291-140d-45bf-9aa7-2c60336a2047.aab294e6-87f9-4148-9252-d8be9abcf3d3 is being set with open permissions: ugo+rw Nov 01 12:38:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f4818a20-7440-46a9-bcbe-e7d95db95699 tempest-CinderUnicodeTest-1702044844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9a68f291-140d-45bf-9aa7-2c60336a2047.aab294e6-87f9-4148-9252-d8be9abcf3d3 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:01 devstack sudo[105257]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9a68f291-140d-45bf-9aa7-2c60336a2047.aab294e6-87f9-4148-9252-d8be9abcf3d3 Nov 01 12:38:01 devstack sudo[105257]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:02 devstack sudo[105257]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f4818a20-7440-46a9-bcbe-e7d95db95699 tempest-CinderUnicodeTest-1702044844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9a68f291-140d-45bf-9aa7-2c60336a2047.aab294e6-87f9-4148-9252-d8be9abcf3d3" returned: 0 in 0.237s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f4818a20-7440-46a9-bcbe-e7d95db95699 tempest-CinderUnicodeTest-1702044844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9a68f291-140d-45bf-9aa7-2c60336a2047.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:02 devstack sudo[105260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9a68f291-140d-45bf-9aa7-2c60336a2047.info Nov 01 12:38:02 devstack sudo[105260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:02 devstack sudo[105260]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f4818a20-7440-46a9-bcbe-e7d95db95699 tempest-CinderUnicodeTest-1702044844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9a68f291-140d-45bf-9aa7-2c60336a2047.info" returned: 0 in 0.246s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:02 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-f4818a20-7440-46a9-bcbe-e7d95db95699 tempest-CinderUnicodeTest-1702044844 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9a68f291-140d-45bf-9aa7-2c60336a2047.info is being set with open permissions: ugo+rw Nov 01 12:38:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f4818a20-7440-46a9-bcbe-e7d95db95699 tempest-CinderUnicodeTest-1702044844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9a68f291-140d-45bf-9aa7-2c60336a2047.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:02 devstack sudo[105263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9a68f291-140d-45bf-9aa7-2c60336a2047.info Nov 01 12:38:02 devstack sudo[105263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:02 devstack sudo[105263]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f4818a20-7440-46a9-bcbe-e7d95db95699 tempest-CinderUnicodeTest-1702044844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9a68f291-140d-45bf-9aa7-2c60336a2047.info" returned: 0 in 0.244s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f4818a20-7440-46a9-bcbe-e7d95db95699 tempest-CinderUnicodeTest-1702044844 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.823s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:02 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-f4818a20-7440-46a9-bcbe-e7d95db95699 tempest-CinderUnicodeTest-1702044844 None] Create snapshot completed successfully Nov 01 12:38:02 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-c53a3c79-e6b7-47a4-9663-ab8aefcbc722 tempest-CinderUnicodeTest-1702044844 None] Acquiring lock "cinder-aab294e6-87f9-4148-9252-d8be9abcf3d3-delete_snapshot" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:02 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-c53a3c79-e6b7-47a4-9663-ab8aefcbc722 tempest-CinderUnicodeTest-1702044844 None] Lock "cinder-aab294e6-87f9-4148-9252-d8be9abcf3d3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.018s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:02 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-c53a3c79-e6b7-47a4-9663-ab8aefcbc722 tempest-CinderUnicodeTest-1702044844 None] Acquiring lock "cinder-quobyte-9a68f291-140d-45bf-9aa7-2c60336a2047" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:02 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-c53a3c79-e6b7-47a4-9663-ab8aefcbc722 tempest-CinderUnicodeTest-1702044844 None] Lock "cinder-quobyte-9a68f291-140d-45bf-9aa7-2c60336a2047" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:02 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-c53a3c79-e6b7-47a4-9663-ab8aefcbc722 tempest-CinderUnicodeTest-1702044844 None] Acquiring lock "cinder-quobyte-aab294e6-87f9-4148-9252-d8be9abcf3d3" by "_delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:02 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-c53a3c79-e6b7-47a4-9663-ab8aefcbc722 tempest-CinderUnicodeTest-1702044844 None] Lock "cinder-quobyte-aab294e6-87f9-4148-9252-d8be9abcf3d3" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-c53a3c79-e6b7-47a4-9663-ab8aefcbc722 tempest-CinderUnicodeTest-1702044844 None] Deleting offline snapshot aab294e6-87f9-4148-9252-d8be9abcf3d3 of volume 9a68f291-140d-45bf-9aa7-2c60336a2047 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:38:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-c53a3c79-e6b7-47a4-9663-ab8aefcbc722 tempest-CinderUnicodeTest-1702044844 None] snapshot_file for this snap is: volume-9a68f291-140d-45bf-9aa7-2c60336a2047.aab294e6-87f9-4148-9252-d8be9abcf3d3 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:38:03 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[30b8f102-a2f9-432e-8e77-7ed9c2fae378]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c53a3c79-e6b7-47a4-9663-ab8aefcbc722 tempest-CinderUnicodeTest-1702044844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9a68f291-140d-45bf-9aa7-2c60336a2047.aab294e6-87f9-4148-9252-d8be9abcf3d3 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:03 devstack sudo[105266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9a68f291-140d-45bf-9aa7-2c60336a2047.aab294e6-87f9-4148-9252-d8be9abcf3d3 Nov 01 12:38:03 devstack sudo[105266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:03 devstack sudo[105266]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c53a3c79-e6b7-47a4-9663-ab8aefcbc722 tempest-CinderUnicodeTest-1702044844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9a68f291-140d-45bf-9aa7-2c60336a2047.aab294e6-87f9-4148-9252-d8be9abcf3d3" returned: 0 in 0.358s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-c53a3c79-e6b7-47a4-9663-ab8aefcbc722 tempest-CinderUnicodeTest-1702044844 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9a68f291-140d-45bf-9aa7-2c60336a2047(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:38:03 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[df945483-86a5-4bfa-a838-d7eb5b9a5a92]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c53a3c79-e6b7-47a4-9663-ab8aefcbc722 tempest-CinderUnicodeTest-1702044844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9a68f291-140d-45bf-9aa7-2c60336a2047 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:03 devstack sudo[105271]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9a68f291-140d-45bf-9aa7-2c60336a2047 Nov 01 12:38:03 devstack sudo[105271]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:03 devstack sudo[105271]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c53a3c79-e6b7-47a4-9663-ab8aefcbc722 tempest-CinderUnicodeTest-1702044844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9a68f291-140d-45bf-9aa7-2c60336a2047" returned: 0 in 0.344s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c53a3c79-e6b7-47a4-9663-ab8aefcbc722 tempest-CinderUnicodeTest-1702044844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9a68f291-140d-45bf-9aa7-2c60336a2047.aab294e6-87f9-4148-9252-d8be9abcf3d3 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:03 devstack sudo[105276]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9a68f291-140d-45bf-9aa7-2c60336a2047.aab294e6-87f9-4148-9252-d8be9abcf3d3 Nov 01 12:38:03 devstack sudo[105276]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:04 devstack sudo[105276]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c53a3c79-e6b7-47a4-9663-ab8aefcbc722 tempest-CinderUnicodeTest-1702044844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9a68f291-140d-45bf-9aa7-2c60336a2047.aab294e6-87f9-4148-9252-d8be9abcf3d3" returned: 0 in 0.330s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c53a3c79-e6b7-47a4-9663-ab8aefcbc722 tempest-CinderUnicodeTest-1702044844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9a68f291-140d-45bf-9aa7-2c60336a2047.aab294e6-87f9-4148-9252-d8be9abcf3d3 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:04 devstack sudo[105282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9a68f291-140d-45bf-9aa7-2c60336a2047.aab294e6-87f9-4148-9252-d8be9abcf3d3 Nov 01 12:38:04 devstack sudo[105282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:04 devstack sudo[105282]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c53a3c79-e6b7-47a4-9663-ab8aefcbc722 tempest-CinderUnicodeTest-1702044844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9a68f291-140d-45bf-9aa7-2c60336a2047.aab294e6-87f9-4148-9252-d8be9abcf3d3" returned: 0 in 0.241s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:04 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-c53a3c79-e6b7-47a4-9663-ab8aefcbc722 tempest-CinderUnicodeTest-1702044844 None] Lock "cinder-quobyte-aab294e6-87f9-4148-9252-d8be9abcf3d3" released by "_delete_snapshot" :: held 1.382s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:04 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-c53a3c79-e6b7-47a4-9663-ab8aefcbc722 tempest-CinderUnicodeTest-1702044844 None] Lock "cinder-quobyte-9a68f291-140d-45bf-9aa7-2c60336a2047" released by "delete_snapshot" :: held 1.404s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:04 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-c53a3c79-e6b7-47a4-9663-ab8aefcbc722 tempest-CinderUnicodeTest-1702044844 None] Created reservations ['94c00860-b917-4ab8-9a3e-0816019fa015', 'ab25046c-2409-442b-b253-17428c6f73c2', '2bb49324-70f2-4244-be22-ae68b4858b7b', '151e1764-6c98-4b35-a317-845869bbd36f'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:38:04 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-c53a3c79-e6b7-47a4-9663-ab8aefcbc722 tempest-CinderUnicodeTest-1702044844 None] Delete snapshot completed successfully. Nov 01 12:38:04 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-c53a3c79-e6b7-47a4-9663-ab8aefcbc722 tempest-CinderUnicodeTest-1702044844 None] Lock "cinder-aab294e6-87f9-4148-9252-d8be9abcf3d3-delete_snapshot" released by "delete_snapshot" :: held 1.533s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:05 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-41fecce5-7aff-491d-b561-54550574895f tempest-CinderUnicodeTest-1702044844 None] Acquiring lock "cinder-9a68f291-140d-45bf-9aa7-2c60336a2047-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:05 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-41fecce5-7aff-491d-b561-54550574895f tempest-CinderUnicodeTest-1702044844 None] Lock "cinder-9a68f291-140d-45bf-9aa7-2c60336a2047-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:05 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-41fecce5-7aff-491d-b561-54550574895f tempest-CinderUnicodeTest-1702044844 None] Acquiring lock "cinder-quobyte-9a68f291-140d-45bf-9aa7-2c60336a2047" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:05 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-41fecce5-7aff-491d-b561-54550574895f tempest-CinderUnicodeTest-1702044844 None] Lock "cinder-quobyte-9a68f291-140d-45bf-9aa7-2c60336a2047" acquired by "delete_volume" :: waited 0.016s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:05 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[2de58287-a275-4508-874e-ed8b3028cf16]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-41fecce5-7aff-491d-b561-54550574895f tempest-CinderUnicodeTest-1702044844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9a68f291-140d-45bf-9aa7-2c60336a2047 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:05 devstack sudo[105285]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9a68f291-140d-45bf-9aa7-2c60336a2047 Nov 01 12:38:05 devstack sudo[105285]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:05 devstack sudo[105285]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-41fecce5-7aff-491d-b561-54550574895f tempest-CinderUnicodeTest-1702044844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9a68f291-140d-45bf-9aa7-2c60336a2047" returned: 0 in 0.351s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-41fecce5-7aff-491d-b561-54550574895f tempest-CinderUnicodeTest-1702044844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9a68f291-140d-45bf-9aa7-2c60336a2047 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:05 devstack sudo[105290]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9a68f291-140d-45bf-9aa7-2c60336a2047 Nov 01 12:38:05 devstack sudo[105290]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:05 devstack sudo[105290]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-41fecce5-7aff-491d-b561-54550574895f tempest-CinderUnicodeTest-1702044844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9a68f291-140d-45bf-9aa7-2c60336a2047" returned: 0 in 0.244s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:05 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-41fecce5-7aff-491d-b561-54550574895f tempest-CinderUnicodeTest-1702044844 None] Lock "cinder-quobyte-9a68f291-140d-45bf-9aa7-2c60336a2047" released by "delete_volume" :: held 0.656s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:05 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-41fecce5-7aff-491d-b561-54550574895f tempest-CinderUnicodeTest-1702044844 None] Created reservations ['2ca8608a-2995-4fd4-b899-3514e11d5fb6', '644e0292-d3b4-4bd1-97dc-7fb90a649d4e', '527524c6-ef29-4863-9522-19267ec0d6af', '2e7cc645-261a-45a6-92e2-250af452d509'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:38:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-41fecce5-7aff-491d-b561-54550574895f tempest-CinderUnicodeTest-1702044844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-41fecce5-7aff-491d-b561-54550574895f tempest-CinderUnicodeTest-1702044844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:05 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-41fecce5-7aff-491d-b561-54550574895f tempest-CinderUnicodeTest-1702044844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:05 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-41fecce5-7aff-491d-b561-54550574895f tempest-CinderUnicodeTest-1702044844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-41fecce5-7aff-491d-b561-54550574895f tempest-CinderUnicodeTest-1702044844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-41fecce5-7aff-491d-b561-54550574895f tempest-CinderUnicodeTest-1702044844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:05 devstack sudo[105293]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:38:05 devstack sudo[105293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:06 devstack sudo[105293]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-41fecce5-7aff-491d-b561-54550574895f tempest-CinderUnicodeTest-1702044844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.241s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:06 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-41fecce5-7aff-491d-b561-54550574895f tempest-CinderUnicodeTest-1702044844 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:38:06 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-41fecce5-7aff-491d-b561-54550574895f tempest-CinderUnicodeTest-1702044844 None] Deleted volume successfully. Nov 01 12:38:06 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-41fecce5-7aff-491d-b561-54550574895f tempest-CinderUnicodeTest-1702044844 None] Lock "cinder-9a68f291-140d-45bf-9aa7-2c60336a2047-delete_volume" released by "delete_volume" :: held 1.077s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:06 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d81690e3-2729-4acc-a00e-24f559cd64c5 tempest-CinderUnicodeTest-1702044844 None] Acquiring lock "cinder-255053a0-d88a-4733-89f0-3dc41dc8ff59-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:06 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d81690e3-2729-4acc-a00e-24f559cd64c5 tempest-CinderUnicodeTest-1702044844 None] Lock "cinder-255053a0-d88a-4733-89f0-3dc41dc8ff59-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:06 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d81690e3-2729-4acc-a00e-24f559cd64c5 tempest-CinderUnicodeTest-1702044844 None] Acquiring lock "cinder-quobyte-255053a0-d88a-4733-89f0-3dc41dc8ff59" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:06 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d81690e3-2729-4acc-a00e-24f559cd64c5 tempest-CinderUnicodeTest-1702044844 None] Lock "cinder-quobyte-255053a0-d88a-4733-89f0-3dc41dc8ff59" acquired by "delete_volume" :: waited 0.016s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:06 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[85ec22c6-8964-41b8-94a6-e089ed11595d]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d81690e3-2729-4acc-a00e-24f559cd64c5 tempest-CinderUnicodeTest-1702044844 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-255053a0-d88a-4733-89f0-3dc41dc8ff59 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:06 devstack sudo[105296]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-255053a0-d88a-4733-89f0-3dc41dc8ff59 Nov 01 12:38:06 devstack sudo[105296]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:06 devstack sudo[105296]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d81690e3-2729-4acc-a00e-24f559cd64c5 tempest-CinderUnicodeTest-1702044844 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-255053a0-d88a-4733-89f0-3dc41dc8ff59" returned: 0 in 0.348s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d81690e3-2729-4acc-a00e-24f559cd64c5 tempest-CinderUnicodeTest-1702044844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-255053a0-d88a-4733-89f0-3dc41dc8ff59 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:06 devstack sudo[105303]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-255053a0-d88a-4733-89f0-3dc41dc8ff59 Nov 01 12:38:06 devstack sudo[105303]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:06 devstack sudo[105303]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d81690e3-2729-4acc-a00e-24f559cd64c5 tempest-CinderUnicodeTest-1702044844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-255053a0-d88a-4733-89f0-3dc41dc8ff59" returned: 0 in 0.249s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:06 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d81690e3-2729-4acc-a00e-24f559cd64c5 tempest-CinderUnicodeTest-1702044844 None] Lock "cinder-quobyte-255053a0-d88a-4733-89f0-3dc41dc8ff59" released by "delete_volume" :: held 0.642s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:07 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-d81690e3-2729-4acc-a00e-24f559cd64c5 tempest-CinderUnicodeTest-1702044844 None] Created reservations ['5f54ea34-2c21-4afc-a450-32803c17c208', '7b8c63fe-ee18-4755-8ecb-73146fb91713', '277defc1-72a2-4575-a7eb-d14e82d39348', 'ecb2b99a-ff57-4554-8cfc-8efc6b3e7263'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:38:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d81690e3-2729-4acc-a00e-24f559cd64c5 tempest-CinderUnicodeTest-1702044844 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d81690e3-2729-4acc-a00e-24f559cd64c5 tempest-CinderUnicodeTest-1702044844 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:07 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d81690e3-2729-4acc-a00e-24f559cd64c5 tempest-CinderUnicodeTest-1702044844 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:07 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d81690e3-2729-4acc-a00e-24f559cd64c5 tempest-CinderUnicodeTest-1702044844 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d81690e3-2729-4acc-a00e-24f559cd64c5 tempest-CinderUnicodeTest-1702044844 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d81690e3-2729-4acc-a00e-24f559cd64c5 tempest-CinderUnicodeTest-1702044844 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:07 devstack sudo[105306]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:38:07 devstack sudo[105306]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:07 devstack sudo[105306]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d81690e3-2729-4acc-a00e-24f559cd64c5 tempest-CinderUnicodeTest-1702044844 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.244s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:07 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-d81690e3-2729-4acc-a00e-24f559cd64c5 tempest-CinderUnicodeTest-1702044844 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:38:07 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-d81690e3-2729-4acc-a00e-24f559cd64c5 tempest-CinderUnicodeTest-1702044844 None] Deleted volume successfully. Nov 01 12:38:07 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d81690e3-2729-4acc-a00e-24f559cd64c5 tempest-CinderUnicodeTest-1702044844 None] Lock "cinder-255053a0-d88a-4733-89f0-3dc41dc8ff59-delete_volume" released by "delete_volume" :: held 1.089s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:10 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-626770b7-14da-4d62-93dc-4c03b55787ba tempest-ProjectReaderTests-912709323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:38:10 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-626770b7-14da-4d62-93dc-4c03b55787ba tempest-ProjectReaderTests-912709323 None] Flow 'volume_create_manager' (06e2db9c-e155-4ea3-bc38-6368c53f91a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:10 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-626770b7-14da-4d62-93dc-4c03b55787ba tempest-ProjectReaderTests-912709323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d49a9a57-3d73-4009-866c-1ba8f55eb7a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:10 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-626770b7-14da-4d62-93dc-4c03b55787ba tempest-ProjectReaderTests-912709323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d49a9a57-3d73-4009-866c-1ba8f55eb7a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-96592092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b9121f5-f221-4cc3-9ed8-3279639b99de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1fe1b263cfe4368b2ad50c2d87b653b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:11Z,use_quota=True,user_id='0333030bc0a440e6aaec76b5d5e8e565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:10 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-626770b7-14da-4d62-93dc-4c03b55787ba tempest-ProjectReaderTests-912709323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0695b31f-0bef-4ca3-9b79-c4df853f879d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:10 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-626770b7-14da-4d62-93dc-4c03b55787ba tempest-ProjectReaderTests-912709323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0695b31f-0bef-4ca3-9b79-c4df853f879d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:10 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-626770b7-14da-4d62-93dc-4c03b55787ba tempest-ProjectReaderTests-912709323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d632949-b870-41ec-bb31-6e254061198a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:10 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-626770b7-14da-4d62-93dc-4c03b55787ba tempest-ProjectReaderTests-912709323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8d632949-b870-41ec-bb31-6e254061198a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5b9121f5-f221-4cc3-9ed8-3279639b99de', 'volume_name': 'volume-5b9121f5-f221-4cc3-9ed8-3279639b99de', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:10 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-626770b7-14da-4d62-93dc-4c03b55787ba tempest-ProjectReaderTests-912709323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e85af2fc-b72a-4f4f-b410-e974d6c701d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:10 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-626770b7-14da-4d62-93dc-4c03b55787ba tempest-ProjectReaderTests-912709323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e85af2fc-b72a-4f4f-b410-e974d6c701d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:10 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-626770b7-14da-4d62-93dc-4c03b55787ba tempest-ProjectReaderTests-912709323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5daa56dd-74e1-4387-85f0-a7f6c67c37fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:10 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-626770b7-14da-4d62-93dc-4c03b55787ba tempest-ProjectReaderTests-912709323 None] Volume 5b9121f5-f221-4cc3-9ed8-3279639b99de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5b9121f5-f221-4cc3-9ed8-3279639b99de', 'volume_size': 1} Nov 01 12:38:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-626770b7-14da-4d62-93dc-4c03b55787ba tempest-ProjectReaderTests-912709323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-626770b7-14da-4d62-93dc-4c03b55787ba tempest-ProjectReaderTests-912709323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:10 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-626770b7-14da-4d62-93dc-4c03b55787ba tempest-ProjectReaderTests-912709323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-96592092',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5b9121f5-f221-4cc3-9ed8-3279639b99de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1fe1b263cfe4368b2ad50c2d87b653b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:11Z,use_quota=True,user_id='0333030bc0a440e6aaec76b5d5e8e565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:38:10 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-626770b7-14da-4d62-93dc-4c03b55787ba tempest-ProjectReaderTests-912709323 None] Creating volume 5b9121f5-f221-4cc3-9ed8-3279639b99de {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:38:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-626770b7-14da-4d62-93dc-4c03b55787ba tempest-ProjectReaderTests-912709323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-626770b7-14da-4d62-93dc-4c03b55787ba tempest-ProjectReaderTests-912709323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:10 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-626770b7-14da-4d62-93dc-4c03b55787ba tempest-ProjectReaderTests-912709323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:10 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-626770b7-14da-4d62-93dc-4c03b55787ba tempest-ProjectReaderTests-912709323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-626770b7-14da-4d62-93dc-4c03b55787ba tempest-ProjectReaderTests-912709323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:10 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-626770b7-14da-4d62-93dc-4c03b55787ba tempest-ProjectReaderTests-912709323 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:38:10 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-626770b7-14da-4d62-93dc-4c03b55787ba tempest-ProjectReaderTests-912709323 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:38:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-626770b7-14da-4d62-93dc-4c03b55787ba tempest-ProjectReaderTests-912709323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5b9121f5-f221-4cc3-9ed8-3279639b99de 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:10 devstack sudo[105311]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5b9121f5-f221-4cc3-9ed8-3279639b99de 1073741824 Nov 01 12:38:10 devstack sudo[105311]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:11 devstack sudo[105311]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-626770b7-14da-4d62-93dc-4c03b55787ba tempest-ProjectReaderTests-912709323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5b9121f5-f221-4cc3-9ed8-3279639b99de 1073741824" returned: 0 in 0.397s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-626770b7-14da-4d62-93dc-4c03b55787ba tempest-ProjectReaderTests-912709323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5b9121f5-f221-4cc3-9ed8-3279639b99de {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:11 devstack sudo[105317]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5b9121f5-f221-4cc3-9ed8-3279639b99de Nov 01 12:38:11 devstack sudo[105317]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:11 devstack sudo[105317]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-626770b7-14da-4d62-93dc-4c03b55787ba tempest-ProjectReaderTests-912709323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5b9121f5-f221-4cc3-9ed8-3279639b99de" returned: 0 in 0.239s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:11 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-626770b7-14da-4d62-93dc-4c03b55787ba tempest-ProjectReaderTests-912709323 None] <== create_volume: return (675ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:38:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-626770b7-14da-4d62-93dc-4c03b55787ba tempest-ProjectReaderTests-912709323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.678s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:11 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-626770b7-14da-4d62-93dc-4c03b55787ba tempest-ProjectReaderTests-912709323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5daa56dd-74e1-4387-85f0-a7f6c67c37fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5b9121f5-f221-4cc3-9ed8-3279639b99de', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:11 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-626770b7-14da-4d62-93dc-4c03b55787ba tempest-ProjectReaderTests-912709323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3df65cd7-c31c-4fc2-8cca-fd395d4453cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:11 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-626770b7-14da-4d62-93dc-4c03b55787ba tempest-ProjectReaderTests-912709323 None] Volume volume-5b9121f5-f221-4cc3-9ed8-3279639b99de (5b9121f5-f221-4cc3-9ed8-3279639b99de): created successfully Nov 01 12:38:11 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-626770b7-14da-4d62-93dc-4c03b55787ba tempest-ProjectReaderTests-912709323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3df65cd7-c31c-4fc2-8cca-fd395d4453cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:11 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-626770b7-14da-4d62-93dc-4c03b55787ba tempest-ProjectReaderTests-912709323 None] Flow 'volume_create_manager' (06e2db9c-e155-4ea3-bc38-6368c53f91a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:11 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-626770b7-14da-4d62-93dc-4c03b55787ba tempest-ProjectReaderTests-912709323 None] Created volume successfully. Nov 01 12:38:11 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-9ce2199c-1873-49e6-9b40-75c1ff73ea99 tempest-ProjectReaderTests-912709323 None] Acquiring lock "cinder-5b9121f5-f221-4cc3-9ed8-3279639b99de-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:11 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-9ce2199c-1873-49e6-9b40-75c1ff73ea99 tempest-ProjectReaderTests-912709323 None] Lock "cinder-5b9121f5-f221-4cc3-9ed8-3279639b99de-delete_volume" acquired by "delete_volume" :: waited 0.014s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:11 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-9ce2199c-1873-49e6-9b40-75c1ff73ea99 tempest-ProjectReaderTests-912709323 None] Acquiring lock "cinder-quobyte-5b9121f5-f221-4cc3-9ed8-3279639b99de" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:11 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-9ce2199c-1873-49e6-9b40-75c1ff73ea99 tempest-ProjectReaderTests-912709323 None] Lock "cinder-quobyte-5b9121f5-f221-4cc3-9ed8-3279639b99de" acquired by "delete_volume" :: waited 0.013s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:11 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[38226f39-a33a-438a-a2ee-fc47ea555e96]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9ce2199c-1873-49e6-9b40-75c1ff73ea99 tempest-ProjectReaderTests-912709323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5b9121f5-f221-4cc3-9ed8-3279639b99de {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:12 devstack sudo[105320]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5b9121f5-f221-4cc3-9ed8-3279639b99de Nov 01 12:38:12 devstack sudo[105320]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:12 devstack sudo[105320]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9ce2199c-1873-49e6-9b40-75c1ff73ea99 tempest-ProjectReaderTests-912709323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5b9121f5-f221-4cc3-9ed8-3279639b99de" returned: 0 in 0.353s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9ce2199c-1873-49e6-9b40-75c1ff73ea99 tempest-ProjectReaderTests-912709323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5b9121f5-f221-4cc3-9ed8-3279639b99de {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:12 devstack sudo[105325]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5b9121f5-f221-4cc3-9ed8-3279639b99de Nov 01 12:38:12 devstack sudo[105325]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:12 devstack sudo[105325]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9ce2199c-1873-49e6-9b40-75c1ff73ea99 tempest-ProjectReaderTests-912709323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5b9121f5-f221-4cc3-9ed8-3279639b99de" returned: 0 in 0.244s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:12 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-9ce2199c-1873-49e6-9b40-75c1ff73ea99 tempest-ProjectReaderTests-912709323 None] Lock "cinder-quobyte-5b9121f5-f221-4cc3-9ed8-3279639b99de" released by "delete_volume" :: held 0.635s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:12 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-9ce2199c-1873-49e6-9b40-75c1ff73ea99 tempest-ProjectReaderTests-912709323 None] Created reservations ['da98ba50-b7b0-4939-81ae-3b56647d3825', '857cb3f7-e190-4e26-a1b1-ca26e364ebab', '23fb5c28-ad9a-4f7a-a1a8-a7ce80781acb', 'c13b70d5-4af6-401f-866d-540873558c5a'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:38:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-9ce2199c-1873-49e6-9b40-75c1ff73ea99 tempest-ProjectReaderTests-912709323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-9ce2199c-1873-49e6-9b40-75c1ff73ea99 tempest-ProjectReaderTests-912709323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:12 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-9ce2199c-1873-49e6-9b40-75c1ff73ea99 tempest-ProjectReaderTests-912709323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:12 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-9ce2199c-1873-49e6-9b40-75c1ff73ea99 tempest-ProjectReaderTests-912709323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-9ce2199c-1873-49e6-9b40-75c1ff73ea99 tempest-ProjectReaderTests-912709323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9ce2199c-1873-49e6-9b40-75c1ff73ea99 tempest-ProjectReaderTests-912709323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:12 devstack sudo[105328]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:38:12 devstack sudo[105328]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:12 devstack sudo[105328]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9ce2199c-1873-49e6-9b40-75c1ff73ea99 tempest-ProjectReaderTests-912709323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.240s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:12 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-9ce2199c-1873-49e6-9b40-75c1ff73ea99 tempest-ProjectReaderTests-912709323 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:38:12 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-9ce2199c-1873-49e6-9b40-75c1ff73ea99 tempest-ProjectReaderTests-912709323 None] Deleted volume successfully. Nov 01 12:38:12 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-9ce2199c-1873-49e6-9b40-75c1ff73ea99 tempest-ProjectReaderTests-912709323 None] Lock "cinder-5b9121f5-f221-4cc3-9ed8-3279639b99de-delete_volume" released by "delete_volume" :: held 1.058s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:13 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-4495d58b-1716-4fc1-9053-304277faad08 tempest-ProjectReaderTests-912709323 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:38:13 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4495d58b-1716-4fc1-9053-304277faad08 tempest-ProjectReaderTests-912709323 None] Flow 'volume_create_manager' (25341189-438d-44c8-b3fa-4b16300ad2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:13 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4495d58b-1716-4fc1-9053-304277faad08 tempest-ProjectReaderTests-912709323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8086c06-7b00-4ddc-81ab-8010fcef53e9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:13 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4495d58b-1716-4fc1-9053-304277faad08 tempest-ProjectReaderTests-912709323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c8086c06-7b00-4ddc-81ab-8010fcef53e9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-247764822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b79f8d4b-6ee2-4c89-8d87-29ccaaa67f36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1fe1b263cfe4368b2ad50c2d87b653b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:13Z,use_quota=True,user_id='0333030bc0a440e6aaec76b5d5e8e565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:13 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4495d58b-1716-4fc1-9053-304277faad08 tempest-ProjectReaderTests-912709323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b59cf57-6ec1-404e-9633-76bc4244032c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:13 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4495d58b-1716-4fc1-9053-304277faad08 tempest-ProjectReaderTests-912709323 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2b59cf57-6ec1-404e-9633-76bc4244032c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:13 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4495d58b-1716-4fc1-9053-304277faad08 tempest-ProjectReaderTests-912709323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (046a984e-5a69-4a9b-be2c-90000bd88def) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:13 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4495d58b-1716-4fc1-9053-304277faad08 tempest-ProjectReaderTests-912709323 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (046a984e-5a69-4a9b-be2c-90000bd88def) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b79f8d4b-6ee2-4c89-8d87-29ccaaa67f36', 'volume_name': 'volume-b79f8d4b-6ee2-4c89-8d87-29ccaaa67f36', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:13 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4495d58b-1716-4fc1-9053-304277faad08 tempest-ProjectReaderTests-912709323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7204b8a9-e197-4bcd-aa82-d5c88e01807c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:13 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4495d58b-1716-4fc1-9053-304277faad08 tempest-ProjectReaderTests-912709323 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7204b8a9-e197-4bcd-aa82-d5c88e01807c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:13 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4495d58b-1716-4fc1-9053-304277faad08 tempest-ProjectReaderTests-912709323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e5195e0-f02a-43e9-8cb4-7ef2c57f6e9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:13 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-4495d58b-1716-4fc1-9053-304277faad08 tempest-ProjectReaderTests-912709323 None] Volume b79f8d4b-6ee2-4c89-8d87-29ccaaa67f36: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b79f8d4b-6ee2-4c89-8d87-29ccaaa67f36', 'volume_size': 1} Nov 01 12:38:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4495d58b-1716-4fc1-9053-304277faad08 tempest-ProjectReaderTests-912709323 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4495d58b-1716-4fc1-9053-304277faad08 tempest-ProjectReaderTests-912709323 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:13 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-4495d58b-1716-4fc1-9053-304277faad08 tempest-ProjectReaderTests-912709323 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:13Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-247764822',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b79f8d4b-6ee2-4c89-8d87-29ccaaa67f36,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1fe1b263cfe4368b2ad50c2d87b653b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:13Z,use_quota=True,user_id='0333030bc0a440e6aaec76b5d5e8e565',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:38:13 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-4495d58b-1716-4fc1-9053-304277faad08 tempest-ProjectReaderTests-912709323 None] Creating volume b79f8d4b-6ee2-4c89-8d87-29ccaaa67f36 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:38:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4495d58b-1716-4fc1-9053-304277faad08 tempest-ProjectReaderTests-912709323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4495d58b-1716-4fc1-9053-304277faad08 tempest-ProjectReaderTests-912709323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:13 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-4495d58b-1716-4fc1-9053-304277faad08 tempest-ProjectReaderTests-912709323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:13 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-4495d58b-1716-4fc1-9053-304277faad08 tempest-ProjectReaderTests-912709323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4495d58b-1716-4fc1-9053-304277faad08 tempest-ProjectReaderTests-912709323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:13 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-4495d58b-1716-4fc1-9053-304277faad08 tempest-ProjectReaderTests-912709323 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:38:13 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-4495d58b-1716-4fc1-9053-304277faad08 tempest-ProjectReaderTests-912709323 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:38:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4495d58b-1716-4fc1-9053-304277faad08 tempest-ProjectReaderTests-912709323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b79f8d4b-6ee2-4c89-8d87-29ccaaa67f36 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:13 devstack sudo[105331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b79f8d4b-6ee2-4c89-8d87-29ccaaa67f36 1073741824 Nov 01 12:38:13 devstack sudo[105331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:13 devstack sudo[105331]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4495d58b-1716-4fc1-9053-304277faad08 tempest-ProjectReaderTests-912709323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b79f8d4b-6ee2-4c89-8d87-29ccaaa67f36 1073741824" returned: 0 in 0.408s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4495d58b-1716-4fc1-9053-304277faad08 tempest-ProjectReaderTests-912709323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b79f8d4b-6ee2-4c89-8d87-29ccaaa67f36 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:13 devstack sudo[105336]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b79f8d4b-6ee2-4c89-8d87-29ccaaa67f36 Nov 01 12:38:13 devstack sudo[105336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:14 devstack sudo[105336]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:14 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4495d58b-1716-4fc1-9053-304277faad08 tempest-ProjectReaderTests-912709323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b79f8d4b-6ee2-4c89-8d87-29ccaaa67f36" returned: 0 in 0.238s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:14 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-4495d58b-1716-4fc1-9053-304277faad08 tempest-ProjectReaderTests-912709323 None] <== create_volume: return (684ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:38:14 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4495d58b-1716-4fc1-9053-304277faad08 tempest-ProjectReaderTests-912709323 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.686s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:14 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4495d58b-1716-4fc1-9053-304277faad08 tempest-ProjectReaderTests-912709323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6e5195e0-f02a-43e9-8cb4-7ef2c57f6e9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b79f8d4b-6ee2-4c89-8d87-29ccaaa67f36', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:14 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4495d58b-1716-4fc1-9053-304277faad08 tempest-ProjectReaderTests-912709323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ff705b6-0be1-4da5-b409-8c8fa746b950) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:14 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-4495d58b-1716-4fc1-9053-304277faad08 tempest-ProjectReaderTests-912709323 None] Volume volume-b79f8d4b-6ee2-4c89-8d87-29ccaaa67f36 (b79f8d4b-6ee2-4c89-8d87-29ccaaa67f36): created successfully Nov 01 12:38:14 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4495d58b-1716-4fc1-9053-304277faad08 tempest-ProjectReaderTests-912709323 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4ff705b6-0be1-4da5-b409-8c8fa746b950) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:14 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4495d58b-1716-4fc1-9053-304277faad08 tempest-ProjectReaderTests-912709323 None] Flow 'volume_create_manager' (25341189-438d-44c8-b3fa-4b16300ad2f2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:14 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-4495d58b-1716-4fc1-9053-304277faad08 tempest-ProjectReaderTests-912709323 None] Created volume successfully. Nov 01 12:38:14 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d5af919a-e226-40ee-b181-d6ec7ef8c197 tempest-ProjectReaderTests-912709323 None] Acquiring lock "cinder-b79f8d4b-6ee2-4c89-8d87-29ccaaa67f36-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:14 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d5af919a-e226-40ee-b181-d6ec7ef8c197 tempest-ProjectReaderTests-912709323 None] Lock "cinder-b79f8d4b-6ee2-4c89-8d87-29ccaaa67f36-delete_volume" acquired by "delete_volume" :: waited 0.016s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:14 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d5af919a-e226-40ee-b181-d6ec7ef8c197 tempest-ProjectReaderTests-912709323 None] Acquiring lock "cinder-quobyte-b79f8d4b-6ee2-4c89-8d87-29ccaaa67f36" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:14 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d5af919a-e226-40ee-b181-d6ec7ef8c197 tempest-ProjectReaderTests-912709323 None] Lock "cinder-quobyte-b79f8d4b-6ee2-4c89-8d87-29ccaaa67f36" acquired by "delete_volume" :: waited 0.014s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:14 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[3211ba1c-b08f-4531-9eeb-54c775000381]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:14 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d5af919a-e226-40ee-b181-d6ec7ef8c197 tempest-ProjectReaderTests-912709323 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b79f8d4b-6ee2-4c89-8d87-29ccaaa67f36 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:14 devstack sudo[105339]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b79f8d4b-6ee2-4c89-8d87-29ccaaa67f36 Nov 01 12:38:14 devstack sudo[105339]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:14 devstack sudo[105339]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:14 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d5af919a-e226-40ee-b181-d6ec7ef8c197 tempest-ProjectReaderTests-912709323 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b79f8d4b-6ee2-4c89-8d87-29ccaaa67f36" returned: 0 in 0.348s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:14 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d5af919a-e226-40ee-b181-d6ec7ef8c197 tempest-ProjectReaderTests-912709323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b79f8d4b-6ee2-4c89-8d87-29ccaaa67f36 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:14 devstack sudo[105344]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b79f8d4b-6ee2-4c89-8d87-29ccaaa67f36 Nov 01 12:38:14 devstack sudo[105344]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:15 devstack sudo[105344]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d5af919a-e226-40ee-b181-d6ec7ef8c197 tempest-ProjectReaderTests-912709323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b79f8d4b-6ee2-4c89-8d87-29ccaaa67f36" returned: 0 in 0.236s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:15 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d5af919a-e226-40ee-b181-d6ec7ef8c197 tempest-ProjectReaderTests-912709323 None] Lock "cinder-quobyte-b79f8d4b-6ee2-4c89-8d87-29ccaaa67f36" released by "delete_volume" :: held 0.623s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:15 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-d5af919a-e226-40ee-b181-d6ec7ef8c197 tempest-ProjectReaderTests-912709323 None] Created reservations ['2a600c80-2d2e-4a1d-8c65-7bfb7771ddfd', 'cc60b412-a000-4eb6-bd05-b6a3e36c97f1', '0599d67c-aa74-4cf5-9d96-5410a20d812a', '7d67d464-ac50-4523-b061-6ec656d8ec2f'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:38:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d5af919a-e226-40ee-b181-d6ec7ef8c197 tempest-ProjectReaderTests-912709323 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d5af919a-e226-40ee-b181-d6ec7ef8c197 tempest-ProjectReaderTests-912709323 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:15 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d5af919a-e226-40ee-b181-d6ec7ef8c197 tempest-ProjectReaderTests-912709323 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:15 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d5af919a-e226-40ee-b181-d6ec7ef8c197 tempest-ProjectReaderTests-912709323 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d5af919a-e226-40ee-b181-d6ec7ef8c197 tempest-ProjectReaderTests-912709323 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d5af919a-e226-40ee-b181-d6ec7ef8c197 tempest-ProjectReaderTests-912709323 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:15 devstack sudo[105347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:38:15 devstack sudo[105347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:15 devstack sudo[105347]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d5af919a-e226-40ee-b181-d6ec7ef8c197 tempest-ProjectReaderTests-912709323 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.238s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:15 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-d5af919a-e226-40ee-b181-d6ec7ef8c197 tempest-ProjectReaderTests-912709323 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:38:15 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-d5af919a-e226-40ee-b181-d6ec7ef8c197 tempest-ProjectReaderTests-912709323 None] Deleted volume successfully. Nov 01 12:38:15 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d5af919a-e226-40ee-b181-d6ec7ef8c197 tempest-ProjectReaderTests-912709323 None] Lock "cinder-b79f8d4b-6ee2-4c89-8d87-29ccaaa67f36-delete_volume" released by "delete_volume" :: held 1.043s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:25 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:SELECT=80,cinder:UPDATE=88,cinder:INSERT=22,cinder:DELETE=5 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:38:25 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:UPDATE=97,cinder:SELECT=68,cinder:DELETE=11,cinder:INSERT=32 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:38:27 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-1cf750b3-d589-4974-9d37-c81dfff1e797 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:38:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-1cf750b3-d589-4974-9d37-c81dfff1e797 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Flow 'volume_create_manager' (1036e250-5e9b-444e-a816-b5b68757d8ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-1cf750b3-d589-4974-9d37-c81dfff1e797 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (989aaf2a-8e62-45d8-baf5-35aa5ca25c41) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-1cf750b3-d589-4974-9d37-c81dfff1e797 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (989aaf2a-8e62-45d8-baf5-35aa5ca25c41) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1070313161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4462cbed-00df-479c-9a1c-8815f802555c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9c934deca6c4332885263dd4cb83dfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:28Z,use_quota=True,user_id='362ff3df17dc46c7bf4bfaacc9db7290',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-1cf750b3-d589-4974-9d37-c81dfff1e797 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2525869-67a3-4ad9-aa73-c25d7f0738dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-1cf750b3-d589-4974-9d37-c81dfff1e797 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c2525869-67a3-4ad9-aa73-c25d7f0738dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-1cf750b3-d589-4974-9d37-c81dfff1e797 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5c63934-fc1c-42f3-b1da-c9c11bd9b495) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-1cf750b3-d589-4974-9d37-c81dfff1e797 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a5c63934-fc1c-42f3-b1da-c9c11bd9b495) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4462cbed-00df-479c-9a1c-8815f802555c', 'volume_name': 'volume-4462cbed-00df-479c-9a1c-8815f802555c', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-1cf750b3-d589-4974-9d37-c81dfff1e797 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1216b71d-aa81-4eab-81ad-f7623bbdfd58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-1cf750b3-d589-4974-9d37-c81dfff1e797 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1216b71d-aa81-4eab-81ad-f7623bbdfd58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-1cf750b3-d589-4974-9d37-c81dfff1e797 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab1edb4-b0f5-4267-96f6-6242f769573d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:27 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-1cf750b3-d589-4974-9d37-c81dfff1e797 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Volume 4462cbed-00df-479c-9a1c-8815f802555c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4462cbed-00df-479c-9a1c-8815f802555c', 'volume_size': 1} Nov 01 12:38:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-1cf750b3-d589-4974-9d37-c81dfff1e797 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-1cf750b3-d589-4974-9d37-c81dfff1e797 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:27 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-1cf750b3-d589-4974-9d37-c81dfff1e797 tempest-CreateVolumesFromSnapshotTest-1885067804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1070313161',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4462cbed-00df-479c-9a1c-8815f802555c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9c934deca6c4332885263dd4cb83dfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:28Z,use_quota=True,user_id='362ff3df17dc46c7bf4bfaacc9db7290',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:38:27 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-1cf750b3-d589-4974-9d37-c81dfff1e797 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Creating volume 4462cbed-00df-479c-9a1c-8815f802555c {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:38:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-1cf750b3-d589-4974-9d37-c81dfff1e797 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-1cf750b3-d589-4974-9d37-c81dfff1e797 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:27 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-1cf750b3-d589-4974-9d37-c81dfff1e797 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:27 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-1cf750b3-d589-4974-9d37-c81dfff1e797 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-1cf750b3-d589-4974-9d37-c81dfff1e797 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:27 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-1cf750b3-d589-4974-9d37-c81dfff1e797 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:38:27 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-1cf750b3-d589-4974-9d37-c81dfff1e797 tempest-CreateVolumesFromSnapshotTest-1885067804 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:38:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1cf750b3-d589-4974-9d37-c81dfff1e797 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4462cbed-00df-479c-9a1c-8815f802555c 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:27 devstack sudo[105389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4462cbed-00df-479c-9a1c-8815f802555c 1073741824 Nov 01 12:38:27 devstack sudo[105389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:28 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-b87c335e-e6db-4b9d-b5b9-fde69e3876a8 tempest-CreateVolumesFromImageTest-2025437841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:38:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b87c335e-e6db-4b9d-b5b9-fde69e3876a8 tempest-CreateVolumesFromImageTest-2025437841 None] Flow 'volume_create_manager' (b2b65027-4769-4dfb-a130-07e087fe6f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b87c335e-e6db-4b9d-b5b9-fde69e3876a8 tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c54c978-0d74-42bb-ac20-fcefb85e4129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b87c335e-e6db-4b9d-b5b9-fde69e3876a8 tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c54c978-0d74-42bb-ac20-fcefb85e4129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-853448559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1748f7e9-00a3-4fe6-9222-fe01526a8acf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='301a72a01b884475a5c7fd38783f1cb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:28Z,use_quota=True,user_id='07cc99f4ff7e4b7db2c0865c49ed2d8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b87c335e-e6db-4b9d-b5b9-fde69e3876a8 tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30a20b6d-b717-41cb-9874-5b3b7c4da92d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b87c335e-e6db-4b9d-b5b9-fde69e3876a8 tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (30a20b6d-b717-41cb-9874-5b3b7c4da92d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b87c335e-e6db-4b9d-b5b9-fde69e3876a8 tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9f03d1c-c8ee-4e15-8035-8ac16755586c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b87c335e-e6db-4b9d-b5b9-fde69e3876a8 tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a9f03d1c-c8ee-4e15-8035-8ac16755586c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '1748f7e9-00a3-4fe6-9222-fe01526a8acf', 'volume_name': 'volume-1748f7e9-00a3-4fe6-9222-fe01526a8acf', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b87c335e-e6db-4b9d-b5b9-fde69e3876a8 tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0e55f1a-d7b3-4ccd-8b7f-9002f3e166ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b87c335e-e6db-4b9d-b5b9-fde69e3876a8 tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0e55f1a-d7b3-4ccd-8b7f-9002f3e166ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b87c335e-e6db-4b9d-b5b9-fde69e3876a8 tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce939302-1c92-4b43-b0ff-b83a0e6ef0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:28 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-b87c335e-e6db-4b9d-b5b9-fde69e3876a8 tempest-CreateVolumesFromImageTest-2025437841 None] Volume 1748f7e9-00a3-4fe6-9222-fe01526a8acf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-1748f7e9-00a3-4fe6-9222-fe01526a8acf', 'volume_size': 1} Nov 01 12:38:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b87c335e-e6db-4b9d-b5b9-fde69e3876a8 tempest-CreateVolumesFromImageTest-2025437841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:28 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-0b4fc4e6-2aa4-4484-9a88-708fdac43f61 tempest-CreateVolumesFromImageTest-2025437841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:38:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0b4fc4e6-2aa4-4484-9a88-708fdac43f61 tempest-CreateVolumesFromImageTest-2025437841 None] Flow 'volume_create_manager' (cbe51784-953d-4958-830d-76fef86dfb63) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0b4fc4e6-2aa4-4484-9a88-708fdac43f61 tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b764559a-0f68-4dc4-9988-201de282634b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0b4fc4e6-2aa4-4484-9a88-708fdac43f61 tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b764559a-0f68-4dc4-9988-201de282634b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1826563732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da5ef211-0d0d-4a0f-a61e-b37e07908b96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='301a72a01b884475a5c7fd38783f1cb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:28Z,use_quota=True,user_id='07cc99f4ff7e4b7db2c0865c49ed2d8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0b4fc4e6-2aa4-4484-9a88-708fdac43f61 tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d6440e6-fdd6-478a-9d94-7a1928c45b89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0b4fc4e6-2aa4-4484-9a88-708fdac43f61 tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d6440e6-fdd6-478a-9d94-7a1928c45b89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0b4fc4e6-2aa4-4484-9a88-708fdac43f61 tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef907e4b-af59-4954-bfa6-2935f79119fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0b4fc4e6-2aa4-4484-9a88-708fdac43f61 tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ef907e4b-af59-4954-bfa6-2935f79119fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da5ef211-0d0d-4a0f-a61e-b37e07908b96', 'volume_name': 'volume-da5ef211-0d0d-4a0f-a61e-b37e07908b96', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0b4fc4e6-2aa4-4484-9a88-708fdac43f61 tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0ffa002-c5af-4ca0-8853-bda3e41b1e62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0b4fc4e6-2aa4-4484-9a88-708fdac43f61 tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a0ffa002-c5af-4ca0-8853-bda3e41b1e62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0b4fc4e6-2aa4-4484-9a88-708fdac43f61 tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84ef6df5-4b47-402a-859c-990ed64b2f7e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:28 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-0b4fc4e6-2aa4-4484-9a88-708fdac43f61 tempest-CreateVolumesFromImageTest-2025437841 None] Volume da5ef211-0d0d-4a0f-a61e-b37e07908b96: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da5ef211-0d0d-4a0f-a61e-b37e07908b96', 'volume_size': 1} Nov 01 12:38:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0b4fc4e6-2aa4-4484-9a88-708fdac43f61 tempest-CreateVolumesFromImageTest-2025437841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:28 devstack sudo[105389]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1cf750b3-d589-4974-9d37-c81dfff1e797 tempest-CreateVolumesFromSnapshotTest-1885067804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4462cbed-00df-479c-9a1c-8815f802555c 1073741824" returned: 0 in 0.587s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1cf750b3-d589-4974-9d37-c81dfff1e797 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4462cbed-00df-479c-9a1c-8815f802555c {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:28 devstack sudo[105396]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4462cbed-00df-479c-9a1c-8815f802555c Nov 01 12:38:28 devstack sudo[105396]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:28 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-22053ccd-554f-47c3-b5ec-a6227b504b69 tempest-CreateVolumesFromImageTest-2025437841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:38:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-22053ccd-554f-47c3-b5ec-a6227b504b69 tempest-CreateVolumesFromImageTest-2025437841 None] Flow 'volume_create_manager' (1091b3c1-cfb7-4e9e-b7f1-06f7a97ac0cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-22053ccd-554f-47c3-b5ec-a6227b504b69 tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (035e5f80-bb7f-4f7a-9681-d04eb0bc62e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-22053ccd-554f-47c3-b5ec-a6227b504b69 tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (035e5f80-bb7f-4f7a-9681-d04eb0bc62e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1503394924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3533648-3a71-4727-b081-aef13dcb4ad1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='301a72a01b884475a5c7fd38783f1cb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:29Z,use_quota=True,user_id='07cc99f4ff7e4b7db2c0865c49ed2d8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-22053ccd-554f-47c3-b5ec-a6227b504b69 tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6f96c93-a844-4b9b-8c2b-084b8c4cb8b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-22053ccd-554f-47c3-b5ec-a6227b504b69 tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b6f96c93-a844-4b9b-8c2b-084b8c4cb8b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-22053ccd-554f-47c3-b5ec-a6227b504b69 tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca66e9b5-a89a-4863-a7c5-f7a1ac4208d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-22053ccd-554f-47c3-b5ec-a6227b504b69 tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca66e9b5-a89a-4863-a7c5-f7a1ac4208d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c3533648-3a71-4727-b081-aef13dcb4ad1', 'volume_name': 'volume-c3533648-3a71-4727-b081-aef13dcb4ad1', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-22053ccd-554f-47c3-b5ec-a6227b504b69 tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34b935f6-32f8-4044-8591-9002eef00a75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-22053ccd-554f-47c3-b5ec-a6227b504b69 tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (34b935f6-32f8-4044-8591-9002eef00a75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:28 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-22053ccd-554f-47c3-b5ec-a6227b504b69 tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab7029f6-c490-4516-8b21-c8384c07980f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:28 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-22053ccd-554f-47c3-b5ec-a6227b504b69 tempest-CreateVolumesFromImageTest-2025437841 None] Volume c3533648-3a71-4727-b081-aef13dcb4ad1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c3533648-3a71-4727-b081-aef13dcb4ad1', 'volume_size': 1} Nov 01 12:38:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-22053ccd-554f-47c3-b5ec-a6227b504b69 tempest-CreateVolumesFromImageTest-2025437841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:28 devstack sudo[105396]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1cf750b3-d589-4974-9d37-c81dfff1e797 tempest-CreateVolumesFromSnapshotTest-1885067804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4462cbed-00df-479c-9a1c-8815f802555c" returned: 0 in 0.359s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:28 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-1cf750b3-d589-4974-9d37-c81dfff1e797 tempest-CreateVolumesFromSnapshotTest-1885067804 None] <== create_volume: return (1035ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:38:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-1cf750b3-d589-4974-9d37-c81dfff1e797 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.037s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b87c335e-e6db-4b9d-b5b9-fde69e3876a8 tempest-CreateVolumesFromImageTest-2025437841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.861s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:28 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-b87c335e-e6db-4b9d-b5b9-fde69e3876a8 tempest-CreateVolumesFromImageTest-2025437841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-853448559',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=1748f7e9-00a3-4fe6-9222-fe01526a8acf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='301a72a01b884475a5c7fd38783f1cb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:28Z,use_quota=True,user_id='07cc99f4ff7e4b7db2c0865c49ed2d8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:38:28 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-b87c335e-e6db-4b9d-b5b9-fde69e3876a8 tempest-CreateVolumesFromImageTest-2025437841 None] Creating volume 1748f7e9-00a3-4fe6-9222-fe01526a8acf {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:38:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b87c335e-e6db-4b9d-b5b9-fde69e3876a8 tempest-CreateVolumesFromImageTest-2025437841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b87c335e-e6db-4b9d-b5b9-fde69e3876a8 tempest-CreateVolumesFromImageTest-2025437841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:28 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-b87c335e-e6db-4b9d-b5b9-fde69e3876a8 tempest-CreateVolumesFromImageTest-2025437841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:29 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-b87c335e-e6db-4b9d-b5b9-fde69e3876a8 tempest-CreateVolumesFromImageTest-2025437841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b87c335e-e6db-4b9d-b5b9-fde69e3876a8 tempest-CreateVolumesFromImageTest-2025437841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:29 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-b87c335e-e6db-4b9d-b5b9-fde69e3876a8 tempest-CreateVolumesFromImageTest-2025437841 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:38:29 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-b87c335e-e6db-4b9d-b5b9-fde69e3876a8 tempest-CreateVolumesFromImageTest-2025437841 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:38:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b87c335e-e6db-4b9d-b5b9-fde69e3876a8 tempest-CreateVolumesFromImageTest-2025437841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1748f7e9-00a3-4fe6-9222-fe01526a8acf 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-1cf750b3-d589-4974-9d37-c81dfff1e797 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bab1edb4-b0f5-4267-96f6-6242f769573d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4462cbed-00df-479c-9a1c-8815f802555c', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-1cf750b3-d589-4974-9d37-c81dfff1e797 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b39dddb-9581-4017-ae59-976e47e62c9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:29 devstack sudo[105400]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1748f7e9-00a3-4fe6-9222-fe01526a8acf 1073741824 Nov 01 12:38:29 devstack sudo[105400]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:29 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-1cf750b3-d589-4974-9d37-c81dfff1e797 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Volume volume-4462cbed-00df-479c-9a1c-8815f802555c (4462cbed-00df-479c-9a1c-8815f802555c): created successfully Nov 01 12:38:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-1cf750b3-d589-4974-9d37-c81dfff1e797 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0b39dddb-9581-4017-ae59-976e47e62c9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-1cf750b3-d589-4974-9d37-c81dfff1e797 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Flow 'volume_create_manager' (1036e250-5e9b-444e-a816-b5b68757d8ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:29 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-1cf750b3-d589-4974-9d37-c81dfff1e797 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Created volume successfully. Nov 01 12:38:29 devstack sudo[105400]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b87c335e-e6db-4b9d-b5b9-fde69e3876a8 tempest-CreateVolumesFromImageTest-2025437841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1748f7e9-00a3-4fe6-9222-fe01526a8acf 1073741824" returned: 0 in 0.557s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b87c335e-e6db-4b9d-b5b9-fde69e3876a8 tempest-CreateVolumesFromImageTest-2025437841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1748f7e9-00a3-4fe6-9222-fe01526a8acf {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:29 devstack sudo[105409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1748f7e9-00a3-4fe6-9222-fe01526a8acf Nov 01 12:38:29 devstack sudo[105409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:29 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-a15c0ac3-fb6e-4cb0-8df7-65862e2adb35 tempest-ProjectMemberTests-538781697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:38:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a15c0ac3-fb6e-4cb0-8df7-65862e2adb35 tempest-ProjectMemberTests-538781697 None] Flow 'volume_create_manager' (4fc2ef8c-8d77-40c2-b9df-9d9e4da0fa07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a15c0ac3-fb6e-4cb0-8df7-65862e2adb35 tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (018379ad-ae55-4cdc-a352-91f7220efd9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a15c0ac3-fb6e-4cb0-8df7-65862e2adb35 tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (018379ad-ae55-4cdc-a352-91f7220efd9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1206212414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe920575-fb85-4f83-9d1c-84791262bc0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe0ffaf6cf1d4294aa9f030164447d48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:30Z,use_quota=True,user_id='f617cd7e548d4a989b479812bba708f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a15c0ac3-fb6e-4cb0-8df7-65862e2adb35 tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f41f95e1-c0fb-45dc-87bf-7611d722a98d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a15c0ac3-fb6e-4cb0-8df7-65862e2adb35 tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f41f95e1-c0fb-45dc-87bf-7611d722a98d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a15c0ac3-fb6e-4cb0-8df7-65862e2adb35 tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d3aa781-8654-413a-ab43-1fe651a22cc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a15c0ac3-fb6e-4cb0-8df7-65862e2adb35 tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d3aa781-8654-413a-ab43-1fe651a22cc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fe920575-fb85-4f83-9d1c-84791262bc0c', 'volume_name': 'volume-fe920575-fb85-4f83-9d1c-84791262bc0c', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a15c0ac3-fb6e-4cb0-8df7-65862e2adb35 tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d6c6192-cbe4-4216-b1ac-78fc32d9a056) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a15c0ac3-fb6e-4cb0-8df7-65862e2adb35 tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6d6c6192-cbe4-4216-b1ac-78fc32d9a056) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a15c0ac3-fb6e-4cb0-8df7-65862e2adb35 tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39a082a5-3bde-4c89-ac9e-37ed19db65a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:29 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-a15c0ac3-fb6e-4cb0-8df7-65862e2adb35 tempest-ProjectMemberTests-538781697 None] Volume fe920575-fb85-4f83-9d1c-84791262bc0c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fe920575-fb85-4f83-9d1c-84791262bc0c', 'volume_size': 1} Nov 01 12:38:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a15c0ac3-fb6e-4cb0-8df7-65862e2adb35 tempest-ProjectMemberTests-538781697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:29 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-5a1d3e59-5b2d-4190-93cb-8e98cc521b9a tempest-CreateVolumesFromImageTest-2025437841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:38:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5a1d3e59-5b2d-4190-93cb-8e98cc521b9a tempest-CreateVolumesFromImageTest-2025437841 None] Flow 'volume_create_manager' (4ab41de8-aac5-41f7-92cd-f2cc26fa34c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:29 devstack sudo[105409]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5a1d3e59-5b2d-4190-93cb-8e98cc521b9a tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4352d277-a22e-41d4-a7b1-0b6a38025e3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b87c335e-e6db-4b9d-b5b9-fde69e3876a8 tempest-CreateVolumesFromImageTest-2025437841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1748f7e9-00a3-4fe6-9222-fe01526a8acf" returned: 0 in 0.274s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:29 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-b87c335e-e6db-4b9d-b5b9-fde69e3876a8 tempest-CreateVolumesFromImageTest-2025437841 None] <== create_volume: return (888ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:38:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b87c335e-e6db-4b9d-b5b9-fde69e3876a8 tempest-CreateVolumesFromImageTest-2025437841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.893s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0b4fc4e6-2aa4-4484-9a88-708fdac43f61 tempest-CreateVolumesFromImageTest-2025437841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.626s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:29 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-0b4fc4e6-2aa4-4484-9a88-708fdac43f61 tempest-CreateVolumesFromImageTest-2025437841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1826563732',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da5ef211-0d0d-4a0f-a61e-b37e07908b96,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='301a72a01b884475a5c7fd38783f1cb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:28Z,use_quota=True,user_id='07cc99f4ff7e4b7db2c0865c49ed2d8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:38:29 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-0b4fc4e6-2aa4-4484-9a88-708fdac43f61 tempest-CreateVolumesFromImageTest-2025437841 None] Creating volume da5ef211-0d0d-4a0f-a61e-b37e07908b96 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:38:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0b4fc4e6-2aa4-4484-9a88-708fdac43f61 tempest-CreateVolumesFromImageTest-2025437841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0b4fc4e6-2aa4-4484-9a88-708fdac43f61 tempest-CreateVolumesFromImageTest-2025437841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:29 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-0b4fc4e6-2aa4-4484-9a88-708fdac43f61 tempest-CreateVolumesFromImageTest-2025437841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:29 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-0b4fc4e6-2aa4-4484-9a88-708fdac43f61 tempest-CreateVolumesFromImageTest-2025437841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0b4fc4e6-2aa4-4484-9a88-708fdac43f61 tempest-CreateVolumesFromImageTest-2025437841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:29 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-0b4fc4e6-2aa4-4484-9a88-708fdac43f61 tempest-CreateVolumesFromImageTest-2025437841 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:38:29 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-0b4fc4e6-2aa4-4484-9a88-708fdac43f61 tempest-CreateVolumesFromImageTest-2025437841 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:38:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0b4fc4e6-2aa4-4484-9a88-708fdac43f61 tempest-CreateVolumesFromImageTest-2025437841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-da5ef211-0d0d-4a0f-a61e-b37e07908b96 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5a1d3e59-5b2d-4190-93cb-8e98cc521b9a tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4352d277-a22e-41d4-a7b1-0b6a38025e3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1491397416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd8b7f41-6a3b-41be-866f-5ae4968519a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='301a72a01b884475a5c7fd38783f1cb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:30Z,use_quota=True,user_id='07cc99f4ff7e4b7db2c0865c49ed2d8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:29 devstack sudo[105412]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-da5ef211-0d0d-4a0f-a61e-b37e07908b96 1073741824 Nov 01 12:38:29 devstack sudo[105412]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5a1d3e59-5b2d-4190-93cb-8e98cc521b9a tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (279b388e-50e4-46f1-a7d2-14bb6b1d357c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5a1d3e59-5b2d-4190-93cb-8e98cc521b9a tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (279b388e-50e4-46f1-a7d2-14bb6b1d357c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5a1d3e59-5b2d-4190-93cb-8e98cc521b9a tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cd63b90-b8f0-419e-a558-a4185366ec1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5a1d3e59-5b2d-4190-93cb-8e98cc521b9a tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1cd63b90-b8f0-419e-a558-a4185366ec1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bd8b7f41-6a3b-41be-866f-5ae4968519a2', 'volume_name': 'volume-bd8b7f41-6a3b-41be-866f-5ae4968519a2', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5a1d3e59-5b2d-4190-93cb-8e98cc521b9a tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3838704d-ecdb-4c9a-a614-686c426e7394) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5a1d3e59-5b2d-4190-93cb-8e98cc521b9a tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3838704d-ecdb-4c9a-a614-686c426e7394) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5a1d3e59-5b2d-4190-93cb-8e98cc521b9a tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a224d751-8232-4266-b54c-fdabede427a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:29 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-5a1d3e59-5b2d-4190-93cb-8e98cc521b9a tempest-CreateVolumesFromImageTest-2025437841 None] Volume bd8b7f41-6a3b-41be-866f-5ae4968519a2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bd8b7f41-6a3b-41be-866f-5ae4968519a2', 'volume_size': 1} Nov 01 12:38:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5a1d3e59-5b2d-4190-93cb-8e98cc521b9a tempest-CreateVolumesFromImageTest-2025437841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:29 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-c05f431e-b971-4183-a539-8c3bf2df805e tempest-CreateVolumesFromImageTest-2025437841 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:38:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c05f431e-b971-4183-a539-8c3bf2df805e tempest-CreateVolumesFromImageTest-2025437841 None] Flow 'volume_create_manager' (2ac57db0-c069-4678-baa9-603ca2caaee6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c05f431e-b971-4183-a539-8c3bf2df805e tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a801cc6-4cbf-4a43-a159-5a11258d01f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:29 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b87c335e-e6db-4b9d-b5b9-fde69e3876a8 tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ce939302-1c92-4b43-b0ff-b83a0e6ef0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-1748f7e9-00a3-4fe6-9222-fe01526a8acf', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:30 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b87c335e-e6db-4b9d-b5b9-fde69e3876a8 tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e09c5083-6b9e-4e22-ab57-7aee56453cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:30 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c05f431e-b971-4183-a539-8c3bf2df805e tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7a801cc6-4cbf-4a43-a159-5a11258d01f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1980689021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1eaf1a5-3937-44e5-918f-ad8ce49c9d89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='301a72a01b884475a5c7fd38783f1cb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:30Z,use_quota=True,user_id='07cc99f4ff7e4b7db2c0865c49ed2d8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:30 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c05f431e-b971-4183-a539-8c3bf2df805e tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (756da180-430e-4016-bec4-b72470f9ffb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:30 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c05f431e-b971-4183-a539-8c3bf2df805e tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (756da180-430e-4016-bec4-b72470f9ffb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:30 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c05f431e-b971-4183-a539-8c3bf2df805e tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9a4d867-76da-479c-b9c3-9084ade647a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:30 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c05f431e-b971-4183-a539-8c3bf2df805e tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d9a4d867-76da-479c-b9c3-9084ade647a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1eaf1a5-3937-44e5-918f-ad8ce49c9d89', 'volume_name': 'volume-b1eaf1a5-3937-44e5-918f-ad8ce49c9d89', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:30 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c05f431e-b971-4183-a539-8c3bf2df805e tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (562922fe-7ee4-44ae-beda-0289ac2df11c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:30 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c05f431e-b971-4183-a539-8c3bf2df805e tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (562922fe-7ee4-44ae-beda-0289ac2df11c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:30 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c05f431e-b971-4183-a539-8c3bf2df805e tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1df36bb7-e64d-45a3-a698-bd831b78fa6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:30 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-c05f431e-b971-4183-a539-8c3bf2df805e tempest-CreateVolumesFromImageTest-2025437841 None] Volume b1eaf1a5-3937-44e5-918f-ad8ce49c9d89: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1eaf1a5-3937-44e5-918f-ad8ce49c9d89', 'volume_size': 1} Nov 01 12:38:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-c05f431e-b971-4183-a539-8c3bf2df805e tempest-CreateVolumesFromImageTest-2025437841 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:30 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-b87c335e-e6db-4b9d-b5b9-fde69e3876a8 tempest-CreateVolumesFromImageTest-2025437841 None] Volume volume-1748f7e9-00a3-4fe6-9222-fe01526a8acf (1748f7e9-00a3-4fe6-9222-fe01526a8acf): created successfully Nov 01 12:38:30 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b87c335e-e6db-4b9d-b5b9-fde69e3876a8 tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e09c5083-6b9e-4e22-ab57-7aee56453cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:30 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-b87c335e-e6db-4b9d-b5b9-fde69e3876a8 tempest-CreateVolumesFromImageTest-2025437841 None] Flow 'volume_create_manager' (b2b65027-4769-4dfb-a130-07e087fe6f0f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:30 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-b87c335e-e6db-4b9d-b5b9-fde69e3876a8 tempest-CreateVolumesFromImageTest-2025437841 None] Created volume successfully. Nov 01 12:38:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-7e57d8e1-e07c-45a2-9165-325e22584e7d tempest-CreateVolumesFromSnapshotTest-1885067804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:30 devstack sudo[105412]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0b4fc4e6-2aa4-4484-9a88-708fdac43f61 tempest-CreateVolumesFromImageTest-2025437841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-da5ef211-0d0d-4a0f-a61e-b37e07908b96 1073741824" returned: 0 in 0.554s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0b4fc4e6-2aa4-4484-9a88-708fdac43f61 tempest-CreateVolumesFromImageTest-2025437841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-da5ef211-0d0d-4a0f-a61e-b37e07908b96 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:30 devstack sudo[105418]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-da5ef211-0d0d-4a0f-a61e-b37e07908b96 Nov 01 12:38:30 devstack sudo[105418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:30 devstack sudo[105418]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-0b4fc4e6-2aa4-4484-9a88-708fdac43f61 tempest-CreateVolumesFromImageTest-2025437841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-da5ef211-0d0d-4a0f-a61e-b37e07908b96" returned: 0 in 0.267s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:30 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-0b4fc4e6-2aa4-4484-9a88-708fdac43f61 tempest-CreateVolumesFromImageTest-2025437841 None] <== create_volume: return (880ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:38:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-0b4fc4e6-2aa4-4484-9a88-708fdac43f61 tempest-CreateVolumesFromImageTest-2025437841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.883s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-22053ccd-554f-47c3-b5ec-a6227b504b69 tempest-CreateVolumesFromImageTest-2025437841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.917s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:30 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-22053ccd-554f-47c3-b5ec-a6227b504b69 tempest-CreateVolumesFromImageTest-2025437841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1503394924',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c3533648-3a71-4727-b081-aef13dcb4ad1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='301a72a01b884475a5c7fd38783f1cb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:29Z,use_quota=True,user_id='07cc99f4ff7e4b7db2c0865c49ed2d8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:38:30 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-22053ccd-554f-47c3-b5ec-a6227b504b69 tempest-CreateVolumesFromImageTest-2025437841 None] Creating volume c3533648-3a71-4727-b081-aef13dcb4ad1 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:38:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-22053ccd-554f-47c3-b5ec-a6227b504b69 tempest-CreateVolumesFromImageTest-2025437841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-22053ccd-554f-47c3-b5ec-a6227b504b69 tempest-CreateVolumesFromImageTest-2025437841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:30 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-22053ccd-554f-47c3-b5ec-a6227b504b69 tempest-CreateVolumesFromImageTest-2025437841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:30 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-22053ccd-554f-47c3-b5ec-a6227b504b69 tempest-CreateVolumesFromImageTest-2025437841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-22053ccd-554f-47c3-b5ec-a6227b504b69 tempest-CreateVolumesFromImageTest-2025437841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:30 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-22053ccd-554f-47c3-b5ec-a6227b504b69 tempest-CreateVolumesFromImageTest-2025437841 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:38:30 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-22053ccd-554f-47c3-b5ec-a6227b504b69 tempest-CreateVolumesFromImageTest-2025437841 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:38:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-22053ccd-554f-47c3-b5ec-a6227b504b69 tempest-CreateVolumesFromImageTest-2025437841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c3533648-3a71-4727-b081-aef13dcb4ad1 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:30 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0b4fc4e6-2aa4-4484-9a88-708fdac43f61 tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84ef6df5-4b47-402a-859c-990ed64b2f7e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da5ef211-0d0d-4a0f-a61e-b37e07908b96', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:30 devstack sudo[105421]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c3533648-3a71-4727-b081-aef13dcb4ad1 1073741824 Nov 01 12:38:30 devstack sudo[105421]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:30 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0b4fc4e6-2aa4-4484-9a88-708fdac43f61 tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1823b9d-199b-4b05-bc70-aa94f13f0b0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:30 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-0b4fc4e6-2aa4-4484-9a88-708fdac43f61 tempest-CreateVolumesFromImageTest-2025437841 None] Volume volume-da5ef211-0d0d-4a0f-a61e-b37e07908b96 (da5ef211-0d0d-4a0f-a61e-b37e07908b96): created successfully Nov 01 12:38:30 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0b4fc4e6-2aa4-4484-9a88-708fdac43f61 tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c1823b9d-199b-4b05-bc70-aa94f13f0b0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:30 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-0b4fc4e6-2aa4-4484-9a88-708fdac43f61 tempest-CreateVolumesFromImageTest-2025437841 None] Flow 'volume_create_manager' (cbe51784-953d-4958-830d-76fef86dfb63) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:30 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-0b4fc4e6-2aa4-4484-9a88-708fdac43f61 tempest-CreateVolumesFromImageTest-2025437841 None] Created volume successfully. Nov 01 12:38:31 devstack sudo[105421]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-22053ccd-554f-47c3-b5ec-a6227b504b69 tempest-CreateVolumesFromImageTest-2025437841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c3533648-3a71-4727-b081-aef13dcb4ad1 1073741824" returned: 0 in 0.469s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-22053ccd-554f-47c3-b5ec-a6227b504b69 tempest-CreateVolumesFromImageTest-2025437841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c3533648-3a71-4727-b081-aef13dcb4ad1 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:31 devstack sudo[105427]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c3533648-3a71-4727-b081-aef13dcb4ad1 Nov 01 12:38:31 devstack sudo[105427]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:31 devstack sudo[105427]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-22053ccd-554f-47c3-b5ec-a6227b504b69 tempest-CreateVolumesFromImageTest-2025437841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c3533648-3a71-4727-b081-aef13dcb4ad1" returned: 0 in 0.262s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:31 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-22053ccd-554f-47c3-b5ec-a6227b504b69 tempest-CreateVolumesFromImageTest-2025437841 None] <== create_volume: return (773ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:38:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-22053ccd-554f-47c3-b5ec-a6227b504b69 tempest-CreateVolumesFromImageTest-2025437841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.775s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a15c0ac3-fb6e-4cb0-8df7-65862e2adb35 tempest-ProjectMemberTests-538781697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.715s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:31 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a15c0ac3-fb6e-4cb0-8df7-65862e2adb35 tempest-ProjectMemberTests-538781697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1206212414',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fe920575-fb85-4f83-9d1c-84791262bc0c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe0ffaf6cf1d4294aa9f030164447d48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:30Z,use_quota=True,user_id='f617cd7e548d4a989b479812bba708f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:38:31 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-a15c0ac3-fb6e-4cb0-8df7-65862e2adb35 tempest-ProjectMemberTests-538781697 None] Creating volume fe920575-fb85-4f83-9d1c-84791262bc0c {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:38:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a15c0ac3-fb6e-4cb0-8df7-65862e2adb35 tempest-ProjectMemberTests-538781697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a15c0ac3-fb6e-4cb0-8df7-65862e2adb35 tempest-ProjectMemberTests-538781697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:31 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a15c0ac3-fb6e-4cb0-8df7-65862e2adb35 tempest-ProjectMemberTests-538781697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:31 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a15c0ac3-fb6e-4cb0-8df7-65862e2adb35 tempest-ProjectMemberTests-538781697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a15c0ac3-fb6e-4cb0-8df7-65862e2adb35 tempest-ProjectMemberTests-538781697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:31 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a15c0ac3-fb6e-4cb0-8df7-65862e2adb35 tempest-ProjectMemberTests-538781697 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:38:31 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-a15c0ac3-fb6e-4cb0-8df7-65862e2adb35 tempest-ProjectMemberTests-538781697 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:38:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a15c0ac3-fb6e-4cb0-8df7-65862e2adb35 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fe920575-fb85-4f83-9d1c-84791262bc0c 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:31 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-22053ccd-554f-47c3-b5ec-a6227b504b69 tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ab7029f6-c490-4516-8b21-c8384c07980f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c3533648-3a71-4727-b081-aef13dcb4ad1', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:31 devstack sudo[105430]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fe920575-fb85-4f83-9d1c-84791262bc0c 1073741824 Nov 01 12:38:31 devstack sudo[105430]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:31 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-22053ccd-554f-47c3-b5ec-a6227b504b69 tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44147c7d-ecb4-4204-a8ef-ed916b1fe343) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:31 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-22053ccd-554f-47c3-b5ec-a6227b504b69 tempest-CreateVolumesFromImageTest-2025437841 None] Volume volume-c3533648-3a71-4727-b081-aef13dcb4ad1 (c3533648-3a71-4727-b081-aef13dcb4ad1): created successfully Nov 01 12:38:31 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-22053ccd-554f-47c3-b5ec-a6227b504b69 tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (44147c7d-ecb4-4204-a8ef-ed916b1fe343) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:31 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-22053ccd-554f-47c3-b5ec-a6227b504b69 tempest-CreateVolumesFromImageTest-2025437841 None] Flow 'volume_create_manager' (1091b3c1-cfb7-4e9e-b7f1-06f7a97ac0cc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:31 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-22053ccd-554f-47c3-b5ec-a6227b504b69 tempest-CreateVolumesFromImageTest-2025437841 None] Created volume successfully. Nov 01 12:38:32 devstack sudo[105430]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a15c0ac3-fb6e-4cb0-8df7-65862e2adb35 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fe920575-fb85-4f83-9d1c-84791262bc0c 1073741824" returned: 0 in 0.478s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a15c0ac3-fb6e-4cb0-8df7-65862e2adb35 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fe920575-fb85-4f83-9d1c-84791262bc0c {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:32 devstack sudo[105435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fe920575-fb85-4f83-9d1c-84791262bc0c Nov 01 12:38:32 devstack sudo[105435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:32 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:38:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Flow 'volume_create_manager' (e21f2854-0933-4977-ac2c-ba73a8888f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8153c70-6976-4227-86a6-bc2f545d24ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e8153c70-6976-4227-86a6-bc2f545d24ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2f9cbc1-de9b-4e04-a841-0988f294bccd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='428dbead44be4ddeb2ac477dd0fba469',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:32Z,use_quota=True,user_id='da3f3cfff9824e5b9529eb23c867f9f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b889b74-1db6-4ebf-9d8a-25c5ea5d2d77),volume_type_id=8b889b74-1db6-4ebf-9d8a-25c5ea5d2d77)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d85de5fb-ecda-4560-8e9f-1bba1be1ddc6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d85de5fb-ecda-4560-8e9f-1bba1be1ddc6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bab68239-639d-4081-ba94-8ef65bf5b889) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:32 devstack cinder-volume[86574]: DEBUG cinder.image.glance [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Creating Keystone auth plugin from conf {{(pid=86574) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 01 12:38:32 devstack sudo[105435]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a15c0ac3-fb6e-4cb0-8df7-65862e2adb35 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fe920575-fb85-4f83-9d1c-84791262bc0c" returned: 0 in 0.272s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:32 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a15c0ac3-fb6e-4cb0-8df7-65862e2adb35 tempest-ProjectMemberTests-538781697 None] <== create_volume: return (794ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:38:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a15c0ac3-fb6e-4cb0-8df7-65862e2adb35 tempest-ProjectMemberTests-538781697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5a1d3e59-5b2d-4190-93cb-8e98cc521b9a tempest-CreateVolumesFromImageTest-2025437841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.396s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:32 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-5a1d3e59-5b2d-4190-93cb-8e98cc521b9a tempest-CreateVolumesFromImageTest-2025437841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1491397416',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bd8b7f41-6a3b-41be-866f-5ae4968519a2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='301a72a01b884475a5c7fd38783f1cb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:30Z,use_quota=True,user_id='07cc99f4ff7e4b7db2c0865c49ed2d8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:38:32 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-5a1d3e59-5b2d-4190-93cb-8e98cc521b9a tempest-CreateVolumesFromImageTest-2025437841 None] Creating volume bd8b7f41-6a3b-41be-866f-5ae4968519a2 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:38:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5a1d3e59-5b2d-4190-93cb-8e98cc521b9a tempest-CreateVolumesFromImageTest-2025437841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5a1d3e59-5b2d-4190-93cb-8e98cc521b9a tempest-CreateVolumesFromImageTest-2025437841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:32 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-5a1d3e59-5b2d-4190-93cb-8e98cc521b9a tempest-CreateVolumesFromImageTest-2025437841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:32 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-5a1d3e59-5b2d-4190-93cb-8e98cc521b9a tempest-CreateVolumesFromImageTest-2025437841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5a1d3e59-5b2d-4190-93cb-8e98cc521b9a tempest-CreateVolumesFromImageTest-2025437841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:32 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-5a1d3e59-5b2d-4190-93cb-8e98cc521b9a tempest-CreateVolumesFromImageTest-2025437841 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:38:32 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-5a1d3e59-5b2d-4190-93cb-8e98cc521b9a tempest-CreateVolumesFromImageTest-2025437841 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:38:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5a1d3e59-5b2d-4190-93cb-8e98cc521b9a tempest-CreateVolumesFromImageTest-2025437841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-bd8b7f41-6a3b-41be-866f-5ae4968519a2 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a15c0ac3-fb6e-4cb0-8df7-65862e2adb35 tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39a082a5-3bde-4c89-ac9e-37ed19db65a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fe920575-fb85-4f83-9d1c-84791262bc0c', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a15c0ac3-fb6e-4cb0-8df7-65862e2adb35 tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (043ec3da-f311-48fd-8d42-f3ffa28be88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:32 devstack sudo[105438]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-bd8b7f41-6a3b-41be-866f-5ae4968519a2 1073741824 Nov 01 12:38:32 devstack sudo[105438]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:32 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-a15c0ac3-fb6e-4cb0-8df7-65862e2adb35 tempest-ProjectMemberTests-538781697 None] Volume volume-fe920575-fb85-4f83-9d1c-84791262bc0c (fe920575-fb85-4f83-9d1c-84791262bc0c): created successfully Nov 01 12:38:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a15c0ac3-fb6e-4cb0-8df7-65862e2adb35 tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (043ec3da-f311-48fd-8d42-f3ffa28be88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a15c0ac3-fb6e-4cb0-8df7-65862e2adb35 tempest-ProjectMemberTests-538781697 None] Flow 'volume_create_manager' (4fc2ef8c-8d77-40c2-b9df-9d9e4da0fa07) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:32 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-a15c0ac3-fb6e-4cb0-8df7-65862e2adb35 tempest-ProjectMemberTests-538781697 None] Created volume successfully. Nov 01 12:38:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bab68239-639d-4081-ba94-8ef65bf5b889) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'a2f9cbc1-de9b-4e04-a841-0988f294bccd', 'volume_name': 'volume-a2f9cbc1-de9b-4e04-a841-0988f294bccd', 'volume_size': 1, 'image_id': 'b924798c-681b-448c-a8c8-d09879ea3769', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b924798c-681b-448c-a8c8-d09879ea3769', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ceaeb4044928abd10be52a51ad01c278', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '428dbead44be4ddeb2ac477dd0fba469', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4557c6a059b5572159cd5257a48283d6eed7350824b5ad17257ceb932a51e6205c2dd51fd6fd1843c28bac82249f21ec88536a6c586c4480c1b05e52a7f4c5bc', 'id': 'b924798c-681b-448c-a8c8-d09879ea3769', 'created_at': datetime.datetime(2026, 11, 1, 11, 38, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 38, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b924798c-681b-448c-a8c8-d09879ea3769/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (839a5591-ccba-4e3f-ab48-d9e03001814f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (839a5591-ccba-4e3f-ab48-d9e03001814f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d8ec0e7-8a97-42fb-ae45-888a01a03938) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:32 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Volume a2f9cbc1-de9b-4e04-a841-0988f294bccd: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-a2f9cbc1-de9b-4e04-a841-0988f294bccd', 'volume_size': 1, 'image_id': 'b924798c-681b-448c-a8c8-d09879ea3769', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b924798c-681b-448c-a8c8-d09879ea3769', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ceaeb4044928abd10be52a51ad01c278', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '428dbead44be4ddeb2ac477dd0fba469', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4557c6a059b5572159cd5257a48283d6eed7350824b5ad17257ceb932a51e6205c2dd51fd6fd1843c28bac82249f21ec88536a6c586c4480c1b05e52a7f4c5bc', 'id': 'b924798c-681b-448c-a8c8-d09879ea3769', 'created_at': datetime.datetime(2026, 11, 1, 11, 38, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 38, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b924798c-681b-448c-a8c8-d09879ea3769/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': } Nov 01 12:38:32 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Trying to clone a2f9cbc1-de9b-4e04-a841-0988f294bccd from image b924798c-681b-448c-a8c8-d09879ea3769 at location (None, [{'url': 'file:///opt/stack/data/glance/images/b924798c-681b-448c-a8c8-d09879ea3769', 'metadata': {}}]). {{(pid=86574) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 01 12:38:32 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_b924798c-681b-448c-a8c8-d09879ea3769_zph3ic0kdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86574) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 01 12:38:32 devstack cinder-volume[86574]: INFO cinder.image.image_utils [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Image download 0.00 MB at 0.00 MB/s Nov 01 12:38:32 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[b816e519-f1bb-4b8a-9207-5b810005b503]: (4, 'raw') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b924798c-681b-448c-a8c8-d09879ea3769_zph3ic0kdevstack@QuobyteHD {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:32 devstack sudo[105438]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5a1d3e59-5b2d-4190-93cb-8e98cc521b9a tempest-CreateVolumesFromImageTest-2025437841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-bd8b7f41-6a3b-41be-866f-5ae4968519a2 1073741824" returned: 0 in 0.466s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:32 devstack sudo[105444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b924798c-681b-448c-a8c8-d09879ea3769_zph3ic0kdevstack@QuobyteHD Nov 01 12:38:32 devstack sudo[105444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5a1d3e59-5b2d-4190-93cb-8e98cc521b9a tempest-CreateVolumesFromImageTest-2025437841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-bd8b7f41-6a3b-41be-866f-5ae4968519a2 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:32 devstack sudo[105446]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-bd8b7f41-6a3b-41be-866f-5ae4968519a2 Nov 01 12:38:32 devstack sudo[105446]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:33 devstack sudo[105444]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b924798c-681b-448c-a8c8-d09879ea3769_zph3ic0kdevstack@QuobyteHD" returned: 0 in 0.334s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b924798c-681b-448c-a8c8-d09879ea3769_zph3ic0kdevstack@QuobyteHD {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:33 devstack sudo[105446]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5a1d3e59-5b2d-4190-93cb-8e98cc521b9a tempest-CreateVolumesFromImageTest-2025437841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-bd8b7f41-6a3b-41be-866f-5ae4968519a2" returned: 0 in 0.249s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:33 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-5a1d3e59-5b2d-4190-93cb-8e98cc521b9a tempest-CreateVolumesFromImageTest-2025437841 None] <== create_volume: return (763ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:38:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5a1d3e59-5b2d-4190-93cb-8e98cc521b9a tempest-CreateVolumesFromImageTest-2025437841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-c05f431e-b971-4183-a539-8c3bf2df805e tempest-CreateVolumesFromImageTest-2025437841 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.019s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:33 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-c05f431e-b971-4183-a539-8c3bf2df805e tempest-CreateVolumesFromImageTest-2025437841 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1980689021',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b1eaf1a5-3937-44e5-918f-ad8ce49c9d89,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='301a72a01b884475a5c7fd38783f1cb6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:30Z,use_quota=True,user_id='07cc99f4ff7e4b7db2c0865c49ed2d8b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:38:33 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-c05f431e-b971-4183-a539-8c3bf2df805e tempest-CreateVolumesFromImageTest-2025437841 None] Creating volume b1eaf1a5-3937-44e5-918f-ad8ce49c9d89 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:38:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-c05f431e-b971-4183-a539-8c3bf2df805e tempest-CreateVolumesFromImageTest-2025437841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-c05f431e-b971-4183-a539-8c3bf2df805e tempest-CreateVolumesFromImageTest-2025437841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:33 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-c05f431e-b971-4183-a539-8c3bf2df805e tempest-CreateVolumesFromImageTest-2025437841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:33 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-c05f431e-b971-4183-a539-8c3bf2df805e tempest-CreateVolumesFromImageTest-2025437841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-c05f431e-b971-4183-a539-8c3bf2df805e tempest-CreateVolumesFromImageTest-2025437841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:33 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-c05f431e-b971-4183-a539-8c3bf2df805e tempest-CreateVolumesFromImageTest-2025437841 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:38:33 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-c05f431e-b971-4183-a539-8c3bf2df805e tempest-CreateVolumesFromImageTest-2025437841 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:38:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c05f431e-b971-4183-a539-8c3bf2df805e tempest-CreateVolumesFromImageTest-2025437841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b1eaf1a5-3937-44e5-918f-ad8ce49c9d89 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:33 devstack sudo[105450]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b924798c-681b-448c-a8c8-d09879ea3769_zph3ic0kdevstack@QuobyteHD Nov 01 12:38:33 devstack sudo[105450]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:33 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5a1d3e59-5b2d-4190-93cb-8e98cc521b9a tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a224d751-8232-4266-b54c-fdabede427a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bd8b7f41-6a3b-41be-866f-5ae4968519a2', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:33 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5a1d3e59-5b2d-4190-93cb-8e98cc521b9a tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (614b70ce-8879-4371-b190-99d5864357aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:33 devstack sudo[105452]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b1eaf1a5-3937-44e5-918f-ad8ce49c9d89 1073741824 Nov 01 12:38:33 devstack sudo[105452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:33 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-5a1d3e59-5b2d-4190-93cb-8e98cc521b9a tempest-CreateVolumesFromImageTest-2025437841 None] Volume volume-bd8b7f41-6a3b-41be-866f-5ae4968519a2 (bd8b7f41-6a3b-41be-866f-5ae4968519a2): created successfully Nov 01 12:38:33 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5a1d3e59-5b2d-4190-93cb-8e98cc521b9a tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (614b70ce-8879-4371-b190-99d5864357aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:33 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5a1d3e59-5b2d-4190-93cb-8e98cc521b9a tempest-CreateVolumesFromImageTest-2025437841 None] Flow 'volume_create_manager' (4ab41de8-aac5-41f7-92cd-f2cc26fa34c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:33 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-5a1d3e59-5b2d-4190-93cb-8e98cc521b9a tempest-CreateVolumesFromImageTest-2025437841 None] Created volume successfully. Nov 01 12:38:33 devstack sudo[105450]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b924798c-681b-448c-a8c8-d09879ea3769_zph3ic0kdevstack@QuobyteHD" returned: 1 in 0.352s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b924798c-681b-448c-a8c8-d09879ea3769_zph3ic0kdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 12:38:33 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Temporary image b924798c-681b-448c-a8c8-d09879ea3769 is fetched for user da3f3cfff9824e5b9529eb23c867f9f2. {{(pid=86574) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 01 12:38:33 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[11f27873-e2db-4491-b002-660dae05aa50]: (4, 'raw') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b924798c-681b-448c-a8c8-d09879ea3769_zph3ic0kdevstack@QuobyteHD {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:33 devstack sudo[105461]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b924798c-681b-448c-a8c8-d09879ea3769_zph3ic0kdevstack@QuobyteHD Nov 01 12:38:33 devstack sudo[105461]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:33 devstack sudo[105452]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c05f431e-b971-4183-a539-8c3bf2df805e tempest-CreateVolumesFromImageTest-2025437841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b1eaf1a5-3937-44e5-918f-ad8ce49c9d89 1073741824" returned: 0 in 0.584s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ac38c68a-a93d-4a20-884f-215ea8ac9f7c tempest-ProjectMemberTests-538781697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c05f431e-b971-4183-a539-8c3bf2df805e tempest-CreateVolumesFromImageTest-2025437841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b1eaf1a5-3937-44e5-918f-ad8ce49c9d89 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:33 devstack sudo[105464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b1eaf1a5-3937-44e5-918f-ad8ce49c9d89 Nov 01 12:38:33 devstack sudo[105464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:33 devstack sudo[105461]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b924798c-681b-448c-a8c8-d09879ea3769_zph3ic0kdevstack@QuobyteHD" returned: 0 in 0.373s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b924798c-681b-448c-a8c8-d09879ea3769_zph3ic0kdevstack@QuobyteHD {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:34 devstack sudo[105468]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b924798c-681b-448c-a8c8-d09879ea3769_zph3ic0kdevstack@QuobyteHD Nov 01 12:38:34 devstack sudo[105468]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:34 devstack sudo[105464]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c05f431e-b971-4183-a539-8c3bf2df805e tempest-CreateVolumesFromImageTest-2025437841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b1eaf1a5-3937-44e5-918f-ad8ce49c9d89" returned: 0 in 0.254s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:34 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-c05f431e-b971-4183-a539-8c3bf2df805e tempest-CreateVolumesFromImageTest-2025437841 None] <== create_volume: return (890ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:38:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-c05f431e-b971-4183-a539-8c3bf2df805e tempest-CreateVolumesFromImageTest-2025437841 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.894s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-7e57d8e1-e07c-45a2-9165-325e22584e7d tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 3.658s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:34 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c05f431e-b971-4183-a539-8c3bf2df805e tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1df36bb7-e64d-45a3-a698-bd831b78fa6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1eaf1a5-3937-44e5-918f-ad8ce49c9d89', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:34 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c05f431e-b971-4183-a539-8c3bf2df805e tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a56b21b3-2182-4f6c-9042-5911a5a0e8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:34 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-7e57d8e1-e07c-45a2-9165-325e22584e7d tempest-CreateVolumesFromSnapshotTest-1885067804 None] Creating offline snapshot 2d8a610f-abb4-4c08-bec4-4b8ef3fe2438 of volume 4462cbed-00df-479c-9a1c-8815f802555c {{(pid=86574) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:38:34 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-c05f431e-b971-4183-a539-8c3bf2df805e tempest-CreateVolumesFromImageTest-2025437841 None] Volume volume-b1eaf1a5-3937-44e5-918f-ad8ce49c9d89 (b1eaf1a5-3937-44e5-918f-ad8ce49c9d89): created successfully Nov 01 12:38:34 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c05f431e-b971-4183-a539-8c3bf2df805e tempest-CreateVolumesFromImageTest-2025437841 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a56b21b3-2182-4f6c-9042-5911a5a0e8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:34 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c05f431e-b971-4183-a539-8c3bf2df805e tempest-CreateVolumesFromImageTest-2025437841 None] Flow 'volume_create_manager' (2ac57db0-c069-4678-baa9-603ca2caaee6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:34 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[81242cab-05c7-4c1c-95e8-765028cfef5c]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7e57d8e1-e07c-45a2-9165-325e22584e7d tempest-CreateVolumesFromSnapshotTest-1885067804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4462cbed-00df-479c-9a1c-8815f802555c {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:34 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-c05f431e-b971-4183-a539-8c3bf2df805e tempest-CreateVolumesFromImageTest-2025437841 None] Created volume successfully. Nov 01 12:38:34 devstack sudo[105471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4462cbed-00df-479c-9a1c-8815f802555c Nov 01 12:38:34 devstack sudo[105471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:34 devstack sudo[105468]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b924798c-681b-448c-a8c8-d09879ea3769_zph3ic0kdevstack@QuobyteHD" returned: 1 in 0.354s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b924798c-681b-448c-a8c8-d09879ea3769_zph3ic0kdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 12:38:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:34 devstack sudo[105471]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7e57d8e1-e07c-45a2-9165-325e22584e7d tempest-CreateVolumesFromSnapshotTest-1885067804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4462cbed-00df-479c-9a1c-8815f802555c" returned: 0 in 0.366s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7e57d8e1-e07c-45a2-9165-325e22584e7d tempest-CreateVolumesFromSnapshotTest-1885067804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4462cbed-00df-479c-9a1c-8815f802555c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4462cbed-00df-479c-9a1c-8815f802555c.2d8a610f-abb4-4c08-bec4-4b8ef3fe2438 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:34 devstack sudo[105479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4462cbed-00df-479c-9a1c-8815f802555c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4462cbed-00df-479c-9a1c-8815f802555c.2d8a610f-abb4-4c08-bec4-4b8ef3fe2438 1G Nov 01 12:38:34 devstack sudo[105479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:34 devstack sudo[105479]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7e57d8e1-e07c-45a2-9165-325e22584e7d tempest-CreateVolumesFromSnapshotTest-1885067804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4462cbed-00df-479c-9a1c-8815f802555c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4462cbed-00df-479c-9a1c-8815f802555c.2d8a610f-abb4-4c08-bec4-4b8ef3fe2438 1G" returned: 0 in 0.383s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7e57d8e1-e07c-45a2-9165-325e22584e7d tempest-CreateVolumesFromSnapshotTest-1885067804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4462cbed-00df-479c-9a1c-8815f802555c -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4462cbed-00df-479c-9a1c-8815f802555c.2d8a610f-abb4-4c08-bec4-4b8ef3fe2438 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:34 devstack sudo[105485]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4462cbed-00df-479c-9a1c-8815f802555c -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4462cbed-00df-479c-9a1c-8815f802555c.2d8a610f-abb4-4c08-bec4-4b8ef3fe2438 Nov 01 12:38:34 devstack sudo[105485]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:35 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e246dce7-9e3c-4a80-a0fc-836a205494b9 tempest-CreateVolumesFromImageTest-2025437841 None] Acquiring lock "cinder-b1eaf1a5-3937-44e5-918f-ad8ce49c9d89-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:35 devstack sudo[105485]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7e57d8e1-e07c-45a2-9165-325e22584e7d tempest-CreateVolumesFromSnapshotTest-1885067804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-4462cbed-00df-479c-9a1c-8815f802555c -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4462cbed-00df-479c-9a1c-8815f802555c.2d8a610f-abb4-4c08-bec4-4b8ef3fe2438" returned: 0 in 0.313s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:35 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-7e57d8e1-e07c-45a2-9165-325e22584e7d tempest-CreateVolumesFromSnapshotTest-1885067804 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4462cbed-00df-479c-9a1c-8815f802555c.2d8a610f-abb4-4c08-bec4-4b8ef3fe2438 is being set with open permissions: ugo+rw Nov 01 12:38:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7e57d8e1-e07c-45a2-9165-325e22584e7d tempest-CreateVolumesFromSnapshotTest-1885067804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4462cbed-00df-479c-9a1c-8815f802555c.2d8a610f-abb4-4c08-bec4-4b8ef3fe2438 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:35 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e246dce7-9e3c-4a80-a0fc-836a205494b9 tempest-CreateVolumesFromImageTest-2025437841 None] Lock "cinder-b1eaf1a5-3937-44e5-918f-ad8ce49c9d89-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:35 devstack sudo[105490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4462cbed-00df-479c-9a1c-8815f802555c.2d8a610f-abb4-4c08-bec4-4b8ef3fe2438 Nov 01 12:38:35 devstack sudo[105490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:35 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e246dce7-9e3c-4a80-a0fc-836a205494b9 tempest-CreateVolumesFromImageTest-2025437841 None] Acquiring lock "cinder-quobyte-b1eaf1a5-3937-44e5-918f-ad8ce49c9d89" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:35 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e246dce7-9e3c-4a80-a0fc-836a205494b9 tempest-CreateVolumesFromImageTest-2025437841 None] Lock "cinder-quobyte-b1eaf1a5-3937-44e5-918f-ad8ce49c9d89" acquired by "delete_volume" :: waited 0.016s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:35 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[f50f6e86-a403-49f8-8de1-67e4f65a0c7c]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e246dce7-9e3c-4a80-a0fc-836a205494b9 tempest-CreateVolumesFromImageTest-2025437841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b1eaf1a5-3937-44e5-918f-ad8ce49c9d89 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:35 devstack sudo[105492]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b1eaf1a5-3937-44e5-918f-ad8ce49c9d89 Nov 01 12:38:35 devstack sudo[105492]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:35 devstack sudo[105490]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7e57d8e1-e07c-45a2-9165-325e22584e7d tempest-CreateVolumesFromSnapshotTest-1885067804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4462cbed-00df-479c-9a1c-8815f802555c.2d8a610f-abb4-4c08-bec4-4b8ef3fe2438" returned: 0 in 0.270s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7e57d8e1-e07c-45a2-9165-325e22584e7d tempest-CreateVolumesFromSnapshotTest-1885067804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4462cbed-00df-479c-9a1c-8815f802555c.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:35 devstack sudo[105495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4462cbed-00df-479c-9a1c-8815f802555c.info Nov 01 12:38:35 devstack sudo[105495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:35 devstack sudo[105492]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e246dce7-9e3c-4a80-a0fc-836a205494b9 tempest-CreateVolumesFromImageTest-2025437841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b1eaf1a5-3937-44e5-918f-ad8ce49c9d89" returned: 0 in 0.393s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e246dce7-9e3c-4a80-a0fc-836a205494b9 tempest-CreateVolumesFromImageTest-2025437841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b1eaf1a5-3937-44e5-918f-ad8ce49c9d89 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:35 devstack sudo[105500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b1eaf1a5-3937-44e5-918f-ad8ce49c9d89 Nov 01 12:38:35 devstack sudo[105500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:35 devstack sudo[105495]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7e57d8e1-e07c-45a2-9165-325e22584e7d tempest-CreateVolumesFromSnapshotTest-1885067804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4462cbed-00df-479c-9a1c-8815f802555c.info" returned: 0 in 0.278s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:35 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-7e57d8e1-e07c-45a2-9165-325e22584e7d tempest-CreateVolumesFromSnapshotTest-1885067804 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4462cbed-00df-479c-9a1c-8815f802555c.info is being set with open permissions: ugo+rw Nov 01 12:38:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7e57d8e1-e07c-45a2-9165-325e22584e7d tempest-CreateVolumesFromSnapshotTest-1885067804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4462cbed-00df-479c-9a1c-8815f802555c.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:35 devstack sudo[105503]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4462cbed-00df-479c-9a1c-8815f802555c.info Nov 01 12:38:35 devstack sudo[105503]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:35 devstack sudo[105500]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e246dce7-9e3c-4a80-a0fc-836a205494b9 tempest-CreateVolumesFromImageTest-2025437841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b1eaf1a5-3937-44e5-918f-ad8ce49c9d89" returned: 0 in 0.267s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:35 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e246dce7-9e3c-4a80-a0fc-836a205494b9 tempest-CreateVolumesFromImageTest-2025437841 None] Lock "cinder-quobyte-b1eaf1a5-3937-44e5-918f-ad8ce49c9d89" released by "delete_volume" :: held 0.704s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:35 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-e246dce7-9e3c-4a80-a0fc-836a205494b9 tempest-CreateVolumesFromImageTest-2025437841 None] Created reservations ['8c4bc269-aef5-455e-8954-79c8c67d67f3', '6fa7c23f-0cd4-48b9-9f0a-2acf9cedd17e', '25bf6e83-15d2-40bf-881b-cec62f42fa00', '5be289e9-428e-4c01-96dd-363aa7f40b48'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:38:36 devstack sudo[105503]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7e57d8e1-e07c-45a2-9165-325e22584e7d tempest-CreateVolumesFromSnapshotTest-1885067804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4462cbed-00df-479c-9a1c-8815f802555c.info" returned: 0 in 0.266s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-7e57d8e1-e07c-45a2-9165-325e22584e7d tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.003s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ac38c68a-a93d-4a20-884f-215ea8ac9f7c tempest-ProjectMemberTests-538781697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.272s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:36 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-ac38c68a-a93d-4a20-884f-215ea8ac9f7c tempest-ProjectMemberTests-538781697 None] Creating offline snapshot 12352992-e0b5-4360-8a32-3f9036597706 of volume fe920575-fb85-4f83-9d1c-84791262bc0c {{(pid=86574) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:38:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e246dce7-9e3c-4a80-a0fc-836a205494b9 tempest-CreateVolumesFromImageTest-2025437841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e246dce7-9e3c-4a80-a0fc-836a205494b9 tempest-CreateVolumesFromImageTest-2025437841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:36 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e246dce7-9e3c-4a80-a0fc-836a205494b9 tempest-CreateVolumesFromImageTest-2025437841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:36 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e246dce7-9e3c-4a80-a0fc-836a205494b9 tempest-CreateVolumesFromImageTest-2025437841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e246dce7-9e3c-4a80-a0fc-836a205494b9 tempest-CreateVolumesFromImageTest-2025437841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e246dce7-9e3c-4a80-a0fc-836a205494b9 tempest-CreateVolumesFromImageTest-2025437841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:36 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[bee5a874-436c-4503-b198-3cb0daf7eac8]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ac38c68a-a93d-4a20-884f-215ea8ac9f7c tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fe920575-fb85-4f83-9d1c-84791262bc0c {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:36 devstack sudo[105507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:38:36 devstack sudo[105507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:36 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-7e57d8e1-e07c-45a2-9165-325e22584e7d tempest-CreateVolumesFromSnapshotTest-1885067804 None] Create snapshot completed successfully Nov 01 12:38:36 devstack sudo[105508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fe920575-fb85-4f83-9d1c-84791262bc0c Nov 01 12:38:36 devstack sudo[105508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:36 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-19a7560b-d58c-42af-9e99-81620e0eee89 tempest-CreateVolumesFromImageTest-2025437841 None] Acquiring lock "cinder-bd8b7f41-6a3b-41be-866f-5ae4968519a2-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:36 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-19a7560b-d58c-42af-9e99-81620e0eee89 tempest-CreateVolumesFromImageTest-2025437841 None] Lock "cinder-bd8b7f41-6a3b-41be-866f-5ae4968519a2-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:36 devstack sudo[105507]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e246dce7-9e3c-4a80-a0fc-836a205494b9 tempest-CreateVolumesFromImageTest-2025437841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.300s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:36 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-e246dce7-9e3c-4a80-a0fc-836a205494b9 tempest-CreateVolumesFromImageTest-2025437841 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:38:36 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-e246dce7-9e3c-4a80-a0fc-836a205494b9 tempest-CreateVolumesFromImageTest-2025437841 None] Deleted volume successfully. Nov 01 12:38:36 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e246dce7-9e3c-4a80-a0fc-836a205494b9 tempest-CreateVolumesFromImageTest-2025437841 None] Lock "cinder-b1eaf1a5-3937-44e5-918f-ad8ce49c9d89-delete_volume" released by "delete_volume" :: held 1.269s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:36 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-19a7560b-d58c-42af-9e99-81620e0eee89 tempest-CreateVolumesFromImageTest-2025437841 None] Acquiring lock "cinder-quobyte-bd8b7f41-6a3b-41be-866f-5ae4968519a2" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:36 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-19a7560b-d58c-42af-9e99-81620e0eee89 tempest-CreateVolumesFromImageTest-2025437841 None] Lock "cinder-quobyte-bd8b7f41-6a3b-41be-866f-5ae4968519a2" acquired by "delete_volume" :: waited 0.017s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:36 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[6b4b12a6-4d8b-416b-b42e-7b19b409f672]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19a7560b-d58c-42af-9e99-81620e0eee89 tempest-CreateVolumesFromImageTest-2025437841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-bd8b7f41-6a3b-41be-866f-5ae4968519a2 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:36 devstack sudo[105508]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ac38c68a-a93d-4a20-884f-215ea8ac9f7c tempest-ProjectMemberTests-538781697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fe920575-fb85-4f83-9d1c-84791262bc0c" returned: 0 in 0.444s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ac38c68a-a93d-4a20-884f-215ea8ac9f7c tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fe920575-fb85-4f83-9d1c-84791262bc0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fe920575-fb85-4f83-9d1c-84791262bc0c.12352992-e0b5-4360-8a32-3f9036597706 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:36 devstack sudo[105516]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fe920575-fb85-4f83-9d1c-84791262bc0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fe920575-fb85-4f83-9d1c-84791262bc0c.12352992-e0b5-4360-8a32-3f9036597706 1G Nov 01 12:38:36 devstack sudo[105516]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:36 devstack sudo[105515]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-bd8b7f41-6a3b-41be-866f-5ae4968519a2 Nov 01 12:38:36 devstack sudo[105515]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:36 devstack sudo[105515]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19a7560b-d58c-42af-9e99-81620e0eee89 tempest-CreateVolumesFromImageTest-2025437841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-bd8b7f41-6a3b-41be-866f-5ae4968519a2" returned: 0 in 0.408s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19a7560b-d58c-42af-9e99-81620e0eee89 tempest-CreateVolumesFromImageTest-2025437841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-bd8b7f41-6a3b-41be-866f-5ae4968519a2 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:36 devstack sudo[105526]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-bd8b7f41-6a3b-41be-866f-5ae4968519a2 Nov 01 12:38:36 devstack sudo[105526]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:37 devstack sudo[105516]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ac38c68a-a93d-4a20-884f-215ea8ac9f7c tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fe920575-fb85-4f83-9d1c-84791262bc0c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fe920575-fb85-4f83-9d1c-84791262bc0c.12352992-e0b5-4360-8a32-3f9036597706 1G" returned: 0 in 0.548s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ac38c68a-a93d-4a20-884f-215ea8ac9f7c tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe920575-fb85-4f83-9d1c-84791262bc0c -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fe920575-fb85-4f83-9d1c-84791262bc0c.12352992-e0b5-4360-8a32-3f9036597706 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:37 devstack sudo[105529]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe920575-fb85-4f83-9d1c-84791262bc0c -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fe920575-fb85-4f83-9d1c-84791262bc0c.12352992-e0b5-4360-8a32-3f9036597706 Nov 01 12:38:37 devstack sudo[105529]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:37 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-1470cdd6-c730-4d69-ab0c-b98eeee66dd6 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:38:37 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-1470cdd6-c730-4d69-ab0c-b98eeee66dd6 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Flow 'volume_create_manager' (97909b8a-7635-4de5-9ce2-54b0e2aa228a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:37 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-1470cdd6-c730-4d69-ab0c-b98eeee66dd6 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81ed0df5-d23e-4fba-9c4d-7c3e70cbddec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:37 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-1470cdd6-c730-4d69-ab0c-b98eeee66dd6 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (81ed0df5-d23e-4fba-9c4d-7c3e70cbddec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1299207954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19dcb9b7-770e-43e7-9ab5-9b11cea0cc52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9c934deca6c4332885263dd4cb83dfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:37Z,use_quota=True,user_id='362ff3df17dc46c7bf4bfaacc9db7290',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:37 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-1470cdd6-c730-4d69-ab0c-b98eeee66dd6 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7865ec0c-e0a1-4fd0-a322-c39d9dfe3849) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:37 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-1470cdd6-c730-4d69-ab0c-b98eeee66dd6 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7865ec0c-e0a1-4fd0-a322-c39d9dfe3849) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:37 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-1470cdd6-c730-4d69-ab0c-b98eeee66dd6 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0774f550-9a66-46de-bff9-a980a5c4ad46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:37 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-1470cdd6-c730-4d69-ab0c-b98eeee66dd6 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0774f550-9a66-46de-bff9-a980a5c4ad46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19dcb9b7-770e-43e7-9ab5-9b11cea0cc52', 'volume_name': 'volume-19dcb9b7-770e-43e7-9ab5-9b11cea0cc52', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:37 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-1470cdd6-c730-4d69-ab0c-b98eeee66dd6 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22936dd1-0b00-4e58-a07a-7e672335e7f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:37 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-1470cdd6-c730-4d69-ab0c-b98eeee66dd6 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (22936dd1-0b00-4e58-a07a-7e672335e7f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:37 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-1470cdd6-c730-4d69-ab0c-b98eeee66dd6 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c23ff0e9-0538-4c7b-a35b-d078c41d89d6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:37 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-1470cdd6-c730-4d69-ab0c-b98eeee66dd6 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Volume 19dcb9b7-770e-43e7-9ab5-9b11cea0cc52: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19dcb9b7-770e-43e7-9ab5-9b11cea0cc52', 'volume_size': 1} Nov 01 12:38:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-1470cdd6-c730-4d69-ab0c-b98eeee66dd6 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:37 devstack sudo[105526]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19a7560b-d58c-42af-9e99-81620e0eee89 tempest-CreateVolumesFromImageTest-2025437841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-bd8b7f41-6a3b-41be-866f-5ae4968519a2" returned: 0 in 0.342s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:37 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-19a7560b-d58c-42af-9e99-81620e0eee89 tempest-CreateVolumesFromImageTest-2025437841 None] Lock "cinder-quobyte-bd8b7f41-6a3b-41be-866f-5ae4968519a2" released by "delete_volume" :: held 0.795s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:37 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-19a7560b-d58c-42af-9e99-81620e0eee89 tempest-CreateVolumesFromImageTest-2025437841 None] Created reservations ['2c433126-6142-4061-bd92-491e96f3a19e', '11a063ba-21c9-4300-9964-974f30f9b4fc', 'a536d447-d244-41ea-b7e5-9a5d1d71c8a7', '2c996cc1-4585-4dc9-accf-87771e8b606d'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:38:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-19a7560b-d58c-42af-9e99-81620e0eee89 tempest-CreateVolumesFromImageTest-2025437841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-19a7560b-d58c-42af-9e99-81620e0eee89 tempest-CreateVolumesFromImageTest-2025437841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:37 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-19a7560b-d58c-42af-9e99-81620e0eee89 tempest-CreateVolumesFromImageTest-2025437841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:37 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-19a7560b-d58c-42af-9e99-81620e0eee89 tempest-CreateVolumesFromImageTest-2025437841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-19a7560b-d58c-42af-9e99-81620e0eee89 tempest-CreateVolumesFromImageTest-2025437841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19a7560b-d58c-42af-9e99-81620e0eee89 tempest-CreateVolumesFromImageTest-2025437841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:37 devstack sudo[105529]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ac38c68a-a93d-4a20-884f-215ea8ac9f7c tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fe920575-fb85-4f83-9d1c-84791262bc0c -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fe920575-fb85-4f83-9d1c-84791262bc0c.12352992-e0b5-4360-8a32-3f9036597706" returned: 0 in 0.493s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:37 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-ac38c68a-a93d-4a20-884f-215ea8ac9f7c tempest-ProjectMemberTests-538781697 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fe920575-fb85-4f83-9d1c-84791262bc0c.12352992-e0b5-4360-8a32-3f9036597706 is being set with open permissions: ugo+rw Nov 01 12:38:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ac38c68a-a93d-4a20-884f-215ea8ac9f7c tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fe920575-fb85-4f83-9d1c-84791262bc0c.12352992-e0b5-4360-8a32-3f9036597706 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:37 devstack sudo[105535]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:38:37 devstack sudo[105535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:37 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-69dbfcf7-7106-4074-9695-92c9bc65fadf tempest-CreateVolumesFromImageTest-2025437841 None] Acquiring lock "cinder-c3533648-3a71-4727-b081-aef13dcb4ad1-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:37 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-5298891b-376f-4397-af74-36979fe6a649 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:38:37 devstack sudo[105536]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fe920575-fb85-4f83-9d1c-84791262bc0c.12352992-e0b5-4360-8a32-3f9036597706 Nov 01 12:38:37 devstack sudo[105536]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:37 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5298891b-376f-4397-af74-36979fe6a649 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Flow 'volume_create_manager' (20890dc1-10d6-48f9-9ec5-d3afa0a57259) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:37 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5298891b-376f-4397-af74-36979fe6a649 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cdea6c4-693a-4c6f-860a-ad5554cddb03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:37 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5298891b-376f-4397-af74-36979fe6a649 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cdea6c4-693a-4c6f-860a-ad5554cddb03) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1996015005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6448a0ac-f896-45e2-b45f-8f0dafa28093,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9c934deca6c4332885263dd4cb83dfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:38Z,use_quota=True,user_id='362ff3df17dc46c7bf4bfaacc9db7290',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:37 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5298891b-376f-4397-af74-36979fe6a649 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7d27ac2-72c4-45b1-81cf-78ae7e13a013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:37 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5298891b-376f-4397-af74-36979fe6a649 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f7d27ac2-72c4-45b1-81cf-78ae7e13a013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:37 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5298891b-376f-4397-af74-36979fe6a649 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3a644fa-679a-4b3f-86dd-dbc46e250234) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:37 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5298891b-376f-4397-af74-36979fe6a649 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a3a644fa-679a-4b3f-86dd-dbc46e250234) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6448a0ac-f896-45e2-b45f-8f0dafa28093', 'volume_name': 'volume-6448a0ac-f896-45e2-b45f-8f0dafa28093', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:37 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5298891b-376f-4397-af74-36979fe6a649 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45c60d7f-92fb-46df-abd1-e799902369c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:37 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5298891b-376f-4397-af74-36979fe6a649 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (45c60d7f-92fb-46df-abd1-e799902369c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:37 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5298891b-376f-4397-af74-36979fe6a649 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8a586f5-35c6-4c35-acb6-ffdb44f7bbd4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:37 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-5298891b-376f-4397-af74-36979fe6a649 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Volume 6448a0ac-f896-45e2-b45f-8f0dafa28093: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6448a0ac-f896-45e2-b45f-8f0dafa28093', 'volume_size': 1} Nov 01 12:38:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5298891b-376f-4397-af74-36979fe6a649 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:37 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-69dbfcf7-7106-4074-9695-92c9bc65fadf tempest-CreateVolumesFromImageTest-2025437841 None] Lock "cinder-c3533648-3a71-4727-b081-aef13dcb4ad1-delete_volume" acquired by "delete_volume" :: waited 0.110s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:37 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-69dbfcf7-7106-4074-9695-92c9bc65fadf tempest-CreateVolumesFromImageTest-2025437841 None] Acquiring lock "cinder-quobyte-c3533648-3a71-4727-b081-aef13dcb4ad1" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:37 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-69dbfcf7-7106-4074-9695-92c9bc65fadf tempest-CreateVolumesFromImageTest-2025437841 None] Lock "cinder-quobyte-c3533648-3a71-4727-b081-aef13dcb4ad1" acquired by "delete_volume" :: waited 0.022s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:37 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[33314ff7-2299-4e3a-9ed2-0f9a35430cb0]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-69dbfcf7-7106-4074-9695-92c9bc65fadf tempest-CreateVolumesFromImageTest-2025437841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c3533648-3a71-4727-b081-aef13dcb4ad1 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:37 devstack sudo[105535]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-19a7560b-d58c-42af-9e99-81620e0eee89 tempest-CreateVolumesFromImageTest-2025437841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.331s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:37 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-19a7560b-d58c-42af-9e99-81620e0eee89 tempest-CreateVolumesFromImageTest-2025437841 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:38:37 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-19a7560b-d58c-42af-9e99-81620e0eee89 tempest-CreateVolumesFromImageTest-2025437841 None] Deleted volume successfully. Nov 01 12:38:37 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-19a7560b-d58c-42af-9e99-81620e0eee89 tempest-CreateVolumesFromImageTest-2025437841 None] Lock "cinder-bd8b7f41-6a3b-41be-866f-5ae4968519a2-delete_volume" released by "delete_volume" :: held 1.561s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:37 devstack sudo[105536]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ac38c68a-a93d-4a20-884f-215ea8ac9f7c tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fe920575-fb85-4f83-9d1c-84791262bc0c.12352992-e0b5-4360-8a32-3f9036597706" returned: 0 in 0.394s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:37 devstack sudo[105540]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c3533648-3a71-4727-b081-aef13dcb4ad1 Nov 01 12:38:37 devstack sudo[105540]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ac38c68a-a93d-4a20-884f-215ea8ac9f7c tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fe920575-fb85-4f83-9d1c-84791262bc0c.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:38 devstack sudo[105543]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fe920575-fb85-4f83-9d1c-84791262bc0c.info Nov 01 12:38:38 devstack sudo[105543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-a738b131-3978-4709-bba9-3e7d513ae156 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a738b131-3978-4709-bba9-3e7d513ae156 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Flow 'volume_create_manager' (cd8e477a-ca68-4b2c-ba63-e3785a61d49e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a738b131-3978-4709-bba9-3e7d513ae156 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6cd4945-7368-46ee-b29d-dab6707efc8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a738b131-3978-4709-bba9-3e7d513ae156 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6cd4945-7368-46ee-b29d-dab6707efc8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1272901376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=390756b0-2726-422f-b616-c1bcd6ec01b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9c934deca6c4332885263dd4cb83dfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:38Z,use_quota=True,user_id='362ff3df17dc46c7bf4bfaacc9db7290',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a738b131-3978-4709-bba9-3e7d513ae156 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91de86dc-03e1-4727-8a6b-4cc1d797f03d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a738b131-3978-4709-bba9-3e7d513ae156 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (91de86dc-03e1-4727-8a6b-4cc1d797f03d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a738b131-3978-4709-bba9-3e7d513ae156 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8067b79e-70f4-47a3-bf1b-6c605ff9fb96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a738b131-3978-4709-bba9-3e7d513ae156 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8067b79e-70f4-47a3-bf1b-6c605ff9fb96) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '390756b0-2726-422f-b616-c1bcd6ec01b9', 'volume_name': 'volume-390756b0-2726-422f-b616-c1bcd6ec01b9', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a738b131-3978-4709-bba9-3e7d513ae156 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ed2e7d0-ae1c-408e-ad05-2dd51f26ee9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a738b131-3978-4709-bba9-3e7d513ae156 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ed2e7d0-ae1c-408e-ad05-2dd51f26ee9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a738b131-3978-4709-bba9-3e7d513ae156 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc8e7540-a32a-43ec-a958-ff29956527ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:38 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-a738b131-3978-4709-bba9-3e7d513ae156 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Volume 390756b0-2726-422f-b616-c1bcd6ec01b9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-390756b0-2726-422f-b616-c1bcd6ec01b9', 'volume_size': 1} Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a738b131-3978-4709-bba9-3e7d513ae156 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:38 devstack sudo[105543]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ac38c68a-a93d-4a20-884f-215ea8ac9f7c tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fe920575-fb85-4f83-9d1c-84791262bc0c.info" returned: 0 in 0.334s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:38 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-ac38c68a-a93d-4a20-884f-215ea8ac9f7c tempest-ProjectMemberTests-538781697 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fe920575-fb85-4f83-9d1c-84791262bc0c.info is being set with open permissions: ugo+rw Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ac38c68a-a93d-4a20-884f-215ea8ac9f7c tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fe920575-fb85-4f83-9d1c-84791262bc0c.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:38 devstack sudo[105540]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-69dbfcf7-7106-4074-9695-92c9bc65fadf tempest-CreateVolumesFromImageTest-2025437841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c3533648-3a71-4727-b081-aef13dcb4ad1" returned: 0 in 0.516s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-69dbfcf7-7106-4074-9695-92c9bc65fadf tempest-CreateVolumesFromImageTest-2025437841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c3533648-3a71-4727-b081-aef13dcb4ad1 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:38 devstack sudo[105549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fe920575-fb85-4f83-9d1c-84791262bc0c.info Nov 01 12:38:38 devstack sudo[105549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:38 devstack sudo[105550]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c3533648-3a71-4727-b081-aef13dcb4ad1 Nov 01 12:38:38 devstack sudo[105550]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-52f3abdc-97a9-41f3-9b38-553956e10e12 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-52f3abdc-97a9-41f3-9b38-553956e10e12 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Flow 'volume_create_manager' (5cf66d90-4d38-461e-b748-defa62edd4fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-52f3abdc-97a9-41f3-9b38-553956e10e12 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b352bb84-cca3-45b2-9c5b-48cf4985bc02) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-52f3abdc-97a9-41f3-9b38-553956e10e12 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b352bb84-cca3-45b2-9c5b-48cf4985bc02) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-471991604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b41a20c4-3be4-4081-ba58-2332e8b198b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9c934deca6c4332885263dd4cb83dfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:38Z,use_quota=True,user_id='362ff3df17dc46c7bf4bfaacc9db7290',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-52f3abdc-97a9-41f3-9b38-553956e10e12 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7ad78fb-000b-4969-a381-5f56a08e3cfc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-52f3abdc-97a9-41f3-9b38-553956e10e12 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e7ad78fb-000b-4969-a381-5f56a08e3cfc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-52f3abdc-97a9-41f3-9b38-553956e10e12 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a31e6f78-b21e-4b6e-8a02-7108f29ae213) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-52f3abdc-97a9-41f3-9b38-553956e10e12 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a31e6f78-b21e-4b6e-8a02-7108f29ae213) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b41a20c4-3be4-4081-ba58-2332e8b198b4', 'volume_name': 'volume-b41a20c4-3be4-4081-ba58-2332e8b198b4', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-52f3abdc-97a9-41f3-9b38-553956e10e12 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88522556-2b6a-4df0-b1b1-bc82292a961e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-52f3abdc-97a9-41f3-9b38-553956e10e12 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (88522556-2b6a-4df0-b1b1-bc82292a961e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-52f3abdc-97a9-41f3-9b38-553956e10e12 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afe35828-5a47-4f50-b030-d0bee0ebc561) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:38 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-52f3abdc-97a9-41f3-9b38-553956e10e12 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Volume b41a20c4-3be4-4081-ba58-2332e8b198b4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b41a20c4-3be4-4081-ba58-2332e8b198b4', 'volume_size': 1} Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-52f3abdc-97a9-41f3-9b38-553956e10e12 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:38 devstack sudo[105549]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ac38c68a-a93d-4a20-884f-215ea8ac9f7c tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fe920575-fb85-4f83-9d1c-84791262bc0c.info" returned: 0 in 0.354s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ac38c68a-a93d-4a20-884f-215ea8ac9f7c tempest-ProjectMemberTests-538781697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.710s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.509s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:32Z,deleted=False,deleted_at=None,display_description=None,display_name='volume-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a2f9cbc1-de9b-4e04-a841-0988f294bccd,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='428dbead44be4ddeb2ac477dd0fba469',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:32Z,use_quota=True,user_id='da3f3cfff9824e5b9529eb23c867f9f2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(8b889b74-1db6-4ebf-9d8a-25c5ea5d2d77),volume_type_id=8b889b74-1db6-4ebf-9d8a-25c5ea5d2d77)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Creating volume a2f9cbc1-de9b-4e04-a841-0988f294bccd {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:38:38 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-a2f9cbc1-de9b-4e04-a841-0988f294bccd 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:38 devstack sudo[105550]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-69dbfcf7-7106-4074-9695-92c9bc65fadf tempest-CreateVolumesFromImageTest-2025437841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-c3533648-3a71-4727-b081-aef13dcb4ad1" returned: 0 in 0.405s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:38 devstack sudo[105556]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-a2f9cbc1-de9b-4e04-a841-0988f294bccd 1073741824 Nov 01 12:38:38 devstack sudo[105556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-69dbfcf7-7106-4074-9695-92c9bc65fadf tempest-CreateVolumesFromImageTest-2025437841 None] Lock "cinder-quobyte-c3533648-3a71-4727-b081-aef13dcb4ad1" released by "delete_volume" :: held 0.998s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:38 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-ac38c68a-a93d-4a20-884f-215ea8ac9f7c tempest-ProjectMemberTests-538781697 None] Create snapshot completed successfully Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-d0362588-a060-4ba6-8502-29d2c8f5f6c9 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d0362588-a060-4ba6-8502-29d2c8f5f6c9 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Flow 'volume_create_manager' (309a6ac7-1dbd-437d-9fc3-b6eab84bc407) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d0362588-a060-4ba6-8502-29d2c8f5f6c9 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5012c06d-7729-4666-bf5c-6fcdc3097b3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d0362588-a060-4ba6-8502-29d2c8f5f6c9 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5012c06d-7729-4666-bf5c-6fcdc3097b3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-968595312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df1ec9cb-869d-409f-ac69-d6943672e009,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9c934deca6c4332885263dd4cb83dfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:39Z,use_quota=True,user_id='362ff3df17dc46c7bf4bfaacc9db7290',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d0362588-a060-4ba6-8502-29d2c8f5f6c9 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff8de8b8-9ac3-4c38-82e3-604da5551874) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d0362588-a060-4ba6-8502-29d2c8f5f6c9 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff8de8b8-9ac3-4c38-82e3-604da5551874) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d0362588-a060-4ba6-8502-29d2c8f5f6c9 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43c915e8-6472-4e62-9427-be1aa45b784a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d0362588-a060-4ba6-8502-29d2c8f5f6c9 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43c915e8-6472-4e62-9427-be1aa45b784a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'df1ec9cb-869d-409f-ac69-d6943672e009', 'volume_name': 'volume-df1ec9cb-869d-409f-ac69-d6943672e009', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d0362588-a060-4ba6-8502-29d2c8f5f6c9 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d001b29-3ddb-407a-802b-b2fc22eba89d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d0362588-a060-4ba6-8502-29d2c8f5f6c9 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2d001b29-3ddb-407a-802b-b2fc22eba89d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d0362588-a060-4ba6-8502-29d2c8f5f6c9 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6096ebb-0830-485a-b50f-3edb6dd5e3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:38 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-d0362588-a060-4ba6-8502-29d2c8f5f6c9 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Volume df1ec9cb-869d-409f-ac69-d6943672e009: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-df1ec9cb-869d-409f-ac69-d6943672e009', 'volume_size': 1} Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d0362588-a060-4ba6-8502-29d2c8f5f6c9 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:38 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-69dbfcf7-7106-4074-9695-92c9bc65fadf tempest-CreateVolumesFromImageTest-2025437841 None] Created reservations ['8ef98ec9-0f24-4c92-af57-315cc9e722cb', '1061d5b1-f26f-4458-a4a7-90549c2cfbf7', '5e02c1fd-ea36-4a34-a011-ebe476d2a7dd', 'cf8d2af6-587d-4375-86ac-69247c4d5c03'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:38:39 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d88e85da-6bef-4963-ad46-170b0e4a3679 tempest-ProjectMemberTests-538781697 None] Acquiring lock "cinder-12352992-e0b5-4360-8a32-3f9036597706-delete_snapshot" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:39 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d88e85da-6bef-4963-ad46-170b0e4a3679 tempest-ProjectMemberTests-538781697 None] Lock "cinder-12352992-e0b5-4360-8a32-3f9036597706-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:39 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d88e85da-6bef-4963-ad46-170b0e4a3679 tempest-ProjectMemberTests-538781697 None] Acquiring lock "cinder-quobyte-fe920575-fb85-4f83-9d1c-84791262bc0c" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-69dbfcf7-7106-4074-9695-92c9bc65fadf tempest-CreateVolumesFromImageTest-2025437841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-69dbfcf7-7106-4074-9695-92c9bc65fadf tempest-CreateVolumesFromImageTest-2025437841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-69dbfcf7-7106-4074-9695-92c9bc65fadf tempest-CreateVolumesFromImageTest-2025437841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-69dbfcf7-7106-4074-9695-92c9bc65fadf tempest-CreateVolumesFromImageTest-2025437841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-69dbfcf7-7106-4074-9695-92c9bc65fadf tempest-CreateVolumesFromImageTest-2025437841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-69dbfcf7-7106-4074-9695-92c9bc65fadf tempest-CreateVolumesFromImageTest-2025437841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:39 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d88e85da-6bef-4963-ad46-170b0e4a3679 tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-fe920575-fb85-4f83-9d1c-84791262bc0c" acquired by "delete_snapshot" :: waited 0.039s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:39 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d88e85da-6bef-4963-ad46-170b0e4a3679 tempest-ProjectMemberTests-538781697 None] Acquiring lock "cinder-quobyte-12352992-e0b5-4360-8a32-3f9036597706" by "_delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:39 devstack sudo[105561]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:38:39 devstack sudo[105561]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:39 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d88e85da-6bef-4963-ad46-170b0e4a3679 tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-12352992-e0b5-4360-8a32-3f9036597706" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-d88e85da-6bef-4963-ad46-170b0e4a3679 tempest-ProjectMemberTests-538781697 None] Deleting offline snapshot 12352992-e0b5-4360-8a32-3f9036597706 of volume fe920575-fb85-4f83-9d1c-84791262bc0c {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:38:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-d88e85da-6bef-4963-ad46-170b0e4a3679 tempest-ProjectMemberTests-538781697 None] snapshot_file for this snap is: volume-fe920575-fb85-4f83-9d1c-84791262bc0c.12352992-e0b5-4360-8a32-3f9036597706 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:38:39 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[82401810-c31e-47f5-a8f0-15a6d93c2564]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d88e85da-6bef-4963-ad46-170b0e4a3679 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fe920575-fb85-4f83-9d1c-84791262bc0c.12352992-e0b5-4360-8a32-3f9036597706 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:39 devstack sudo[105556]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-a2f9cbc1-de9b-4e04-a841-0988f294bccd 1073741824" returned: 0 in 0.512s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:39 devstack sudo[105564]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fe920575-fb85-4f83-9d1c-84791262bc0c.12352992-e0b5-4360-8a32-3f9036597706 Nov 01 12:38:39 devstack sudo[105564]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-a2f9cbc1-de9b-4e04-a841-0988f294bccd {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:39 devstack sudo[105566]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-a2f9cbc1-de9b-4e04-a841-0988f294bccd Nov 01 12:38:39 devstack sudo[105566]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:39 devstack sudo[105561]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-69dbfcf7-7106-4074-9695-92c9bc65fadf tempest-CreateVolumesFromImageTest-2025437841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.301s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:39 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-69dbfcf7-7106-4074-9695-92c9bc65fadf tempest-CreateVolumesFromImageTest-2025437841 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:38:39 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-69dbfcf7-7106-4074-9695-92c9bc65fadf tempest-CreateVolumesFromImageTest-2025437841 None] Deleted volume successfully. Nov 01 12:38:39 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-69dbfcf7-7106-4074-9695-92c9bc65fadf tempest-CreateVolumesFromImageTest-2025437841 None] Lock "cinder-c3533648-3a71-4727-b081-aef13dcb4ad1-delete_volume" released by "delete_volume" :: held 1.658s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:39 devstack sudo[105564]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d88e85da-6bef-4963-ad46-170b0e4a3679 tempest-ProjectMemberTests-538781697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fe920575-fb85-4f83-9d1c-84791262bc0c.12352992-e0b5-4360-8a32-3f9036597706" returned: 0 in 0.384s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-d88e85da-6bef-4963-ad46-170b0e4a3679 tempest-ProjectMemberTests-538781697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fe920575-fb85-4f83-9d1c-84791262bc0c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:38:39 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[63d66593-3f96-4266-8b27-ee574a624779]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d88e85da-6bef-4963-ad46-170b0e4a3679 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fe920575-fb85-4f83-9d1c-84791262bc0c {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:39 devstack sudo[105566]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-a2f9cbc1-de9b-4e04-a841-0988f294bccd" returned: 0 in 0.286s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] <== create_volume: return (840ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:38:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.843s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-1470cdd6-c730-4d69-ab0c-b98eeee66dd6 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.359s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-1470cdd6-c730-4d69-ab0c-b98eeee66dd6 tempest-CreateVolumesFromSnapshotTest-1885067804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1299207954',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19dcb9b7-770e-43e7-9ab5-9b11cea0cc52,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9c934deca6c4332885263dd4cb83dfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:37Z,use_quota=True,user_id='362ff3df17dc46c7bf4bfaacc9db7290',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:38:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-1470cdd6-c730-4d69-ab0c-b98eeee66dd6 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Creating volume 19dcb9b7-770e-43e7-9ab5-9b11cea0cc52 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:38:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-1470cdd6-c730-4d69-ab0c-b98eeee66dd6 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-1470cdd6-c730-4d69-ab0c-b98eeee66dd6 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-1470cdd6-c730-4d69-ab0c-b98eeee66dd6 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-1470cdd6-c730-4d69-ab0c-b98eeee66dd6 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-1470cdd6-c730-4d69-ab0c-b98eeee66dd6 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-1470cdd6-c730-4d69-ab0c-b98eeee66dd6 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:38:39 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-1470cdd6-c730-4d69-ab0c-b98eeee66dd6 tempest-CreateVolumesFromSnapshotTest-1885067804 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:38:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1470cdd6-c730-4d69-ab0c-b98eeee66dd6 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-19dcb9b7-770e-43e7-9ab5-9b11cea0cc52 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:39 devstack sudo[105574]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-19dcb9b7-770e-43e7-9ab5-9b11cea0cc52 1073741824 Nov 01 12:38:39 devstack sudo[105574]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:39 devstack cinder-volume[86574]: DEBUG cinder.volume.volume_utils [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Attempting download of b924798c-681b-448c-a8c8-d09879ea3769 ((None, [{'url': 'file:///opt/stack/data/glance/images/b924798c-681b-448c-a8c8-d09879ea3769', 'metadata': {}}])) to volume a2f9cbc1-de9b-4e04-a841-0988f294bccd. {{(pid=86574) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 01 12:38:39 devstack sudo[105573]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fe920575-fb85-4f83-9d1c-84791262bc0c Nov 01 12:38:39 devstack sudo[105573]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:39 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[aedc96c2-865b-4849-84d7-8cfbffa9c2f1]: (4, 'raw') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b924798c-681b-448c-a8c8-d09879ea3769_6kwl1dle {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:39 devstack sudo[105577]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b924798c-681b-448c-a8c8-d09879ea3769_6kwl1dle Nov 01 12:38:39 devstack sudo[105577]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:39 devstack cinder-volume[86574]: DEBUG oslo_service.periodic_task [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86574) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:38:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:39 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a14c0716-6def-47ba-8955-e8ad6425b529 tempest-CreateVolumesFromImageTest-2025437841 None] Acquiring lock "cinder-da5ef211-0d0d-4a0f-a61e-b37e07908b96-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:39 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a14c0716-6def-47ba-8955-e8ad6425b529 tempest-CreateVolumesFromImageTest-2025437841 None] Lock "cinder-da5ef211-0d0d-4a0f-a61e-b37e07908b96-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:39 devstack sudo[105584]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:38:39 devstack sudo[105584]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:40 devstack sudo[105573]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d88e85da-6bef-4963-ad46-170b0e4a3679 tempest-ProjectMemberTests-538781697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fe920575-fb85-4f83-9d1c-84791262bc0c" returned: 0 in 0.454s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d88e85da-6bef-4963-ad46-170b0e4a3679 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fe920575-fb85-4f83-9d1c-84791262bc0c.12352992-e0b5-4360-8a32-3f9036597706 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:40 devstack sudo[105588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fe920575-fb85-4f83-9d1c-84791262bc0c.12352992-e0b5-4360-8a32-3f9036597706 Nov 01 12:38:40 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a14c0716-6def-47ba-8955-e8ad6425b529 tempest-CreateVolumesFromImageTest-2025437841 None] Acquiring lock "cinder-quobyte-da5ef211-0d0d-4a0f-a61e-b37e07908b96" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:40 devstack sudo[105588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:40 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a14c0716-6def-47ba-8955-e8ad6425b529 tempest-CreateVolumesFromImageTest-2025437841 None] Lock "cinder-quobyte-da5ef211-0d0d-4a0f-a61e-b37e07908b96" acquired by "delete_volume" :: waited 0.026s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:40 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[98cf9e3c-ad5f-494d-859e-e2dea4ae28d1]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a14c0716-6def-47ba-8955-e8ad6425b529 tempest-CreateVolumesFromImageTest-2025437841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-da5ef211-0d0d-4a0f-a61e-b37e07908b96 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:40 devstack sudo[105577]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_b924798c-681b-448c-a8c8-d09879ea3769_6kwl1dle" returned: 0 in 0.451s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b924798c-681b-448c-a8c8-d09879ea3769_6kwl1dle {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:40 devstack sudo[105574]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1470cdd6-c730-4d69-ab0c-b98eeee66dd6 tempest-CreateVolumesFromSnapshotTest-1885067804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-19dcb9b7-770e-43e7-9ab5-9b11cea0cc52 1073741824" returned: 0 in 0.582s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1470cdd6-c730-4d69-ab0c-b98eeee66dd6 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-19dcb9b7-770e-43e7-9ab5-9b11cea0cc52 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:40 devstack sudo[105592]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-da5ef211-0d0d-4a0f-a61e-b37e07908b96 Nov 01 12:38:40 devstack sudo[105592]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:40 devstack sudo[105595]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-19dcb9b7-770e-43e7-9ab5-9b11cea0cc52 Nov 01 12:38:40 devstack sudo[105595]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:40 devstack sudo[105593]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b924798c-681b-448c-a8c8-d09879ea3769_6kwl1dle Nov 01 12:38:40 devstack sudo[105593]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:40 devstack sudo[105584]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.405s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:40 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:38:40 devstack cinder-volume[86574]: DEBUG oslo_service.periodic_task [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running periodic task VolumeManager._thread_info {{(pid=86574) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:38:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] thread count: 28 {{(pid=86574) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 12:38:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] thread info: [<_MainThread(MainThread, started 131331184930944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86574) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 12:38:40 devstack sudo[105588]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d88e85da-6bef-4963-ad46-170b0e4a3679 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fe920575-fb85-4f83-9d1c-84791262bc0c.12352992-e0b5-4360-8a32-3f9036597706" returned: 0 in 0.462s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d88e85da-6bef-4963-ad46-170b0e4a3679 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fe920575-fb85-4f83-9d1c-84791262bc0c.12352992-e0b5-4360-8a32-3f9036597706 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:40 devstack sudo[105603]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fe920575-fb85-4f83-9d1c-84791262bc0c.12352992-e0b5-4360-8a32-3f9036597706 Nov 01 12:38:40 devstack sudo[105603]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:40 devstack sudo[105593]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b924798c-681b-448c-a8c8-d09879ea3769_6kwl1dle" returned: 1 in 0.390s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_b924798c-681b-448c-a8c8-d09879ea3769_6kwl1dle' failed. Not Retrying. {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 12:38:40 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[8775d4be-87e8-4a1d-bdd1-bcb303a96bd8]: (4, 'raw') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b924798c-681b-448c-a8c8-d09879ea3769_zph3ic0kdevstack@QuobyteHD {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:40 devstack sudo[105595]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1470cdd6-c730-4d69-ab0c-b98eeee66dd6 tempest-CreateVolumesFromSnapshotTest-1885067804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-19dcb9b7-770e-43e7-9ab5-9b11cea0cc52" returned: 0 in 0.332s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:40 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-1470cdd6-c730-4d69-ab0c-b98eeee66dd6 tempest-CreateVolumesFromSnapshotTest-1885067804 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:38:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-1470cdd6-c730-4d69-ab0c-b98eeee66dd6 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.998s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5298891b-376f-4397-af74-36979fe6a649 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.856s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:40 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-5298891b-376f-4397-af74-36979fe6a649 tempest-CreateVolumesFromSnapshotTest-1885067804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1996015005',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6448a0ac-f896-45e2-b45f-8f0dafa28093,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9c934deca6c4332885263dd4cb83dfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:38Z,use_quota=True,user_id='362ff3df17dc46c7bf4bfaacc9db7290',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:38:40 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-5298891b-376f-4397-af74-36979fe6a649 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Creating volume 6448a0ac-f896-45e2-b45f-8f0dafa28093 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:38:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5298891b-376f-4397-af74-36979fe6a649 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5298891b-376f-4397-af74-36979fe6a649 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:40 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-5298891b-376f-4397-af74-36979fe6a649 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:40 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-5298891b-376f-4397-af74-36979fe6a649 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5298891b-376f-4397-af74-36979fe6a649 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:40 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-5298891b-376f-4397-af74-36979fe6a649 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:38:40 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-5298891b-376f-4397-af74-36979fe6a649 tempest-CreateVolumesFromSnapshotTest-1885067804 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:38:40 devstack sudo[105592]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5298891b-376f-4397-af74-36979fe6a649 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6448a0ac-f896-45e2-b45f-8f0dafa28093 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a14c0716-6def-47ba-8955-e8ad6425b529 tempest-CreateVolumesFromImageTest-2025437841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-da5ef211-0d0d-4a0f-a61e-b37e07908b96" returned: 0 in 0.490s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a14c0716-6def-47ba-8955-e8ad6425b529 tempest-CreateVolumesFromImageTest-2025437841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-da5ef211-0d0d-4a0f-a61e-b37e07908b96 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:40 devstack sudo[105612]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6448a0ac-f896-45e2-b45f-8f0dafa28093 1073741824 Nov 01 12:38:40 devstack sudo[105612]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-1470cdd6-c730-4d69-ab0c-b98eeee66dd6 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c23ff0e9-0538-4c7b-a35b-d078c41d89d6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19dcb9b7-770e-43e7-9ab5-9b11cea0cc52', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-1470cdd6-c730-4d69-ab0c-b98eeee66dd6 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f21a0c6e-e6f5-4a75-837d-1ab35d0c7758) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:40 devstack sudo[105614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-da5ef211-0d0d-4a0f-a61e-b37e07908b96 Nov 01 12:38:40 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-1470cdd6-c730-4d69-ab0c-b98eeee66dd6 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Volume volume-19dcb9b7-770e-43e7-9ab5-9b11cea0cc52 (19dcb9b7-770e-43e7-9ab5-9b11cea0cc52): created successfully Nov 01 12:38:40 devstack sudo[105614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-1470cdd6-c730-4d69-ab0c-b98eeee66dd6 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f21a0c6e-e6f5-4a75-837d-1ab35d0c7758) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:40 devstack sudo[105611]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b924798c-681b-448c-a8c8-d09879ea3769_zph3ic0kdevstack@QuobyteHD Nov 01 12:38:40 devstack sudo[105611]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-1470cdd6-c730-4d69-ab0c-b98eeee66dd6 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Flow 'volume_create_manager' (97909b8a-7635-4de5-9ce2-54b0e2aa228a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:40 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-1470cdd6-c730-4d69-ab0c-b98eeee66dd6 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Created volume successfully. Nov 01 12:38:40 devstack sudo[105603]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d88e85da-6bef-4963-ad46-170b0e4a3679 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fe920575-fb85-4f83-9d1c-84791262bc0c.12352992-e0b5-4360-8a32-3f9036597706" returned: 0 in 0.375s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:40 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d88e85da-6bef-4963-ad46-170b0e4a3679 tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-12352992-e0b5-4360-8a32-3f9036597706" released by "_delete_snapshot" :: held 1.826s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:40 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d88e85da-6bef-4963-ad46-170b0e4a3679 tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-fe920575-fb85-4f83-9d1c-84791262bc0c" released by "delete_snapshot" :: held 1.855s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:40 devstack sudo[105611]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_b924798c-681b-448c-a8c8-d09879ea3769_zph3ic0kdevstack@QuobyteHD" returned: 0 in 0.428s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b924798c-681b-448c-a8c8-d09879ea3769_zph3ic0kdevstack@QuobyteHD {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:41 devstack sudo[105614]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a14c0716-6def-47ba-8955-e8ad6425b529 tempest-CreateVolumesFromImageTest-2025437841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-da5ef211-0d0d-4a0f-a61e-b37e07908b96" returned: 0 in 0.388s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:41 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a14c0716-6def-47ba-8955-e8ad6425b529 tempest-CreateVolumesFromImageTest-2025437841 None] Lock "cinder-quobyte-da5ef211-0d0d-4a0f-a61e-b37e07908b96" released by "delete_volume" :: held 0.941s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:41 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-d88e85da-6bef-4963-ad46-170b0e4a3679 tempest-ProjectMemberTests-538781697 None] Created reservations ['1cb2be04-1e4a-43c3-a12d-53d1e5577998', '6bdc4ee2-7d1e-41ab-b918-a510bef038e4', 'cc8e24ab-c7f9-4ac8-954f-0bbb0a6b2f01', '3d5ddb8e-83bd-4755-9417-e084e0846a68'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:38:41 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-a14c0716-6def-47ba-8955-e8ad6425b529 tempest-CreateVolumesFromImageTest-2025437841 None] Created reservations ['a454900d-e91a-48e5-8a9d-bbdabc7abbba', '4009b0ec-8ba5-42bd-a8d9-329817203e5e', '4e4c3fb8-7ffb-4292-86b4-6f610ac98924', 'dfad3fe6-f61f-4e09-8a89-fb727fa3c522'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:38:41 devstack sudo[105629]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b924798c-681b-448c-a8c8-d09879ea3769_zph3ic0kdevstack@QuobyteHD Nov 01 12:38:41 devstack sudo[105629]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:41 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-d88e85da-6bef-4963-ad46-170b0e4a3679 tempest-ProjectMemberTests-538781697 None] Delete snapshot completed successfully. Nov 01 12:38:41 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d88e85da-6bef-4963-ad46-170b0e4a3679 tempest-ProjectMemberTests-538781697 None] Lock "cinder-12352992-e0b5-4360-8a32-3f9036597706-delete_snapshot" released by "delete_snapshot" :: held 2.142s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:41 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-94e90f6d-65d1-442e-8704-71c0e57f6b36 tempest-ProjectMemberTests-538781697 None] Acquiring lock "cinder-fe920575-fb85-4f83-9d1c-84791262bc0c-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a14c0716-6def-47ba-8955-e8ad6425b529 tempest-CreateVolumesFromImageTest-2025437841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a14c0716-6def-47ba-8955-e8ad6425b529 tempest-CreateVolumesFromImageTest-2025437841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:41 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a14c0716-6def-47ba-8955-e8ad6425b529 tempest-CreateVolumesFromImageTest-2025437841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:41 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a14c0716-6def-47ba-8955-e8ad6425b529 tempest-CreateVolumesFromImageTest-2025437841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a14c0716-6def-47ba-8955-e8ad6425b529 tempest-CreateVolumesFromImageTest-2025437841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a14c0716-6def-47ba-8955-e8ad6425b529 tempest-CreateVolumesFromImageTest-2025437841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:41 devstack sudo[105612]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5298891b-376f-4397-af74-36979fe6a649 tempest-CreateVolumesFromSnapshotTest-1885067804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6448a0ac-f896-45e2-b45f-8f0dafa28093 1073741824" returned: 0 in 0.694s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:41 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-94e90f6d-65d1-442e-8704-71c0e57f6b36 tempest-ProjectMemberTests-538781697 None] Lock "cinder-fe920575-fb85-4f83-9d1c-84791262bc0c-delete_volume" acquired by "delete_volume" :: waited 0.066s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:41 devstack sudo[105634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:38:41 devstack sudo[105634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:41 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-94e90f6d-65d1-442e-8704-71c0e57f6b36 tempest-ProjectMemberTests-538781697 None] Acquiring lock "cinder-quobyte-fe920575-fb85-4f83-9d1c-84791262bc0c" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5298891b-376f-4397-af74-36979fe6a649 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6448a0ac-f896-45e2-b45f-8f0dafa28093 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:41 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-94e90f6d-65d1-442e-8704-71c0e57f6b36 tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-fe920575-fb85-4f83-9d1c-84791262bc0c" acquired by "delete_volume" :: waited 0.026s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:41 devstack sudo[105636]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6448a0ac-f896-45e2-b45f-8f0dafa28093 Nov 01 12:38:41 devstack sudo[105636]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:41 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff83d2b7-f5a2-4cf1-869d-f97422bc96d6]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-94e90f6d-65d1-442e-8704-71c0e57f6b36 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fe920575-fb85-4f83-9d1c-84791262bc0c {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:41 devstack sudo[105629]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b924798c-681b-448c-a8c8-d09879ea3769_zph3ic0kdevstack@QuobyteHD" returned: 1 in 0.472s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_b924798c-681b-448c-a8c8-d09879ea3769_zph3ic0kdevstack@QuobyteHD' failed. Not Retrying. {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 12:38:41 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] b924798c-681b-448c-a8c8-d09879ea3769 was raw, converting to qcow2 {{(pid=86574) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 01 12:38:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b924798c-681b-448c-a8c8-d09879ea3769_zph3ic0kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-a2f9cbc1-de9b-4e04-a841-0988f294bccd {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:41 devstack sudo[105642]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b924798c-681b-448c-a8c8-d09879ea3769_zph3ic0kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-a2f9cbc1-de9b-4e04-a841-0988f294bccd Nov 01 12:38:41 devstack sudo[105642]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:41 devstack sudo[105634]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a14c0716-6def-47ba-8955-e8ad6425b529 tempest-CreateVolumesFromImageTest-2025437841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.304s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:41 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-a14c0716-6def-47ba-8955-e8ad6425b529 tempest-CreateVolumesFromImageTest-2025437841 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:38:41 devstack sudo[105641]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fe920575-fb85-4f83-9d1c-84791262bc0c Nov 01 12:38:41 devstack sudo[105641]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:41 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-a14c0716-6def-47ba-8955-e8ad6425b529 tempest-CreateVolumesFromImageTest-2025437841 None] Deleted volume successfully. Nov 01 12:38:41 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a14c0716-6def-47ba-8955-e8ad6425b529 tempest-CreateVolumesFromImageTest-2025437841 None] Lock "cinder-da5ef211-0d0d-4a0f-a61e-b37e07908b96-delete_volume" released by "delete_volume" :: held 1.626s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:41 devstack sudo[105636]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5298891b-376f-4397-af74-36979fe6a649 tempest-CreateVolumesFromSnapshotTest-1885067804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6448a0ac-f896-45e2-b45f-8f0dafa28093" returned: 0 in 0.273s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:41 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-5298891b-376f-4397-af74-36979fe6a649 tempest-CreateVolumesFromSnapshotTest-1885067804 None] <== create_volume: return (1040ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:38:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5298891b-376f-4397-af74-36979fe6a649 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.044s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a738b131-3978-4709-bba9-3e7d513ae156 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.390s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:41 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a738b131-3978-4709-bba9-3e7d513ae156 tempest-CreateVolumesFromSnapshotTest-1885067804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1272901376',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=390756b0-2726-422f-b616-c1bcd6ec01b9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9c934deca6c4332885263dd4cb83dfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:38Z,use_quota=True,user_id='362ff3df17dc46c7bf4bfaacc9db7290',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:38:41 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-a738b131-3978-4709-bba9-3e7d513ae156 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Creating volume 390756b0-2726-422f-b616-c1bcd6ec01b9 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:38:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a738b131-3978-4709-bba9-3e7d513ae156 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a738b131-3978-4709-bba9-3e7d513ae156 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:41 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a738b131-3978-4709-bba9-3e7d513ae156 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:41 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a738b131-3978-4709-bba9-3e7d513ae156 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a738b131-3978-4709-bba9-3e7d513ae156 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:41 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a738b131-3978-4709-bba9-3e7d513ae156 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:38:41 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-a738b131-3978-4709-bba9-3e7d513ae156 tempest-CreateVolumesFromSnapshotTest-1885067804 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:38:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a738b131-3978-4709-bba9-3e7d513ae156 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-390756b0-2726-422f-b616-c1bcd6ec01b9 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:41 devstack sudo[105647]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-390756b0-2726-422f-b616-c1bcd6ec01b9 1073741824 Nov 01 12:38:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5298891b-376f-4397-af74-36979fe6a649 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f8a586f5-35c6-4c35-acb6-ffdb44f7bbd4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6448a0ac-f896-45e2-b45f-8f0dafa28093', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:41 devstack sudo[105647]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5298891b-376f-4397-af74-36979fe6a649 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cdd83d8-a69c-4e77-9e1f-30b605024f14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:41 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-5298891b-376f-4397-af74-36979fe6a649 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Volume volume-6448a0ac-f896-45e2-b45f-8f0dafa28093 (6448a0ac-f896-45e2-b45f-8f0dafa28093): created successfully Nov 01 12:38:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5298891b-376f-4397-af74-36979fe6a649 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cdd83d8-a69c-4e77-9e1f-30b605024f14) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5298891b-376f-4397-af74-36979fe6a649 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Flow 'volume_create_manager' (20890dc1-10d6-48f9-9ec5-d3afa0a57259) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:41 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-5298891b-376f-4397-af74-36979fe6a649 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Created volume successfully. Nov 01 12:38:41 devstack sudo[105641]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-94e90f6d-65d1-442e-8704-71c0e57f6b36 tempest-ProjectMemberTests-538781697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fe920575-fb85-4f83-9d1c-84791262bc0c" returned: 0 in 0.461s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-94e90f6d-65d1-442e-8704-71c0e57f6b36 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fe920575-fb85-4f83-9d1c-84791262bc0c {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:41 devstack sudo[105656]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fe920575-fb85-4f83-9d1c-84791262bc0c Nov 01 12:38:41 devstack sudo[105656]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:41 devstack sudo[105642]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_b924798c-681b-448c-a8c8-d09879ea3769_zph3ic0kdevstack@QuobyteHD /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-a2f9cbc1-de9b-4e04-a841-0988f294bccd" returned: 0 in 0.521s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:41 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_b924798c-681b-448c-a8c8-d09879ea3769_zph3ic0kdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-a2f9cbc1-de9b-4e04-a841-0988f294bccd {{(pid=86574) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 12:38:41 devstack cinder-volume[86574]: INFO cinder.image.image_utils [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Converted 0.00 MB image at 0.00 MB/s Nov 01 12:38:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-a2f9cbc1-de9b-4e04-a841-0988f294bccd 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:42 devstack sudo[105661]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-a2f9cbc1-de9b-4e04-a841-0988f294bccd 1G Nov 01 12:38:42 devstack sudo[105661]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:42 devstack sudo[105656]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-94e90f6d-65d1-442e-8704-71c0e57f6b36 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fe920575-fb85-4f83-9d1c-84791262bc0c" returned: 0 in 0.317s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:42 devstack sudo[105647]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a738b131-3978-4709-bba9-3e7d513ae156 tempest-CreateVolumesFromSnapshotTest-1885067804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-390756b0-2726-422f-b616-c1bcd6ec01b9 1073741824" returned: 0 in 0.603s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:42 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-94e90f6d-65d1-442e-8704-71c0e57f6b36 tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-fe920575-fb85-4f83-9d1c-84791262bc0c" released by "delete_volume" :: held 0.877s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:42 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a27aaf15-dffe-4534-b74a-13e109c05163 tempest-CreateVolumesFromImageTest-2025437841 None] Acquiring lock "cinder-1748f7e9-00a3-4fe6-9222-fe01526a8acf-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a738b131-3978-4709-bba9-3e7d513ae156 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-390756b0-2726-422f-b616-c1bcd6ec01b9 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:42 devstack sudo[105666]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-390756b0-2726-422f-b616-c1bcd6ec01b9 Nov 01 12:38:42 devstack sudo[105666]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:42 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a27aaf15-dffe-4534-b74a-13e109c05163 tempest-CreateVolumesFromImageTest-2025437841 None] Lock "cinder-1748f7e9-00a3-4fe6-9222-fe01526a8acf-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:42 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-94e90f6d-65d1-442e-8704-71c0e57f6b36 tempest-ProjectMemberTests-538781697 None] Created reservations ['d7c9c10c-cbd9-4fd4-8eda-adf1962b3cb1', 'aa125f8c-fff8-4a75-8229-d1e2aa01d99f', '7e28cfe1-f514-436b-8bff-ff3a94d958c9', '1675b244-10a0-43b3-874a-91a0dae665fa'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:38:42 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a27aaf15-dffe-4534-b74a-13e109c05163 tempest-CreateVolumesFromImageTest-2025437841 None] Acquiring lock "cinder-quobyte-1748f7e9-00a3-4fe6-9222-fe01526a8acf" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:42 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a27aaf15-dffe-4534-b74a-13e109c05163 tempest-CreateVolumesFromImageTest-2025437841 None] Lock "cinder-quobyte-1748f7e9-00a3-4fe6-9222-fe01526a8acf" acquired by "delete_volume" :: waited 0.030s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:42 devstack sudo[105661]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:42 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[0fbde42b-5027-4c33-a2f0-1c50339e4ddd]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a27aaf15-dffe-4534-b74a-13e109c05163 tempest-CreateVolumesFromImageTest-2025437841 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1748f7e9-00a3-4fe6-9222-fe01526a8acf {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-a2f9cbc1-de9b-4e04-a841-0988f294bccd 1G" returned: 0 in 0.541s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:42 devstack cinder-volume[86574]: DEBUG cinder.volume.volume_utils [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Downloaded image b924798c-681b-448c-a8c8-d09879ea3769 ((None, [{'url': 'file:///opt/stack/data/glance/images/b924798c-681b-448c-a8c8-d09879ea3769', 'metadata': {}}])) to volume a2f9cbc1-de9b-4e04-a841-0988f294bccd successfully. {{(pid=86574) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 01 12:38:42 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Temporary image b924798c-681b-448c-a8c8-d09879ea3769 for user da3f3cfff9824e5b9529eb23c867f9f2 is deleted. {{(pid=86574) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 01 12:38:42 devstack cinder-volume[86574]: DEBUG cinder.volume.volume_utils [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Marking volume a2f9cbc1-de9b-4e04-a841-0988f294bccd as bootable. {{(pid=86574) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 01 12:38:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-94e90f6d-65d1-442e-8704-71c0e57f6b36 tempest-ProjectMemberTests-538781697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-94e90f6d-65d1-442e-8704-71c0e57f6b36 tempest-ProjectMemberTests-538781697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:42 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-94e90f6d-65d1-442e-8704-71c0e57f6b36 tempest-ProjectMemberTests-538781697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:42 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-94e90f6d-65d1-442e-8704-71c0e57f6b36 tempest-ProjectMemberTests-538781697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-94e90f6d-65d1-442e-8704-71c0e57f6b36 tempest-ProjectMemberTests-538781697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-94e90f6d-65d1-442e-8704-71c0e57f6b36 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:42 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Copying metadata from image b924798c-681b-448c-a8c8-d09879ea3769 to a2f9cbc1-de9b-4e04-a841-0988f294bccd. {{(pid=86574) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 01 12:38:42 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Creating volume glance metadata for volume a2f9cbc1-de9b-4e04-a841-0988f294bccd backed by image b924798c-681b-448c-a8c8-d09879ea3769 with: {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'image_id': 'b924798c-681b-448c-a8c8-d09879ea3769', 'image_name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'checksum': 'ceaeb4044928abd10be52a51ad01c278', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86574) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 01 12:38:42 devstack sudo[105671]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:38:42 devstack sudo[105671]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:42 devstack sudo[105670]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1748f7e9-00a3-4fe6-9222-fe01526a8acf Nov 01 12:38:42 devstack sudo[105670]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:42 devstack sudo[105666]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a738b131-3978-4709-bba9-3e7d513ae156 tempest-CreateVolumesFromSnapshotTest-1885067804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-390756b0-2726-422f-b616-c1bcd6ec01b9" returned: 0 in 0.332s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:42 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a738b131-3978-4709-bba9-3e7d513ae156 tempest-CreateVolumesFromSnapshotTest-1885067804 None] <== create_volume: return (1011ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:38:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a738b131-3978-4709-bba9-3e7d513ae156 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.014s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-52f3abdc-97a9-41f3-9b38-553956e10e12 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.973s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:42 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-52f3abdc-97a9-41f3-9b38-553956e10e12 tempest-CreateVolumesFromSnapshotTest-1885067804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-471991604',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b41a20c4-3be4-4081-ba58-2332e8b198b4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9c934deca6c4332885263dd4cb83dfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:38Z,use_quota=True,user_id='362ff3df17dc46c7bf4bfaacc9db7290',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:38:42 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-52f3abdc-97a9-41f3-9b38-553956e10e12 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Creating volume b41a20c4-3be4-4081-ba58-2332e8b198b4 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:38:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-52f3abdc-97a9-41f3-9b38-553956e10e12 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-52f3abdc-97a9-41f3-9b38-553956e10e12 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:42 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-52f3abdc-97a9-41f3-9b38-553956e10e12 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:42 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-52f3abdc-97a9-41f3-9b38-553956e10e12 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-52f3abdc-97a9-41f3-9b38-553956e10e12 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:42 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-52f3abdc-97a9-41f3-9b38-553956e10e12 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:38:42 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-52f3abdc-97a9-41f3-9b38-553956e10e12 tempest-CreateVolumesFromSnapshotTest-1885067804 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:38:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-52f3abdc-97a9-41f3-9b38-553956e10e12 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b41a20c4-3be4-4081-ba58-2332e8b198b4 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:42 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d8ec0e7-8a97-42fb-ae45-888a01a03938) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a2f9cbc1-de9b-4e04-a841-0988f294bccd', 'volume_size': 1, 'image_id': 'b924798c-681b-448c-a8c8-d09879ea3769', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/b924798c-681b-448c-a8c8-d09879ea3769', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'private', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'ceaeb4044928abd10be52a51ad01c278', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': '428dbead44be4ddeb2ac477dd0fba469', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '4557c6a059b5572159cd5257a48283d6eed7350824b5ad17257ceb932a51e6205c2dd51fd6fd1843c28bac82249f21ec88536a6c586c4480c1b05e52a7f4c5bc', 'id': 'b924798c-681b-448c-a8c8-d09879ea3769', 'created_at': datetime.datetime(2026, 11, 1, 11, 38, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 38, 31, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/b924798c-681b-448c-a8c8-d09879ea3769/file', 'properties': {'cinder_img_volume_type': 'vol-type-for-6e9266ff-a917-4dd5-aa4a-c36e59e7a2a6'}}, 'image_service': }' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:42 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4680ce02-40c2-4951-a3cf-9d4e94b5de34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:42 devstack sudo[105675]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b41a20c4-3be4-4081-ba58-2332e8b198b4 1073741824 Nov 01 12:38:42 devstack sudo[105675]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:42 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a738b131-3978-4709-bba9-3e7d513ae156 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc8e7540-a32a-43ec-a958-ff29956527ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-390756b0-2726-422f-b616-c1bcd6ec01b9', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:42 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a738b131-3978-4709-bba9-3e7d513ae156 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de63cc08-7362-48be-8fe2-476100e5a1e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:42 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Volume volume-a2f9cbc1-de9b-4e04-a841-0988f294bccd (a2f9cbc1-de9b-4e04-a841-0988f294bccd): created successfully Nov 01 12:38:42 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4680ce02-40c2-4951-a3cf-9d4e94b5de34) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:42 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Flow 'volume_create_manager' (e21f2854-0933-4977-ac2c-ba73a8888f2c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:42 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-a738b131-3978-4709-bba9-3e7d513ae156 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Volume volume-390756b0-2726-422f-b616-c1bcd6ec01b9 (390756b0-2726-422f-b616-c1bcd6ec01b9): created successfully Nov 01 12:38:42 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a738b131-3978-4709-bba9-3e7d513ae156 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (de63cc08-7362-48be-8fe2-476100e5a1e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:42 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a738b131-3978-4709-bba9-3e7d513ae156 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Flow 'volume_create_manager' (cd8e477a-ca68-4b2c-ba63-e3785a61d49e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:42 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-6cfa1b83-8be5-4302-ac6b-3aea74c73169 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Created volume successfully. Nov 01 12:38:42 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-a738b131-3978-4709-bba9-3e7d513ae156 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Created volume successfully. Nov 01 12:38:42 devstack sudo[105671]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-94e90f6d-65d1-442e-8704-71c0e57f6b36 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.328s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:42 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-94e90f6d-65d1-442e-8704-71c0e57f6b36 tempest-ProjectMemberTests-538781697 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:38:42 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-94e90f6d-65d1-442e-8704-71c0e57f6b36 tempest-ProjectMemberTests-538781697 None] Deleted volume successfully. Nov 01 12:38:42 devstack sudo[105670]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a27aaf15-dffe-4534-b74a-13e109c05163 tempest-CreateVolumesFromImageTest-2025437841 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1748f7e9-00a3-4fe6-9222-fe01526a8acf" returned: 0 in 0.410s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a27aaf15-dffe-4534-b74a-13e109c05163 tempest-CreateVolumesFromImageTest-2025437841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1748f7e9-00a3-4fe6-9222-fe01526a8acf {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:42 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-94e90f6d-65d1-442e-8704-71c0e57f6b36 tempest-ProjectMemberTests-538781697 None] Lock "cinder-fe920575-fb85-4f83-9d1c-84791262bc0c-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:42 devstack sudo[105682]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1748f7e9-00a3-4fe6-9222-fe01526a8acf Nov 01 12:38:42 devstack sudo[105682]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:43 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ee49f738-1f9e-47a7-9072-bcd44af50241 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Acquiring lock "cinder-a2f9cbc1-de9b-4e04-a841-0988f294bccd-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:43 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ee49f738-1f9e-47a7-9072-bcd44af50241 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Lock "cinder-a2f9cbc1-de9b-4e04-a841-0988f294bccd-delete_volume" acquired by "delete_volume" :: waited 0.017s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:43 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ee49f738-1f9e-47a7-9072-bcd44af50241 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Acquiring lock "cinder-quobyte-a2f9cbc1-de9b-4e04-a841-0988f294bccd" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:43 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ee49f738-1f9e-47a7-9072-bcd44af50241 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Lock "cinder-quobyte-a2f9cbc1-de9b-4e04-a841-0988f294bccd" acquired by "delete_volume" :: waited 0.022s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:43 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[57ea664e-fa84-407d-ade7-8dd776e6e569]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ee49f738-1f9e-47a7-9072-bcd44af50241 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-a2f9cbc1-de9b-4e04-a841-0988f294bccd {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:43 devstack sudo[105687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-a2f9cbc1-de9b-4e04-a841-0988f294bccd Nov 01 12:38:43 devstack sudo[105687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:43 devstack sudo[105682]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a27aaf15-dffe-4534-b74a-13e109c05163 tempest-CreateVolumesFromImageTest-2025437841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-1748f7e9-00a3-4fe6-9222-fe01526a8acf" returned: 0 in 0.330s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:43 devstack sudo[105675]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-52f3abdc-97a9-41f3-9b38-553956e10e12 tempest-CreateVolumesFromSnapshotTest-1885067804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b41a20c4-3be4-4081-ba58-2332e8b198b4 1073741824" returned: 0 in 0.607s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:43 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a27aaf15-dffe-4534-b74a-13e109c05163 tempest-CreateVolumesFromImageTest-2025437841 None] Lock "cinder-quobyte-1748f7e9-00a3-4fe6-9222-fe01526a8acf" released by "delete_volume" :: held 0.810s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-52f3abdc-97a9-41f3-9b38-553956e10e12 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b41a20c4-3be4-4081-ba58-2332e8b198b4 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:43 devstack sudo[105690]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b41a20c4-3be4-4081-ba58-2332e8b198b4 Nov 01 12:38:43 devstack sudo[105690]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:43 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-a27aaf15-dffe-4534-b74a-13e109c05163 tempest-CreateVolumesFromImageTest-2025437841 None] Created reservations ['efb5f4f4-3b0f-4d5d-a3f8-3e4e159efa98', '37a7a22e-5d9a-43a2-be3a-9e0b6c7715f2', '41cbe40b-d480-4552-8b9d-785de56d81bb', '4459ce1f-496f-49b0-a7c5-3807e798e2a1'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:38:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a27aaf15-dffe-4534-b74a-13e109c05163 tempest-CreateVolumesFromImageTest-2025437841 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a27aaf15-dffe-4534-b74a-13e109c05163 tempest-CreateVolumesFromImageTest-2025437841 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:43 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a27aaf15-dffe-4534-b74a-13e109c05163 tempest-CreateVolumesFromImageTest-2025437841 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:43 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a27aaf15-dffe-4534-b74a-13e109c05163 tempest-CreateVolumesFromImageTest-2025437841 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a27aaf15-dffe-4534-b74a-13e109c05163 tempest-CreateVolumesFromImageTest-2025437841 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a27aaf15-dffe-4534-b74a-13e109c05163 tempest-CreateVolumesFromImageTest-2025437841 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:43 devstack sudo[105696]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:38:43 devstack sudo[105696]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:43 devstack sudo[105687]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ee49f738-1f9e-47a7-9072-bcd44af50241 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-a2f9cbc1-de9b-4e04-a841-0988f294bccd" returned: 0 in 0.521s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ee49f738-1f9e-47a7-9072-bcd44af50241 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-a2f9cbc1-de9b-4e04-a841-0988f294bccd {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:43 devstack sudo[105690]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-52f3abdc-97a9-41f3-9b38-553956e10e12 tempest-CreateVolumesFromSnapshotTest-1885067804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b41a20c4-3be4-4081-ba58-2332e8b198b4" returned: 0 in 0.347s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:43 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-52f3abdc-97a9-41f3-9b38-553956e10e12 tempest-CreateVolumesFromSnapshotTest-1885067804 None] <== create_volume: return (1016ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:38:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-52f3abdc-97a9-41f3-9b38-553956e10e12 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.022s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:43 devstack sudo[105699]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-a2f9cbc1-de9b-4e04-a841-0988f294bccd Nov 01 12:38:43 devstack sudo[105699]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d0362588-a060-4ba6-8502-29d2c8f5f6c9 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 4.751s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:43 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d0362588-a060-4ba6-8502-29d2c8f5f6c9 tempest-CreateVolumesFromSnapshotTest-1885067804 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-968595312',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=df1ec9cb-869d-409f-ac69-d6943672e009,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d9c934deca6c4332885263dd4cb83dfa',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:39Z,use_quota=True,user_id='362ff3df17dc46c7bf4bfaacc9db7290',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:38:43 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-d0362588-a060-4ba6-8502-29d2c8f5f6c9 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Creating volume df1ec9cb-869d-409f-ac69-d6943672e009 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:38:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d0362588-a060-4ba6-8502-29d2c8f5f6c9 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d0362588-a060-4ba6-8502-29d2c8f5f6c9 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:43 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d0362588-a060-4ba6-8502-29d2c8f5f6c9 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:43 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d0362588-a060-4ba6-8502-29d2c8f5f6c9 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d0362588-a060-4ba6-8502-29d2c8f5f6c9 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:43 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d0362588-a060-4ba6-8502-29d2c8f5f6c9 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:38:43 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-d0362588-a060-4ba6-8502-29d2c8f5f6c9 tempest-CreateVolumesFromSnapshotTest-1885067804 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:38:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d0362588-a060-4ba6-8502-29d2c8f5f6c9 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-df1ec9cb-869d-409f-ac69-d6943672e009 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:43 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-52f3abdc-97a9-41f3-9b38-553956e10e12 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (afe35828-5a47-4f50-b030-d0bee0ebc561) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b41a20c4-3be4-4081-ba58-2332e8b198b4', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:43 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-52f3abdc-97a9-41f3-9b38-553956e10e12 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf39ca05-fb82-4b97-880e-c387239854cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:43 devstack sudo[105701]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-df1ec9cb-869d-409f-ac69-d6943672e009 1073741824 Nov 01 12:38:43 devstack sudo[105701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:43 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-52f3abdc-97a9-41f3-9b38-553956e10e12 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Volume volume-b41a20c4-3be4-4081-ba58-2332e8b198b4 (b41a20c4-3be4-4081-ba58-2332e8b198b4): created successfully Nov 01 12:38:43 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-52f3abdc-97a9-41f3-9b38-553956e10e12 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cf39ca05-fb82-4b97-880e-c387239854cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:43 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-52f3abdc-97a9-41f3-9b38-553956e10e12 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Flow 'volume_create_manager' (5cf66d90-4d38-461e-b748-defa62edd4fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:43 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-52f3abdc-97a9-41f3-9b38-553956e10e12 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Created volume successfully. Nov 01 12:38:43 devstack sudo[105696]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a27aaf15-dffe-4534-b74a-13e109c05163 tempest-CreateVolumesFromImageTest-2025437841 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.315s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:43 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-a27aaf15-dffe-4534-b74a-13e109c05163 tempest-CreateVolumesFromImageTest-2025437841 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:38:43 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-a27aaf15-dffe-4534-b74a-13e109c05163 tempest-CreateVolumesFromImageTest-2025437841 None] Deleted volume successfully. Nov 01 12:38:43 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a27aaf15-dffe-4534-b74a-13e109c05163 tempest-CreateVolumesFromImageTest-2025437841 None] Lock "cinder-1748f7e9-00a3-4fe6-9222-fe01526a8acf-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:44 devstack sudo[105699]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ee49f738-1f9e-47a7-9072-bcd44af50241 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-a2f9cbc1-de9b-4e04-a841-0988f294bccd" returned: 0 in 0.425s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:44 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ee49f738-1f9e-47a7-9072-bcd44af50241 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Lock "cinder-quobyte-a2f9cbc1-de9b-4e04-a841-0988f294bccd" released by "delete_volume" :: held 1.029s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:44 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-ee49f738-1f9e-47a7-9072-bcd44af50241 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Created reservations ['c96006a0-2d0f-4b13-ac3a-8dcace44c212', '4e064c5b-c44e-49af-a181-e3521b51f9d7', 'fb9711de-5ec5-4407-9f7c-849d5e99e597', '7362e771-166b-41e8-9021-43763dab0cf3'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:38:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ee49f738-1f9e-47a7-9072-bcd44af50241 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ee49f738-1f9e-47a7-9072-bcd44af50241 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:44 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ee49f738-1f9e-47a7-9072-bcd44af50241 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:44 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ee49f738-1f9e-47a7-9072-bcd44af50241 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ee49f738-1f9e-47a7-9072-bcd44af50241 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ee49f738-1f9e-47a7-9072-bcd44af50241 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:44 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-8728d39a-27d1-44d3-bab3-c0a331ec0adb tempest-ProjectMemberTests-538781697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:38:44 devstack sudo[105743]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:38:44 devstack sudo[105743]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:44 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8728d39a-27d1-44d3-bab3-c0a331ec0adb tempest-ProjectMemberTests-538781697 None] Flow 'volume_create_manager' (c870328d-1cc7-40a1-9d77-a9c741c161f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:44 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8728d39a-27d1-44d3-bab3-c0a331ec0adb tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a331e20f-efb4-454d-8325-d4abc79b33e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:44 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8728d39a-27d1-44d3-bab3-c0a331ec0adb tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a331e20f-efb4-454d-8325-d4abc79b33e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2016225648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0169914-fbd3-4b82-93ab-30da137a9826,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe0ffaf6cf1d4294aa9f030164447d48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:44Z,use_quota=True,user_id='f617cd7e548d4a989b479812bba708f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:44 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8728d39a-27d1-44d3-bab3-c0a331ec0adb tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3465d728-421e-439d-aea6-98516eb0ffae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:44 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8728d39a-27d1-44d3-bab3-c0a331ec0adb tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3465d728-421e-439d-aea6-98516eb0ffae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:44 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8728d39a-27d1-44d3-bab3-c0a331ec0adb tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbdb5aa1-3fe0-45a8-9c01-f1793871e80a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:44 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8728d39a-27d1-44d3-bab3-c0a331ec0adb tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bbdb5aa1-3fe0-45a8-9c01-f1793871e80a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f0169914-fbd3-4b82-93ab-30da137a9826', 'volume_name': 'volume-f0169914-fbd3-4b82-93ab-30da137a9826', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:44 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8728d39a-27d1-44d3-bab3-c0a331ec0adb tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f26b8fb-73ea-4494-899c-71d5d4837ef0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:44 devstack sudo[105701]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:44 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8728d39a-27d1-44d3-bab3-c0a331ec0adb tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8f26b8fb-73ea-4494-899c-71d5d4837ef0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:44 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8728d39a-27d1-44d3-bab3-c0a331ec0adb tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7faa256-d8c7-4016-84da-749f6d3a4612) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:44 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-8728d39a-27d1-44d3-bab3-c0a331ec0adb tempest-ProjectMemberTests-538781697 None] Volume f0169914-fbd3-4b82-93ab-30da137a9826: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f0169914-fbd3-4b82-93ab-30da137a9826', 'volume_size': 1} Nov 01 12:38:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8728d39a-27d1-44d3-bab3-c0a331ec0adb tempest-ProjectMemberTests-538781697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d0362588-a060-4ba6-8502-29d2c8f5f6c9 tempest-CreateVolumesFromSnapshotTest-1885067804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-df1ec9cb-869d-409f-ac69-d6943672e009 1073741824" returned: 0 in 0.830s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d0362588-a060-4ba6-8502-29d2c8f5f6c9 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-df1ec9cb-869d-409f-ac69-d6943672e009 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:44 devstack sudo[105747]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-df1ec9cb-869d-409f-ac69-d6943672e009 Nov 01 12:38:44 devstack sudo[105747]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:44 devstack sudo[105743]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ee49f738-1f9e-47a7-9072-bcd44af50241 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.354s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:44 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-ee49f738-1f9e-47a7-9072-bcd44af50241 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:38:44 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-ee49f738-1f9e-47a7-9072-bcd44af50241 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Deleted volume successfully. Nov 01 12:38:44 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ee49f738-1f9e-47a7-9072-bcd44af50241 tempest-VolumeAndVolumeTypeFromImageTest-1477898287 None] Lock "cinder-a2f9cbc1-de9b-4e04-a841-0988f294bccd-delete_volume" released by "delete_volume" :: held 1.743s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:44 devstack sudo[105747]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d0362588-a060-4ba6-8502-29d2c8f5f6c9 tempest-CreateVolumesFromSnapshotTest-1885067804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-df1ec9cb-869d-409f-ac69-d6943672e009" returned: 0 in 0.287s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:44 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d0362588-a060-4ba6-8502-29d2c8f5f6c9 tempest-CreateVolumesFromSnapshotTest-1885067804 None] <== create_volume: return (1165ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:38:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d0362588-a060-4ba6-8502-29d2c8f5f6c9 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.168s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8728d39a-27d1-44d3-bab3-c0a331ec0adb tempest-ProjectMemberTests-538781697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.324s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:44 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-8728d39a-27d1-44d3-bab3-c0a331ec0adb tempest-ProjectMemberTests-538781697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2016225648',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f0169914-fbd3-4b82-93ab-30da137a9826,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe0ffaf6cf1d4294aa9f030164447d48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:44Z,use_quota=True,user_id='f617cd7e548d4a989b479812bba708f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:38:44 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-8728d39a-27d1-44d3-bab3-c0a331ec0adb tempest-ProjectMemberTests-538781697 None] Creating volume f0169914-fbd3-4b82-93ab-30da137a9826 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:38:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8728d39a-27d1-44d3-bab3-c0a331ec0adb tempest-ProjectMemberTests-538781697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8728d39a-27d1-44d3-bab3-c0a331ec0adb tempest-ProjectMemberTests-538781697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:44 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-8728d39a-27d1-44d3-bab3-c0a331ec0adb tempest-ProjectMemberTests-538781697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:44 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-8728d39a-27d1-44d3-bab3-c0a331ec0adb tempest-ProjectMemberTests-538781697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8728d39a-27d1-44d3-bab3-c0a331ec0adb tempest-ProjectMemberTests-538781697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:44 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-8728d39a-27d1-44d3-bab3-c0a331ec0adb tempest-ProjectMemberTests-538781697 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:38:44 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-8728d39a-27d1-44d3-bab3-c0a331ec0adb tempest-ProjectMemberTests-538781697 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:38:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8728d39a-27d1-44d3-bab3-c0a331ec0adb tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0169914-fbd3-4b82-93ab-30da137a9826 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:44 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d0362588-a060-4ba6-8502-29d2c8f5f6c9 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a6096ebb-0830-485a-b50f-3edb6dd5e3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-df1ec9cb-869d-409f-ac69-d6943672e009', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:44 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d0362588-a060-4ba6-8502-29d2c8f5f6c9 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ae29258-409f-4e9f-badb-2a12cf6f0f15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:44 devstack sudo[105751]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0169914-fbd3-4b82-93ab-30da137a9826 1073741824 Nov 01 12:38:44 devstack sudo[105751]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:44 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-d0362588-a060-4ba6-8502-29d2c8f5f6c9 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Volume volume-df1ec9cb-869d-409f-ac69-d6943672e009 (df1ec9cb-869d-409f-ac69-d6943672e009): created successfully Nov 01 12:38:44 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d0362588-a060-4ba6-8502-29d2c8f5f6c9 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6ae29258-409f-4e9f-badb-2a12cf6f0f15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:44 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d0362588-a060-4ba6-8502-29d2c8f5f6c9 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Flow 'volume_create_manager' (309a6ac7-1dbd-437d-9fc3-b6eab84bc407) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:44 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-d0362588-a060-4ba6-8502-29d2c8f5f6c9 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Created volume successfully. Nov 01 12:38:45 devstack sudo[105751]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8728d39a-27d1-44d3-bab3-c0a331ec0adb tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0169914-fbd3-4b82-93ab-30da137a9826 1073741824" returned: 0 in 0.505s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8728d39a-27d1-44d3-bab3-c0a331ec0adb tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0169914-fbd3-4b82-93ab-30da137a9826 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:45 devstack sudo[105758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0169914-fbd3-4b82-93ab-30da137a9826 Nov 01 12:38:45 devstack sudo[105758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:45 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-754d3ada-397a-4244-9f5b-5babde379579 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Acquiring lock "cinder-df1ec9cb-869d-409f-ac69-d6943672e009-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:45 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-754d3ada-397a-4244-9f5b-5babde379579 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "cinder-df1ec9cb-869d-409f-ac69-d6943672e009-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:45 devstack sudo[105758]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8728d39a-27d1-44d3-bab3-c0a331ec0adb tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0169914-fbd3-4b82-93ab-30da137a9826" returned: 0 in 0.310s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:45 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-8728d39a-27d1-44d3-bab3-c0a331ec0adb tempest-ProjectMemberTests-538781697 None] <== create_volume: return (860ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:38:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8728d39a-27d1-44d3-bab3-c0a331ec0adb tempest-ProjectMemberTests-538781697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.863s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:45 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-754d3ada-397a-4244-9f5b-5babde379579 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Acquiring lock "cinder-quobyte-df1ec9cb-869d-409f-ac69-d6943672e009" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:45 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8728d39a-27d1-44d3-bab3-c0a331ec0adb tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a7faa256-d8c7-4016-84da-749f6d3a4612) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f0169914-fbd3-4b82-93ab-30da137a9826', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:45 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8728d39a-27d1-44d3-bab3-c0a331ec0adb tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2334ace-df09-401e-bfff-71dd676f9883) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:45 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-754d3ada-397a-4244-9f5b-5babde379579 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "cinder-quobyte-df1ec9cb-869d-409f-ac69-d6943672e009" acquired by "delete_volume" :: waited 0.040s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:45 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-8728d39a-27d1-44d3-bab3-c0a331ec0adb tempest-ProjectMemberTests-538781697 None] Volume volume-f0169914-fbd3-4b82-93ab-30da137a9826 (f0169914-fbd3-4b82-93ab-30da137a9826): created successfully Nov 01 12:38:45 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8728d39a-27d1-44d3-bab3-c0a331ec0adb tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e2334ace-df09-401e-bfff-71dd676f9883) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:45 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8728d39a-27d1-44d3-bab3-c0a331ec0adb tempest-ProjectMemberTests-538781697 None] Flow 'volume_create_manager' (c870328d-1cc7-40a1-9d77-a9c741c161f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:45 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3aaafee-02d1-41dc-b58f-c42552ff197d]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-754d3ada-397a-4244-9f5b-5babde379579 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-df1ec9cb-869d-409f-ac69-d6943672e009 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:45 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-8728d39a-27d1-44d3-bab3-c0a331ec0adb tempest-ProjectMemberTests-538781697 None] Created volume successfully. Nov 01 12:38:45 devstack sudo[105761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-df1ec9cb-869d-409f-ac69-d6943672e009 Nov 01 12:38:45 devstack sudo[105761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:46 devstack sudo[105761]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-754d3ada-397a-4244-9f5b-5babde379579 tempest-CreateVolumesFromSnapshotTest-1885067804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-df1ec9cb-869d-409f-ac69-d6943672e009" returned: 0 in 0.431s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-754d3ada-397a-4244-9f5b-5babde379579 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-df1ec9cb-869d-409f-ac69-d6943672e009 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:46 devstack sudo[105766]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-df1ec9cb-869d-409f-ac69-d6943672e009 Nov 01 12:38:46 devstack sudo[105766]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d584765c-0ba3-4342-b340-9df5c3e00283 tempest-ProjectMemberTests-538781697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d584765c-0ba3-4342-b340-9df5c3e00283 tempest-ProjectMemberTests-538781697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:46 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-d584765c-0ba3-4342-b340-9df5c3e00283 tempest-ProjectMemberTests-538781697 None] Creating offline snapshot eb1d59fb-c898-4434-830c-474919abd18b of volume f0169914-fbd3-4b82-93ab-30da137a9826 {{(pid=86574) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:38:46 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cd2a172-d87e-446c-a355-323be3b96650]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d584765c-0ba3-4342-b340-9df5c3e00283 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0169914-fbd3-4b82-93ab-30da137a9826 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:46 devstack sudo[105766]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-754d3ada-397a-4244-9f5b-5babde379579 tempest-CreateVolumesFromSnapshotTest-1885067804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-df1ec9cb-869d-409f-ac69-d6943672e009" returned: 0 in 0.386s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:46 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-754d3ada-397a-4244-9f5b-5babde379579 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "cinder-quobyte-df1ec9cb-869d-409f-ac69-d6943672e009" released by "delete_volume" :: held 0.889s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:46 devstack sudo[105769]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0169914-fbd3-4b82-93ab-30da137a9826 Nov 01 12:38:46 devstack sudo[105769]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:46 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-754d3ada-397a-4244-9f5b-5babde379579 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Created reservations ['4f07710e-efb8-47d1-afd3-58c6bcb25729', 'a1fd2ac2-0c70-4df0-83ed-b8c7585a94bd', '3eed9392-4771-4b23-8353-c69e82e16b6a', '9b2f1ae6-cc4b-4553-a075-f7ed6eca8074'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:38:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-754d3ada-397a-4244-9f5b-5babde379579 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-754d3ada-397a-4244-9f5b-5babde379579 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:46 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-754d3ada-397a-4244-9f5b-5babde379579 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:46 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-754d3ada-397a-4244-9f5b-5babde379579 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-754d3ada-397a-4244-9f5b-5babde379579 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-754d3ada-397a-4244-9f5b-5babde379579 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:46 devstack sudo[105771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:38:46 devstack sudo[105771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:47 devstack sudo[105769]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d584765c-0ba3-4342-b340-9df5c3e00283 tempest-ProjectMemberTests-538781697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0169914-fbd3-4b82-93ab-30da137a9826" returned: 0 in 0.472s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d584765c-0ba3-4342-b340-9df5c3e00283 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0169914-fbd3-4b82-93ab-30da137a9826,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0169914-fbd3-4b82-93ab-30da137a9826.eb1d59fb-c898-4434-830c-474919abd18b 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:47 devstack sudo[105776]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0169914-fbd3-4b82-93ab-30da137a9826,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0169914-fbd3-4b82-93ab-30da137a9826.eb1d59fb-c898-4434-830c-474919abd18b 1G Nov 01 12:38:47 devstack sudo[105776]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:47 devstack sudo[105771]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-754d3ada-397a-4244-9f5b-5babde379579 tempest-CreateVolumesFromSnapshotTest-1885067804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.300s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:47 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-754d3ada-397a-4244-9f5b-5babde379579 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:38:47 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-754d3ada-397a-4244-9f5b-5babde379579 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Deleted volume successfully. Nov 01 12:38:47 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-754d3ada-397a-4244-9f5b-5babde379579 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "cinder-df1ec9cb-869d-409f-ac69-d6943672e009-delete_volume" released by "delete_volume" :: held 1.550s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:47 devstack sudo[105776]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d584765c-0ba3-4342-b340-9df5c3e00283 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0169914-fbd3-4b82-93ab-30da137a9826,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0169914-fbd3-4b82-93ab-30da137a9826.eb1d59fb-c898-4434-830c-474919abd18b 1G" returned: 0 in 0.601s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d584765c-0ba3-4342-b340-9df5c3e00283 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0169914-fbd3-4b82-93ab-30da137a9826 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0169914-fbd3-4b82-93ab-30da137a9826.eb1d59fb-c898-4434-830c-474919abd18b {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:47 devstack sudo[105782]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0169914-fbd3-4b82-93ab-30da137a9826 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0169914-fbd3-4b82-93ab-30da137a9826.eb1d59fb-c898-4434-830c-474919abd18b Nov 01 12:38:47 devstack sudo[105782]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:47 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-a276105e-f7ed-4047-9854-a417c81a8127 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:38:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a276105e-f7ed-4047-9854-a417c81a8127 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Flow 'volume_create_manager' (d1b62fab-1f7f-4e27-8e1f-3ca6c71fb929) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a276105e-f7ed-4047-9854-a417c81a8127 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (064ee904-868e-4e5d-a474-38426f434b08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a276105e-f7ed-4047-9854-a417c81a8127 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (064ee904-868e-4e5d-a474-38426f434b08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1076430671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37e3f6d1-d91c-4558-ad03-6bc4cf27a539,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe39de02f39844b1a92697cef58deb07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:48Z,use_quota=True,user_id='e5df31eef66842b2b4cc7ead7a3ba1ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a276105e-f7ed-4047-9854-a417c81a8127 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (710ba4a7-1112-4ee9-ad05-8f6bce0f0ea4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a276105e-f7ed-4047-9854-a417c81a8127 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (710ba4a7-1112-4ee9-ad05-8f6bce0f0ea4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a276105e-f7ed-4047-9854-a417c81a8127 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64a6167b-85fe-4842-968a-ffa6d099aa10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a276105e-f7ed-4047-9854-a417c81a8127 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (64a6167b-85fe-4842-968a-ffa6d099aa10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37e3f6d1-d91c-4558-ad03-6bc4cf27a539', 'volume_name': 'volume-37e3f6d1-d91c-4558-ad03-6bc4cf27a539', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a276105e-f7ed-4047-9854-a417c81a8127 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e612d132-c732-4709-8b67-1e74d3ebae5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a276105e-f7ed-4047-9854-a417c81a8127 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e612d132-c732-4709-8b67-1e74d3ebae5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a276105e-f7ed-4047-9854-a417c81a8127 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5ffff20-ea6f-4118-b600-d92509b90b06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:47 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-a276105e-f7ed-4047-9854-a417c81a8127 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Volume 37e3f6d1-d91c-4558-ad03-6bc4cf27a539: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37e3f6d1-d91c-4558-ad03-6bc4cf27a539', 'volume_size': 1} Nov 01 12:38:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a276105e-f7ed-4047-9854-a417c81a8127 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:47 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-3ab5de07-a1c9-4634-88b3-4d31e169f9d4 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Acquiring lock "cinder-b41a20c4-3be4-4081-ba58-2332e8b198b4-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:47 devstack sudo[105782]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:47 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-3ab5de07-a1c9-4634-88b3-4d31e169f9d4 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "cinder-b41a20c4-3be4-4081-ba58-2332e8b198b4-delete_volume" acquired by "delete_volume" :: waited 0.024s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d584765c-0ba3-4342-b340-9df5c3e00283 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f0169914-fbd3-4b82-93ab-30da137a9826 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0169914-fbd3-4b82-93ab-30da137a9826.eb1d59fb-c898-4434-830c-474919abd18b" returned: 0 in 0.346s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:48 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-d584765c-0ba3-4342-b340-9df5c3e00283 tempest-ProjectMemberTests-538781697 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0169914-fbd3-4b82-93ab-30da137a9826.eb1d59fb-c898-4434-830c-474919abd18b is being set with open permissions: ugo+rw Nov 01 12:38:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d584765c-0ba3-4342-b340-9df5c3e00283 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0169914-fbd3-4b82-93ab-30da137a9826.eb1d59fb-c898-4434-830c-474919abd18b {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:48 devstack sudo[105787]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0169914-fbd3-4b82-93ab-30da137a9826.eb1d59fb-c898-4434-830c-474919abd18b Nov 01 12:38:48 devstack sudo[105787]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:48 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-3ab5de07-a1c9-4634-88b3-4d31e169f9d4 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Acquiring lock "cinder-quobyte-b41a20c4-3be4-4081-ba58-2332e8b198b4" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:48 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-3ab5de07-a1c9-4634-88b3-4d31e169f9d4 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "cinder-quobyte-b41a20c4-3be4-4081-ba58-2332e8b198b4" acquired by "delete_volume" :: waited 0.020s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:48 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[01dcf25b-695e-42bc-a821-e9242bd4fc15]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3ab5de07-a1c9-4634-88b3-4d31e169f9d4 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b41a20c4-3be4-4081-ba58-2332e8b198b4 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:48 devstack sudo[105789]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b41a20c4-3be4-4081-ba58-2332e8b198b4 Nov 01 12:38:48 devstack sudo[105789]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:48 devstack sudo[105787]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d584765c-0ba3-4342-b340-9df5c3e00283 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0169914-fbd3-4b82-93ab-30da137a9826.eb1d59fb-c898-4434-830c-474919abd18b" returned: 0 in 0.298s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d584765c-0ba3-4342-b340-9df5c3e00283 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0169914-fbd3-4b82-93ab-30da137a9826.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:48 devstack sudo[105792]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0169914-fbd3-4b82-93ab-30da137a9826.info Nov 01 12:38:48 devstack sudo[105792]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:48 devstack sudo[105789]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3ab5de07-a1c9-4634-88b3-4d31e169f9d4 tempest-CreateVolumesFromSnapshotTest-1885067804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b41a20c4-3be4-4081-ba58-2332e8b198b4" returned: 0 in 0.434s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3ab5de07-a1c9-4634-88b3-4d31e169f9d4 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b41a20c4-3be4-4081-ba58-2332e8b198b4 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:48 devstack sudo[105798]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b41a20c4-3be4-4081-ba58-2332e8b198b4 Nov 01 12:38:48 devstack sudo[105798]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:48 devstack sudo[105792]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d584765c-0ba3-4342-b340-9df5c3e00283 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0169914-fbd3-4b82-93ab-30da137a9826.info" returned: 0 in 0.313s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:48 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-d584765c-0ba3-4342-b340-9df5c3e00283 tempest-ProjectMemberTests-538781697 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0169914-fbd3-4b82-93ab-30da137a9826.info is being set with open permissions: ugo+rw Nov 01 12:38:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d584765c-0ba3-4342-b340-9df5c3e00283 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0169914-fbd3-4b82-93ab-30da137a9826.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:48 devstack sudo[105801]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0169914-fbd3-4b82-93ab-30da137a9826.info Nov 01 12:38:48 devstack sudo[105801]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:48 devstack sudo[105798]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3ab5de07-a1c9-4634-88b3-4d31e169f9d4 tempest-CreateVolumesFromSnapshotTest-1885067804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-b41a20c4-3be4-4081-ba58-2332e8b198b4" returned: 0 in 0.293s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:48 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-3ab5de07-a1c9-4634-88b3-4d31e169f9d4 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "cinder-quobyte-b41a20c4-3be4-4081-ba58-2332e8b198b4" released by "delete_volume" :: held 0.785s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:48 devstack sudo[105801]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d584765c-0ba3-4342-b340-9df5c3e00283 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0169914-fbd3-4b82-93ab-30da137a9826.info" returned: 0 in 0.265s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d584765c-0ba3-4342-b340-9df5c3e00283 tempest-ProjectMemberTests-538781697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.416s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a276105e-f7ed-4047-9854-a417c81a8127 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.998s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:48 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a276105e-f7ed-4047-9854-a417c81a8127 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1076430671',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37e3f6d1-d91c-4558-ad03-6bc4cf27a539,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe39de02f39844b1a92697cef58deb07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:48Z,use_quota=True,user_id='e5df31eef66842b2b4cc7ead7a3ba1ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:38:48 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-a276105e-f7ed-4047-9854-a417c81a8127 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Creating volume 37e3f6d1-d91c-4558-ad03-6bc4cf27a539 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:38:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a276105e-f7ed-4047-9854-a417c81a8127 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a276105e-f7ed-4047-9854-a417c81a8127 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:48 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a276105e-f7ed-4047-9854-a417c81a8127 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:48 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a276105e-f7ed-4047-9854-a417c81a8127 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a276105e-f7ed-4047-9854-a417c81a8127 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:48 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a276105e-f7ed-4047-9854-a417c81a8127 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:38:48 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-a276105e-f7ed-4047-9854-a417c81a8127 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:38:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a276105e-f7ed-4047-9854-a417c81a8127 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-37e3f6d1-d91c-4558-ad03-6bc4cf27a539 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:48 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-3ab5de07-a1c9-4634-88b3-4d31e169f9d4 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Created reservations ['b0c3669d-2cf9-4408-acb1-313c1f61de45', '8a151e74-c100-480e-958c-497a8c168a99', '7c929e53-6756-442f-baaa-494c4ece9598', '45d7cd6b-2d85-4a6d-a0d2-973acae4b25f'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:38:48 devstack sudo[105805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-37e3f6d1-d91c-4558-ad03-6bc4cf27a539 1073741824 Nov 01 12:38:48 devstack sudo[105805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:49 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-d584765c-0ba3-4342-b340-9df5c3e00283 tempest-ProjectMemberTests-538781697 None] Create snapshot completed successfully Nov 01 12:38:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-3ab5de07-a1c9-4634-88b3-4d31e169f9d4 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-3ab5de07-a1c9-4634-88b3-4d31e169f9d4 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:49 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-3ab5de07-a1c9-4634-88b3-4d31e169f9d4 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:49 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-3ab5de07-a1c9-4634-88b3-4d31e169f9d4 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-3ab5de07-a1c9-4634-88b3-4d31e169f9d4 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3ab5de07-a1c9-4634-88b3-4d31e169f9d4 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:49 devstack sudo[105807]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:38:49 devstack sudo[105807]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:49 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-de72f3ce-60d5-40d9-995c-ff7370f57a14 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Acquiring lock "cinder-390756b0-2726-422f-b616-c1bcd6ec01b9-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:49 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-de72f3ce-60d5-40d9-995c-ff7370f57a14 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "cinder-390756b0-2726-422f-b616-c1bcd6ec01b9-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:49 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-de72f3ce-60d5-40d9-995c-ff7370f57a14 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Acquiring lock "cinder-quobyte-390756b0-2726-422f-b616-c1bcd6ec01b9" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:49 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-de72f3ce-60d5-40d9-995c-ff7370f57a14 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "cinder-quobyte-390756b0-2726-422f-b616-c1bcd6ec01b9" acquired by "delete_volume" :: waited 0.028s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:49 devstack sudo[105807]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3ab5de07-a1c9-4634-88b3-4d31e169f9d4 tempest-CreateVolumesFromSnapshotTest-1885067804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.283s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:49 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-3ab5de07-a1c9-4634-88b3-4d31e169f9d4 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:38:49 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-3ab5de07-a1c9-4634-88b3-4d31e169f9d4 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Deleted volume successfully. Nov 01 12:38:49 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[a75600af-404b-4f32-84d7-2ce13421da88]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-de72f3ce-60d5-40d9-995c-ff7370f57a14 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-390756b0-2726-422f-b616-c1bcd6ec01b9 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:49 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-3ab5de07-a1c9-4634-88b3-4d31e169f9d4 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "cinder-b41a20c4-3be4-4081-ba58-2332e8b198b4-delete_volume" released by "delete_volume" :: held 1.414s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:49 devstack sudo[105813]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-390756b0-2726-422f-b616-c1bcd6ec01b9 Nov 01 12:38:49 devstack sudo[105813]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:49 devstack sudo[105805]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a276105e-f7ed-4047-9854-a417c81a8127 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-37e3f6d1-d91c-4558-ad03-6bc4cf27a539 1073741824" returned: 0 in 0.593s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a276105e-f7ed-4047-9854-a417c81a8127 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-37e3f6d1-d91c-4558-ad03-6bc4cf27a539 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:49 devstack sudo[105816]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-37e3f6d1-d91c-4558-ad03-6bc4cf27a539 Nov 01 12:38:49 devstack sudo[105816]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:49 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-4dc52537-5d2e-449a-bf34-1abfbc0b0372 tempest-ProjectMemberTests-538781697 None] Acquiring lock "cinder-eb1d59fb-c898-4434-830c-474919abd18b-delete_snapshot" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:49 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-4dc52537-5d2e-449a-bf34-1abfbc0b0372 tempest-ProjectMemberTests-538781697 None] Lock "cinder-eb1d59fb-c898-4434-830c-474919abd18b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.036s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:49 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-4dc52537-5d2e-449a-bf34-1abfbc0b0372 tempest-ProjectMemberTests-538781697 None] Acquiring lock "cinder-quobyte-f0169914-fbd3-4b82-93ab-30da137a9826" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:49 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-4dc52537-5d2e-449a-bf34-1abfbc0b0372 tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-f0169914-fbd3-4b82-93ab-30da137a9826" acquired by "delete_snapshot" :: waited 0.029s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:49 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-4dc52537-5d2e-449a-bf34-1abfbc0b0372 tempest-ProjectMemberTests-538781697 None] Acquiring lock "cinder-quobyte-eb1d59fb-c898-4434-830c-474919abd18b" by "_delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:49 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-4dc52537-5d2e-449a-bf34-1abfbc0b0372 tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-eb1d59fb-c898-4434-830c-474919abd18b" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:49 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-4dc52537-5d2e-449a-bf34-1abfbc0b0372 tempest-ProjectMemberTests-538781697 None] Deleting offline snapshot eb1d59fb-c898-4434-830c-474919abd18b of volume f0169914-fbd3-4b82-93ab-30da137a9826 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:38:49 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-4dc52537-5d2e-449a-bf34-1abfbc0b0372 tempest-ProjectMemberTests-538781697 None] snapshot_file for this snap is: volume-f0169914-fbd3-4b82-93ab-30da137a9826.eb1d59fb-c898-4434-830c-474919abd18b {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:38:49 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[7a1735e1-4577-49b8-b311-f6c709441d90]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4dc52537-5d2e-449a-bf34-1abfbc0b0372 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0169914-fbd3-4b82-93ab-30da137a9826.eb1d59fb-c898-4434-830c-474919abd18b {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:49 devstack sudo[105813]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-de72f3ce-60d5-40d9-995c-ff7370f57a14 tempest-CreateVolumesFromSnapshotTest-1885067804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-390756b0-2726-422f-b616-c1bcd6ec01b9" returned: 0 in 0.513s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-de72f3ce-60d5-40d9-995c-ff7370f57a14 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-390756b0-2726-422f-b616-c1bcd6ec01b9 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:49 devstack sudo[105822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-390756b0-2726-422f-b616-c1bcd6ec01b9 Nov 01 12:38:49 devstack sudo[105822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:49 devstack sudo[105816]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a276105e-f7ed-4047-9854-a417c81a8127 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-37e3f6d1-d91c-4558-ad03-6bc4cf27a539" returned: 0 in 0.354s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:49 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a276105e-f7ed-4047-9854-a417c81a8127 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] <== create_volume: return (995ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:38:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a276105e-f7ed-4047-9854-a417c81a8127 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.997s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:49 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a276105e-f7ed-4047-9854-a417c81a8127 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5ffff20-ea6f-4118-b600-d92509b90b06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37e3f6d1-d91c-4558-ad03-6bc4cf27a539', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:49 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a276105e-f7ed-4047-9854-a417c81a8127 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b676345b-39c7-4208-b436-29c2b39ff902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:49 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-a276105e-f7ed-4047-9854-a417c81a8127 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Volume volume-37e3f6d1-d91c-4558-ad03-6bc4cf27a539 (37e3f6d1-d91c-4558-ad03-6bc4cf27a539): created successfully Nov 01 12:38:49 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a276105e-f7ed-4047-9854-a417c81a8127 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b676345b-39c7-4208-b436-29c2b39ff902) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:49 devstack sudo[105821]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0169914-fbd3-4b82-93ab-30da137a9826.eb1d59fb-c898-4434-830c-474919abd18b Nov 01 12:38:49 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a276105e-f7ed-4047-9854-a417c81a8127 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Flow 'volume_create_manager' (d1b62fab-1f7f-4e27-8e1f-3ca6c71fb929) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:49 devstack sudo[105821]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:50 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-a276105e-f7ed-4047-9854-a417c81a8127 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Created volume successfully. Nov 01 12:38:50 devstack sudo[105822]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-de72f3ce-60d5-40d9-995c-ff7370f57a14 tempest-CreateVolumesFromSnapshotTest-1885067804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-390756b0-2726-422f-b616-c1bcd6ec01b9" returned: 0 in 0.288s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:50 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-de72f3ce-60d5-40d9-995c-ff7370f57a14 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "cinder-quobyte-390756b0-2726-422f-b616-c1bcd6ec01b9" released by "delete_volume" :: held 0.877s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:50 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-de72f3ce-60d5-40d9-995c-ff7370f57a14 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Created reservations ['463c053e-a031-414d-9d2b-37cf35f7f649', 'f9b04eb7-3a98-459d-b111-e655a7f1fa56', '93c9462d-8e42-4842-8bfb-2a2c9566cabb', '637d73f8-9a5e-496d-8600-cf213e10d180'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:38:50 devstack sudo[105821]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4dc52537-5d2e-449a-bf34-1abfbc0b0372 tempest-ProjectMemberTests-538781697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0169914-fbd3-4b82-93ab-30da137a9826.eb1d59fb-c898-4434-830c-474919abd18b" returned: 0 in 0.482s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:50 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-4dc52537-5d2e-449a-bf34-1abfbc0b0372 tempest-ProjectMemberTests-538781697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f0169914-fbd3-4b82-93ab-30da137a9826(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:38:50 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[7ff101f5-8864-4e7a-95dc-56b42d07b3fb]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4dc52537-5d2e-449a-bf34-1abfbc0b0372 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0169914-fbd3-4b82-93ab-30da137a9826 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-de72f3ce-60d5-40d9-995c-ff7370f57a14 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-de72f3ce-60d5-40d9-995c-ff7370f57a14 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:50 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-de72f3ce-60d5-40d9-995c-ff7370f57a14 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:50 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-de72f3ce-60d5-40d9-995c-ff7370f57a14 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-de72f3ce-60d5-40d9-995c-ff7370f57a14 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-de72f3ce-60d5-40d9-995c-ff7370f57a14 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:50 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-9aecc9cb-c36a-44d0-acb7-8a83f75d10a7 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Acquiring lock "cinder-6448a0ac-f896-45e2-b45f-8f0dafa28093-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:50 devstack sudo[105831]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:38:50 devstack sudo[105831]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:50 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-9aecc9cb-c36a-44d0-acb7-8a83f75d10a7 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "cinder-6448a0ac-f896-45e2-b45f-8f0dafa28093-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:50 devstack sudo[105830]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0169914-fbd3-4b82-93ab-30da137a9826 Nov 01 12:38:50 devstack sudo[105830]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:50 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-9aecc9cb-c36a-44d0-acb7-8a83f75d10a7 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Acquiring lock "cinder-quobyte-6448a0ac-f896-45e2-b45f-8f0dafa28093" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:50 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-9aecc9cb-c36a-44d0-acb7-8a83f75d10a7 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "cinder-quobyte-6448a0ac-f896-45e2-b45f-8f0dafa28093" acquired by "delete_volume" :: waited 0.024s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:50 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[b270fd91-661f-42a7-89c1-45b4d72be55c]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9aecc9cb-c36a-44d0-acb7-8a83f75d10a7 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6448a0ac-f896-45e2-b45f-8f0dafa28093 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:50 devstack sudo[105834]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6448a0ac-f896-45e2-b45f-8f0dafa28093 Nov 01 12:38:50 devstack sudo[105834]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:50 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-8e230d5e-8bd6-49c7-ad51-5d453e87944f tempest-VolumeDependencyTests-648381524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:38:50 devstack sudo[105831]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8e230d5e-8bd6-49c7-ad51-5d453e87944f tempest-VolumeDependencyTests-648381524 None] Flow 'volume_create_manager' (142d0431-fb8a-4399-861c-67f0c2e9b7a3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8e230d5e-8bd6-49c7-ad51-5d453e87944f tempest-VolumeDependencyTests-648381524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c46fab9-384d-4706-8ba2-1aa80fc799ab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-de72f3ce-60d5-40d9-995c-ff7370f57a14 tempest-CreateVolumesFromSnapshotTest-1885067804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.410s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:50 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-de72f3ce-60d5-40d9-995c-ff7370f57a14 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:38:50 devstack sudo[105830]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4dc52537-5d2e-449a-bf34-1abfbc0b0372 tempest-ProjectMemberTests-538781697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0169914-fbd3-4b82-93ab-30da137a9826" returned: 0 in 0.466s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:50 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-de72f3ce-60d5-40d9-995c-ff7370f57a14 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Deleted volume successfully. Nov 01 12:38:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4dc52537-5d2e-449a-bf34-1abfbc0b0372 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0169914-fbd3-4b82-93ab-30da137a9826.eb1d59fb-c898-4434-830c-474919abd18b {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8e230d5e-8bd6-49c7-ad51-5d453e87944f tempest-VolumeDependencyTests-648381524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6c46fab9-384d-4706-8ba2-1aa80fc799ab) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-574426804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22d85a4e-2114-4dd2-b912-a280dfc5c64d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb39a7a774444abcaa3b6a8cbfef8f95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:51Z,use_quota=True,user_id='296a919ba5574538ae75a586bd625da3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:50 devstack sudo[105841]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0169914-fbd3-4b82-93ab-30da137a9826.eb1d59fb-c898-4434-830c-474919abd18b Nov 01 12:38:50 devstack sudo[105841]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8e230d5e-8bd6-49c7-ad51-5d453e87944f tempest-VolumeDependencyTests-648381524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b2d60f3-e8a9-4443-b0dd-7606e386ff0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8e230d5e-8bd6-49c7-ad51-5d453e87944f tempest-VolumeDependencyTests-648381524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b2d60f3-e8a9-4443-b0dd-7606e386ff0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8e230d5e-8bd6-49c7-ad51-5d453e87944f tempest-VolumeDependencyTests-648381524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1979f4aa-32cf-4a11-85fb-995dbee6dae5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8e230d5e-8bd6-49c7-ad51-5d453e87944f tempest-VolumeDependencyTests-648381524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1979f4aa-32cf-4a11-85fb-995dbee6dae5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '22d85a4e-2114-4dd2-b912-a280dfc5c64d', 'volume_name': 'volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8e230d5e-8bd6-49c7-ad51-5d453e87944f tempest-VolumeDependencyTests-648381524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (559f7a95-a976-4aaf-85d5-c29354785d3c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8e230d5e-8bd6-49c7-ad51-5d453e87944f tempest-VolumeDependencyTests-648381524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (559f7a95-a976-4aaf-85d5-c29354785d3c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8e230d5e-8bd6-49c7-ad51-5d453e87944f tempest-VolumeDependencyTests-648381524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73ecd99b-bd43-4d3f-ac24-ca2c183498a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:50 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-8e230d5e-8bd6-49c7-ad51-5d453e87944f tempest-VolumeDependencyTests-648381524 None] Volume 22d85a4e-2114-4dd2-b912-a280dfc5c64d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d', 'volume_size': 1} Nov 01 12:38:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8e230d5e-8bd6-49c7-ad51-5d453e87944f tempest-VolumeDependencyTests-648381524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8e230d5e-8bd6-49c7-ad51-5d453e87944f tempest-VolumeDependencyTests-648381524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:50 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-8e230d5e-8bd6-49c7-ad51-5d453e87944f tempest-VolumeDependencyTests-648381524 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-574426804',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=22d85a4e-2114-4dd2-b912-a280dfc5c64d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb39a7a774444abcaa3b6a8cbfef8f95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:51Z,use_quota=True,user_id='296a919ba5574538ae75a586bd625da3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:38:50 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-8e230d5e-8bd6-49c7-ad51-5d453e87944f tempest-VolumeDependencyTests-648381524 None] Creating volume 22d85a4e-2114-4dd2-b912-a280dfc5c64d {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:38:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8e230d5e-8bd6-49c7-ad51-5d453e87944f tempest-VolumeDependencyTests-648381524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8e230d5e-8bd6-49c7-ad51-5d453e87944f tempest-VolumeDependencyTests-648381524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:50 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-8e230d5e-8bd6-49c7-ad51-5d453e87944f tempest-VolumeDependencyTests-648381524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:50 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-8e230d5e-8bd6-49c7-ad51-5d453e87944f tempest-VolumeDependencyTests-648381524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8e230d5e-8bd6-49c7-ad51-5d453e87944f tempest-VolumeDependencyTests-648381524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:50 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-8e230d5e-8bd6-49c7-ad51-5d453e87944f tempest-VolumeDependencyTests-648381524 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:38:50 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-8e230d5e-8bd6-49c7-ad51-5d453e87944f tempest-VolumeDependencyTests-648381524 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:38:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8e230d5e-8bd6-49c7-ad51-5d453e87944f tempest-VolumeDependencyTests-648381524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:50 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-de72f3ce-60d5-40d9-995c-ff7370f57a14 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "cinder-390756b0-2726-422f-b616-c1bcd6ec01b9-delete_volume" released by "delete_volume" :: held 1.717s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:50 devstack sudo[105843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d 1073741824 Nov 01 12:38:50 devstack sudo[105843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:51 devstack sudo[105834]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9aecc9cb-c36a-44d0-acb7-8a83f75d10a7 tempest-CreateVolumesFromSnapshotTest-1885067804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6448a0ac-f896-45e2-b45f-8f0dafa28093" returned: 0 in 0.458s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9aecc9cb-c36a-44d0-acb7-8a83f75d10a7 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6448a0ac-f896-45e2-b45f-8f0dafa28093 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:51 devstack sudo[105849]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6448a0ac-f896-45e2-b45f-8f0dafa28093 Nov 01 12:38:51 devstack sudo[105849]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:51 devstack sudo[105841]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4dc52537-5d2e-449a-bf34-1abfbc0b0372 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0169914-fbd3-4b82-93ab-30da137a9826.eb1d59fb-c898-4434-830c-474919abd18b" returned: 0 in 0.449s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4dc52537-5d2e-449a-bf34-1abfbc0b0372 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0169914-fbd3-4b82-93ab-30da137a9826.eb1d59fb-c898-4434-830c-474919abd18b {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:51 devstack sudo[105857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0169914-fbd3-4b82-93ab-30da137a9826.eb1d59fb-c898-4434-830c-474919abd18b Nov 01 12:38:51 devstack sudo[105857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:51 devstack sudo[105849]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9aecc9cb-c36a-44d0-acb7-8a83f75d10a7 tempest-CreateVolumesFromSnapshotTest-1885067804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6448a0ac-f896-45e2-b45f-8f0dafa28093" returned: 0 in 0.343s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:51 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-9aecc9cb-c36a-44d0-acb7-8a83f75d10a7 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "cinder-quobyte-6448a0ac-f896-45e2-b45f-8f0dafa28093" released by "delete_volume" :: held 0.876s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:51 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-9aecc9cb-c36a-44d0-acb7-8a83f75d10a7 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Created reservations ['20ac632c-facb-4245-a51e-857fb032bc83', '44ab3090-0e23-407f-b5ee-09092aae1c61', '33e78665-9b39-46e5-b0be-6fb1d47798cf', 'f58f2c31-1751-4b82-b053-0c491ec309f1'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:38:51 devstack sudo[105843]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8e230d5e-8bd6-49c7-ad51-5d453e87944f tempest-VolumeDependencyTests-648381524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d 1073741824" returned: 0 in 0.633s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8e230d5e-8bd6-49c7-ad51-5d453e87944f tempest-VolumeDependencyTests-648381524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-9aecc9cb-c36a-44d0-acb7-8a83f75d10a7 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-9aecc9cb-c36a-44d0-acb7-8a83f75d10a7 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:51 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-9aecc9cb-c36a-44d0-acb7-8a83f75d10a7 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:51 devstack sudo[105862]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d Nov 01 12:38:51 devstack sudo[105862]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:51 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-9aecc9cb-c36a-44d0-acb7-8a83f75d10a7 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-9aecc9cb-c36a-44d0-acb7-8a83f75d10a7 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9aecc9cb-c36a-44d0-acb7-8a83f75d10a7 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:51 devstack sudo[105857]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:51 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-c2e17ed6-403d-4d9a-aff6-6eed550df018 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:38:51 devstack sudo[105864]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:38:51 devstack sudo[105864]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:51 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c2e17ed6-403d-4d9a-aff6-6eed550df018 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Flow 'volume_create_manager' (5eff6563-8724-4095-8e4c-8624a9aca463) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:51 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c2e17ed6-403d-4d9a-aff6-6eed550df018 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (360bfa74-379c-4fef-8e70-5f29c22959c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4dc52537-5d2e-449a-bf34-1abfbc0b0372 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0169914-fbd3-4b82-93ab-30da137a9826.eb1d59fb-c898-4434-830c-474919abd18b" returned: 0 in 0.466s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:51 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c2e17ed6-403d-4d9a-aff6-6eed550df018 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (360bfa74-379c-4fef-8e70-5f29c22959c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1548905473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0249fc2-21f9-410b-9af7-12979e365338,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe39de02f39844b1a92697cef58deb07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:52Z,use_quota=True,user_id='e5df31eef66842b2b4cc7ead7a3ba1ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:51 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c2e17ed6-403d-4d9a-aff6-6eed550df018 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3655c407-8694-4dab-82f8-5b6a916b7c44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:51 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c2e17ed6-403d-4d9a-aff6-6eed550df018 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3655c407-8694-4dab-82f8-5b6a916b7c44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:51 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c2e17ed6-403d-4d9a-aff6-6eed550df018 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a857c17-192b-4cf5-aac6-f065e747c91e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:51 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c2e17ed6-403d-4d9a-aff6-6eed550df018 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a857c17-192b-4cf5-aac6-f065e747c91e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0249fc2-21f9-410b-9af7-12979e365338', 'volume_name': 'volume-d0249fc2-21f9-410b-9af7-12979e365338', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:51 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c2e17ed6-403d-4d9a-aff6-6eed550df018 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80a4c936-c1ae-4431-93ee-c79751d2a78e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:51 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c2e17ed6-403d-4d9a-aff6-6eed550df018 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (80a4c936-c1ae-4431-93ee-c79751d2a78e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:51 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c2e17ed6-403d-4d9a-aff6-6eed550df018 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcd4851d-150e-4b61-af80-d835444543b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:51 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-c2e17ed6-403d-4d9a-aff6-6eed550df018 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Volume d0249fc2-21f9-410b-9af7-12979e365338: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0249fc2-21f9-410b-9af7-12979e365338', 'volume_size': 1} Nov 01 12:38:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-c2e17ed6-403d-4d9a-aff6-6eed550df018 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:51 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-4dc52537-5d2e-449a-bf34-1abfbc0b0372 tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-eb1d59fb-c898-4434-830c-474919abd18b" released by "_delete_snapshot" :: held 2.102s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:51 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-4dc52537-5d2e-449a-bf34-1abfbc0b0372 tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-f0169914-fbd3-4b82-93ab-30da137a9826" released by "delete_snapshot" :: held 2.134s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:51 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-4dc52537-5d2e-449a-bf34-1abfbc0b0372 tempest-ProjectMemberTests-538781697 None] Created reservations ['e5d4dea1-d603-4fb4-b735-6e8255d10c3d', '736a7f9e-c9c9-4b4a-9362-74cc0a3d62e0', 'e9e1db29-6ff6-47c3-9057-cf3477ee5a35', 'c06c68bd-7a20-4426-a521-db469ef4e428'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:38:52 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-4dc52537-5d2e-449a-bf34-1abfbc0b0372 tempest-ProjectMemberTests-538781697 None] Delete snapshot completed successfully. Nov 01 12:38:52 devstack sudo[105864]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-4dc52537-5d2e-449a-bf34-1abfbc0b0372 tempest-ProjectMemberTests-538781697 None] Lock "cinder-eb1d59fb-c898-4434-830c-474919abd18b-delete_snapshot" released by "delete_snapshot" :: held 2.369s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9aecc9cb-c36a-44d0-acb7-8a83f75d10a7 tempest-CreateVolumesFromSnapshotTest-1885067804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.428s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-9aecc9cb-c36a-44d0-acb7-8a83f75d10a7 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:38:52 devstack sudo[105862]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-bf27882f-7088-447f-b909-8c8bdd447e0a tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-bf27882f-7088-447f-b909-8c8bdd447e0a tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Flow 'volume_create_manager' (ecb04bf0-1530-4fa8-a4f2-53ff6bdf93e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-bf27882f-7088-447f-b909-8c8bdd447e0a tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bafb6a6-4f7e-4e4b-86ea-f517b905f2ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:52 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-9aecc9cb-c36a-44d0-acb7-8a83f75d10a7 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Deleted volume successfully. Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8e230d5e-8bd6-49c7-ad51-5d453e87944f tempest-VolumeDependencyTests-648381524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d" returned: 0 in 0.525s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-8e230d5e-8bd6-49c7-ad51-5d453e87944f tempest-VolumeDependencyTests-648381524 None] <== create_volume: return (1243ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8e230d5e-8bd6-49c7-ad51-5d453e87944f tempest-VolumeDependencyTests-648381524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.245s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-c2e17ed6-403d-4d9a-aff6-6eed550df018 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.331s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-c2e17ed6-403d-4d9a-aff6-6eed550df018 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1548905473',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0249fc2-21f9-410b-9af7-12979e365338,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe39de02f39844b1a92697cef58deb07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:52Z,use_quota=True,user_id='e5df31eef66842b2b4cc7ead7a3ba1ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-c2e17ed6-403d-4d9a-aff6-6eed550df018 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Creating volume d0249fc2-21f9-410b-9af7-12979e365338 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-c2e17ed6-403d-4d9a-aff6-6eed550df018 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-c2e17ed6-403d-4d9a-aff6-6eed550df018 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-c2e17ed6-403d-4d9a-aff6-6eed550df018 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-c2e17ed6-403d-4d9a-aff6-6eed550df018 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-c2e17ed6-403d-4d9a-aff6-6eed550df018 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-c2e17ed6-403d-4d9a-aff6-6eed550df018 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:38:52 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-c2e17ed6-403d-4d9a-aff6-6eed550df018 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c2e17ed6-403d-4d9a-aff6-6eed550df018 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d0249fc2-21f9-410b-9af7-12979e365338 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-bf27882f-7088-447f-b909-8c8bdd447e0a tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7bafb6a6-4f7e-4e4b-86ea-f517b905f2ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2084187682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2db46282-c878-45b1-bfb8-fc86ea419ba2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe39de02f39844b1a92697cef58deb07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:52Z,use_quota=True,user_id='e5df31eef66842b2b4cc7ead7a3ba1ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-bf27882f-7088-447f-b909-8c8bdd447e0a tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccdeb7bd-1ee1-40a6-b5c0-c2eb069ddd0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:52 devstack sudo[105868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d0249fc2-21f9-410b-9af7-12979e365338 1073741824 Nov 01 12:38:52 devstack sudo[105868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-bf27882f-7088-447f-b909-8c8bdd447e0a tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ccdeb7bd-1ee1-40a6-b5c0-c2eb069ddd0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-bf27882f-7088-447f-b909-8c8bdd447e0a tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca71c384-4201-4666-9f55-7fe228ecae03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-bf27882f-7088-447f-b909-8c8bdd447e0a tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca71c384-4201-4666-9f55-7fe228ecae03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2db46282-c878-45b1-bfb8-fc86ea419ba2', 'volume_name': 'volume-2db46282-c878-45b1-bfb8-fc86ea419ba2', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-bf27882f-7088-447f-b909-8c8bdd447e0a tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56f251bc-44b8-438a-9a46-11e82a6635e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-bf27882f-7088-447f-b909-8c8bdd447e0a tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (56f251bc-44b8-438a-9a46-11e82a6635e6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-bf27882f-7088-447f-b909-8c8bdd447e0a tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0c5ab24-3e22-4d2a-8fb2-94684f118b93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:52 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-bf27882f-7088-447f-b909-8c8bdd447e0a tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Volume 2db46282-c878-45b1-bfb8-fc86ea419ba2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2db46282-c878-45b1-bfb8-fc86ea419ba2', 'volume_size': 1} Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-bf27882f-7088-447f-b909-8c8bdd447e0a tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8e230d5e-8bd6-49c7-ad51-5d453e87944f tempest-VolumeDependencyTests-648381524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (73ecd99b-bd43-4d3f-ac24-ca2c183498a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8e230d5e-8bd6-49c7-ad51-5d453e87944f tempest-VolumeDependencyTests-648381524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8bad3cd-ba80-4faf-b42b-336b1e1bca3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-9aecc9cb-c36a-44d0-acb7-8a83f75d10a7 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "cinder-6448a0ac-f896-45e2-b45f-8f0dafa28093-delete_volume" released by "delete_volume" :: held 1.779s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:52 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-8e230d5e-8bd6-49c7-ad51-5d453e87944f tempest-VolumeDependencyTests-648381524 None] Volume volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d (22d85a4e-2114-4dd2-b912-a280dfc5c64d): created successfully Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8e230d5e-8bd6-49c7-ad51-5d453e87944f tempest-VolumeDependencyTests-648381524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d8bad3cd-ba80-4faf-b42b-336b1e1bca3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8e230d5e-8bd6-49c7-ad51-5d453e87944f tempest-VolumeDependencyTests-648381524 None] Flow 'volume_create_manager' (142d0431-fb8a-4399-861c-67f0c2e9b7a3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:52 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-8e230d5e-8bd6-49c7-ad51-5d453e87944f tempest-VolumeDependencyTests-648381524 None] Created volume successfully. Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-5548062e-7bfb-469c-9e72-1182a02a880c tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5548062e-7bfb-469c-9e72-1182a02a880c tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Flow 'volume_create_manager' (88ad028d-8513-44a9-b84b-5cccbb9e0540) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5548062e-7bfb-469c-9e72-1182a02a880c tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd6fc6bd-1625-434e-b89b-f4709def9220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5548062e-7bfb-469c-9e72-1182a02a880c tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dd6fc6bd-1625-434e-b89b-f4709def9220) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-135584061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebbdda3e-f73e-48ac-84a5-c371439cd011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe39de02f39844b1a92697cef58deb07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:52Z,use_quota=True,user_id='e5df31eef66842b2b4cc7ead7a3ba1ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5548062e-7bfb-469c-9e72-1182a02a880c tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (811f8801-2963-4cda-94b7-e229cc1aae3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5548062e-7bfb-469c-9e72-1182a02a880c tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (811f8801-2963-4cda-94b7-e229cc1aae3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5548062e-7bfb-469c-9e72-1182a02a880c tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85bdd2f9-05c1-4d1f-a206-d80b0ad5d6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5548062e-7bfb-469c-9e72-1182a02a880c tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85bdd2f9-05c1-4d1f-a206-d80b0ad5d6b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ebbdda3e-f73e-48ac-84a5-c371439cd011', 'volume_name': 'volume-ebbdda3e-f73e-48ac-84a5-c371439cd011', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5548062e-7bfb-469c-9e72-1182a02a880c tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ff1d7ab-445a-4b17-9924-1146a56446b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5548062e-7bfb-469c-9e72-1182a02a880c tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3ff1d7ab-445a-4b17-9924-1146a56446b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5548062e-7bfb-469c-9e72-1182a02a880c tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f355139-b8d3-4b15-8086-56fc3fedf551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:52 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-5548062e-7bfb-469c-9e72-1182a02a880c tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Volume ebbdda3e-f73e-48ac-84a5-c371439cd011: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ebbdda3e-f73e-48ac-84a5-c371439cd011', 'volume_size': 1} Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5548062e-7bfb-469c-9e72-1182a02a880c tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-1a3fa538-ff30-4734-9f8c-639857e2b377 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Acquiring lock "cinder-19dcb9b7-770e-43e7-9ab5-9b11cea0cc52-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:52 devstack sudo[105868]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c2e17ed6-403d-4d9a-aff6-6eed550df018 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d0249fc2-21f9-410b-9af7-12979e365338 1073741824" returned: 0 in 0.582s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-1a3fa538-ff30-4734-9f8c-639857e2b377 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "cinder-19dcb9b7-770e-43e7-9ab5-9b11cea0cc52-delete_volume" acquired by "delete_volume" :: waited 0.049s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c2e17ed6-403d-4d9a-aff6-6eed550df018 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d0249fc2-21f9-410b-9af7-12979e365338 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-1a3fa538-ff30-4734-9f8c-639857e2b377 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Acquiring lock "cinder-quobyte-19dcb9b7-770e-43e7-9ab5-9b11cea0cc52" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:52 devstack sudo[105876]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d0249fc2-21f9-410b-9af7-12979e365338 Nov 01 12:38:52 devstack sudo[105876]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-1a3fa538-ff30-4734-9f8c-639857e2b377 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "cinder-quobyte-19dcb9b7-770e-43e7-9ab5-9b11cea0cc52" acquired by "delete_volume" :: waited 0.041s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[4f290519-d1fe-4c83-bb0a-3ba3051b2214]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1a3fa538-ff30-4734-9f8c-639857e2b377 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-19dcb9b7-770e-43e7-9ab5-9b11cea0cc52 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-776f5738-1da4-4949-a18b-44ee80bb7c14 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-776f5738-1da4-4949-a18b-44ee80bb7c14 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Flow 'volume_create_manager' (8c57ef42-3911-4480-a387-f60fd4203088) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-776f5738-1da4-4949-a18b-44ee80bb7c14 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d427957-3b1c-4a4d-9a3c-ce7b32b0593d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:53 devstack sudo[105878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-19dcb9b7-770e-43e7-9ab5-9b11cea0cc52 Nov 01 12:38:53 devstack sudo[105878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-776f5738-1da4-4949-a18b-44ee80bb7c14 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8d427957-3b1c-4a4d-9a3c-ce7b32b0593d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1488145038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92baefc2-d803-4e73-9477-a48d5f726893,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe39de02f39844b1a92697cef58deb07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:53Z,use_quota=True,user_id='e5df31eef66842b2b4cc7ead7a3ba1ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-776f5738-1da4-4949-a18b-44ee80bb7c14 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0a5d790-4582-434c-ba45-8190386a1bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-776f5738-1da4-4949-a18b-44ee80bb7c14 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0a5d790-4582-434c-ba45-8190386a1bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-776f5738-1da4-4949-a18b-44ee80bb7c14 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29879a66-b261-4c92-a3b8-8e10b7049a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-776f5738-1da4-4949-a18b-44ee80bb7c14 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (29879a66-b261-4c92-a3b8-8e10b7049a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '92baefc2-d803-4e73-9477-a48d5f726893', 'volume_name': 'volume-92baefc2-d803-4e73-9477-a48d5f726893', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-776f5738-1da4-4949-a18b-44ee80bb7c14 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12d41dcd-c182-40a1-ba0f-d6a2d22dbfd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-776f5738-1da4-4949-a18b-44ee80bb7c14 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12d41dcd-c182-40a1-ba0f-d6a2d22dbfd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-776f5738-1da4-4949-a18b-44ee80bb7c14 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d5b76bf-f1fe-4ab5-8a53-34ed1ce8e2b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:53 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-776f5738-1da4-4949-a18b-44ee80bb7c14 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Volume 92baefc2-d803-4e73-9477-a48d5f726893: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-92baefc2-d803-4e73-9477-a48d5f726893', 'volume_size': 1} Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-776f5738-1da4-4949-a18b-44ee80bb7c14 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:53 devstack sudo[105876]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c2e17ed6-403d-4d9a-aff6-6eed550df018 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d0249fc2-21f9-410b-9af7-12979e365338" returned: 0 in 0.415s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-c2e17ed6-403d-4d9a-aff6-6eed550df018 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] <== create_volume: return (1091ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-c2e17ed6-403d-4d9a-aff6-6eed550df018 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.094s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-bf27882f-7088-447f-b909-8c8bdd447e0a tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.027s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-bf27882f-7088-447f-b909-8c8bdd447e0a tempest-CreateVolumesFromSourceVolumeTest-207056831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2084187682',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2db46282-c878-45b1-bfb8-fc86ea419ba2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe39de02f39844b1a92697cef58deb07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:52Z,use_quota=True,user_id='e5df31eef66842b2b4cc7ead7a3ba1ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-bf27882f-7088-447f-b909-8c8bdd447e0a tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Creating volume 2db46282-c878-45b1-bfb8-fc86ea419ba2 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-bf27882f-7088-447f-b909-8c8bdd447e0a tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-bf27882f-7088-447f-b909-8c8bdd447e0a tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-bf27882f-7088-447f-b909-8c8bdd447e0a tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-bf27882f-7088-447f-b909-8c8bdd447e0a tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-bf27882f-7088-447f-b909-8c8bdd447e0a tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-bf27882f-7088-447f-b909-8c8bdd447e0a tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:38:53 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-bf27882f-7088-447f-b909-8c8bdd447e0a tempest-CreateVolumesFromSourceVolumeTest-207056831 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bf27882f-7088-447f-b909-8c8bdd447e0a tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-2db46282-c878-45b1-bfb8-fc86ea419ba2 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c2e17ed6-403d-4d9a-aff6-6eed550df018 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bcd4851d-150e-4b61-af80-d835444543b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0249fc2-21f9-410b-9af7-12979e365338', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:53 devstack sudo[105881]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-2db46282-c878-45b1-bfb8-fc86ea419ba2 1073741824 Nov 01 12:38:53 devstack sudo[105881]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c2e17ed6-403d-4d9a-aff6-6eed550df018 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2392fe03-74ba-4eae-910e-f6c1a25e1147) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:53 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-c2e17ed6-403d-4d9a-aff6-6eed550df018 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Volume volume-d0249fc2-21f9-410b-9af7-12979e365338 (d0249fc2-21f9-410b-9af7-12979e365338): created successfully Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c2e17ed6-403d-4d9a-aff6-6eed550df018 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2392fe03-74ba-4eae-910e-f6c1a25e1147) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-c2e17ed6-403d-4d9a-aff6-6eed550df018 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Flow 'volume_create_manager' (5eff6563-8724-4095-8e4c-8624a9aca463) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:53 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-c2e17ed6-403d-4d9a-aff6-6eed550df018 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Created volume successfully. Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f26a32a6-73ed-43ee-8916-9177ad0a9d17 tempest-ProjectMemberTests-538781697 None] Acquiring lock "cinder-f0169914-fbd3-4b82-93ab-30da137a9826-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d512cc63-4130-4fb5-9fa3-b375aa19a036 tempest-VolumeDependencyTests-648381524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f26a32a6-73ed-43ee-8916-9177ad0a9d17 tempest-ProjectMemberTests-538781697 None] Lock "cinder-f0169914-fbd3-4b82-93ab-30da137a9826-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:53 devstack sudo[105878]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1a3fa538-ff30-4734-9f8c-639857e2b377 tempest-CreateVolumesFromSnapshotTest-1885067804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-19dcb9b7-770e-43e7-9ab5-9b11cea0cc52" returned: 0 in 0.557s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1a3fa538-ff30-4734-9f8c-639857e2b377 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-19dcb9b7-770e-43e7-9ab5-9b11cea0cc52 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:53 devstack sudo[105887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-19dcb9b7-770e-43e7-9ab5-9b11cea0cc52 Nov 01 12:38:53 devstack sudo[105887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f26a32a6-73ed-43ee-8916-9177ad0a9d17 tempest-ProjectMemberTests-538781697 None] Acquiring lock "cinder-quobyte-f0169914-fbd3-4b82-93ab-30da137a9826" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f26a32a6-73ed-43ee-8916-9177ad0a9d17 tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-f0169914-fbd3-4b82-93ab-30da137a9826" acquired by "delete_volume" :: waited 0.022s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[20a51dca-7bc2-41ce-b32e-50ab73bd9011]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f26a32a6-73ed-43ee-8916-9177ad0a9d17 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0169914-fbd3-4b82-93ab-30da137a9826 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-d99dfc08-e656-4e7e-ba33-e53910a20ccf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d99dfc08-e656-4e7e-ba33-e53910a20ccf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Flow 'volume_create_manager' (c0796acd-f9ed-44ef-a36c-592dbbb1ed9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d99dfc08-e656-4e7e-ba33-e53910a20ccf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6b4b18e-93a9-4f80-8023-2a57076caa8b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d99dfc08-e656-4e7e-ba33-e53910a20ccf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e6b4b18e-93a9-4f80-8023-2a57076caa8b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2095101866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e0d6ae3-0173-439f-a91e-1df505923c26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe39de02f39844b1a92697cef58deb07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:54Z,use_quota=True,user_id='e5df31eef66842b2b4cc7ead7a3ba1ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d99dfc08-e656-4e7e-ba33-e53910a20ccf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9fc0dad-b839-4b12-8f03-ac2953117ed5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d99dfc08-e656-4e7e-ba33-e53910a20ccf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9fc0dad-b839-4b12-8f03-ac2953117ed5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:53 devstack sudo[105892]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0169914-fbd3-4b82-93ab-30da137a9826 Nov 01 12:38:53 devstack sudo[105892]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d99dfc08-e656-4e7e-ba33-e53910a20ccf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec405f7f-3d39-401f-96ae-c7d4257e4eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d99dfc08-e656-4e7e-ba33-e53910a20ccf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ec405f7f-3d39-401f-96ae-c7d4257e4eac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e0d6ae3-0173-439f-a91e-1df505923c26', 'volume_name': 'volume-3e0d6ae3-0173-439f-a91e-1df505923c26', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d99dfc08-e656-4e7e-ba33-e53910a20ccf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26ffdd1c-42d2-442d-b1d6-44ea9088b964) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d99dfc08-e656-4e7e-ba33-e53910a20ccf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26ffdd1c-42d2-442d-b1d6-44ea9088b964) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d99dfc08-e656-4e7e-ba33-e53910a20ccf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9dccb0a-5faf-42a7-a7b0-c126ff49a02a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:53 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-d99dfc08-e656-4e7e-ba33-e53910a20ccf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Volume 3e0d6ae3-0173-439f-a91e-1df505923c26: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e0d6ae3-0173-439f-a91e-1df505923c26', 'volume_size': 1} Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d99dfc08-e656-4e7e-ba33-e53910a20ccf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:53 devstack sudo[105881]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bf27882f-7088-447f-b909-8c8bdd447e0a tempest-CreateVolumesFromSourceVolumeTest-207056831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-2db46282-c878-45b1-bfb8-fc86ea419ba2 1073741824" returned: 0 in 0.589s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:53 devstack sudo[105887]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1a3fa538-ff30-4734-9f8c-639857e2b377 tempest-CreateVolumesFromSnapshotTest-1885067804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-19dcb9b7-770e-43e7-9ab5-9b11cea0cc52" returned: 0 in 0.332s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-1a3fa538-ff30-4734-9f8c-639857e2b377 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "cinder-quobyte-19dcb9b7-770e-43e7-9ab5-9b11cea0cc52" released by "delete_volume" :: held 0.993s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bf27882f-7088-447f-b909-8c8bdd447e0a tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-2db46282-c878-45b1-bfb8-fc86ea419ba2 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:53 devstack sudo[105896]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-2db46282-c878-45b1-bfb8-fc86ea419ba2 Nov 01 12:38:53 devstack sudo[105896]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:53 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-1a3fa538-ff30-4734-9f8c-639857e2b377 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Created reservations ['5dc7ae76-8226-4d4a-ae94-b2c08cc1d804', 'b48e0993-c3eb-42b4-92de-220a426a202a', '2ebb316f-55e1-4d05-aef9-f740a1022a18', '2feb974c-99ea-4828-85ae-720bc22dc7cd'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:38:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-1a3fa538-ff30-4734-9f8c-639857e2b377 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-1a3fa538-ff30-4734-9f8c-639857e2b377 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:54 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-1a3fa538-ff30-4734-9f8c-639857e2b377 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:54 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-1a3fa538-ff30-4734-9f8c-639857e2b377 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-1a3fa538-ff30-4734-9f8c-639857e2b377 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1a3fa538-ff30-4734-9f8c-639857e2b377 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:54 devstack sudo[105892]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f26a32a6-73ed-43ee-8916-9177ad0a9d17 tempest-ProjectMemberTests-538781697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0169914-fbd3-4b82-93ab-30da137a9826" returned: 0 in 0.433s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f26a32a6-73ed-43ee-8916-9177ad0a9d17 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0169914-fbd3-4b82-93ab-30da137a9826 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:54 devstack sudo[105901]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:38:54 devstack sudo[105901]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:54 devstack sudo[105903]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0169914-fbd3-4b82-93ab-30da137a9826 Nov 01 12:38:54 devstack sudo[105903]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:54 devstack sudo[105896]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bf27882f-7088-447f-b909-8c8bdd447e0a tempest-CreateVolumesFromSourceVolumeTest-207056831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-2db46282-c878-45b1-bfb8-fc86ea419ba2" returned: 0 in 0.268s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:54 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-bf27882f-7088-447f-b909-8c8bdd447e0a tempest-CreateVolumesFromSourceVolumeTest-207056831 None] <== create_volume: return (942ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:38:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-bf27882f-7088-447f-b909-8c8bdd447e0a tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5548062e-7bfb-469c-9e72-1182a02a880c tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.608s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:54 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-5548062e-7bfb-469c-9e72-1182a02a880c tempest-CreateVolumesFromSourceVolumeTest-207056831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-135584061',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ebbdda3e-f73e-48ac-84a5-c371439cd011,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe39de02f39844b1a92697cef58deb07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:52Z,use_quota=True,user_id='e5df31eef66842b2b4cc7ead7a3ba1ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:38:54 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-5548062e-7bfb-469c-9e72-1182a02a880c tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Creating volume ebbdda3e-f73e-48ac-84a5-c371439cd011 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:38:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5548062e-7bfb-469c-9e72-1182a02a880c tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5548062e-7bfb-469c-9e72-1182a02a880c tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:54 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-5548062e-7bfb-469c-9e72-1182a02a880c tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:54 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-5548062e-7bfb-469c-9e72-1182a02a880c tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5548062e-7bfb-469c-9e72-1182a02a880c tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:54 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-5548062e-7bfb-469c-9e72-1182a02a880c tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:38:54 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-5548062e-7bfb-469c-9e72-1182a02a880c tempest-CreateVolumesFromSourceVolumeTest-207056831 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:38:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5548062e-7bfb-469c-9e72-1182a02a880c tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ebbdda3e-f73e-48ac-84a5-c371439cd011 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:54 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-bf27882f-7088-447f-b909-8c8bdd447e0a tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c0c5ab24-3e22-4d2a-8fb2-94684f118b93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2db46282-c878-45b1-bfb8-fc86ea419ba2', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:54 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-bf27882f-7088-447f-b909-8c8bdd447e0a tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (819ca6c5-d6bd-4cd1-8c17-064b4453e52f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:54 devstack sudo[105906]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ebbdda3e-f73e-48ac-84a5-c371439cd011 1073741824 Nov 01 12:38:54 devstack sudo[105906]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:54 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-bf27882f-7088-447f-b909-8c8bdd447e0a tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Volume volume-2db46282-c878-45b1-bfb8-fc86ea419ba2 (2db46282-c878-45b1-bfb8-fc86ea419ba2): created successfully Nov 01 12:38:54 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-bf27882f-7088-447f-b909-8c8bdd447e0a tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (819ca6c5-d6bd-4cd1-8c17-064b4453e52f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:54 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-bf27882f-7088-447f-b909-8c8bdd447e0a tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Flow 'volume_create_manager' (ecb04bf0-1530-4fa8-a4f2-53ff6bdf93e1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:54 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-bf27882f-7088-447f-b909-8c8bdd447e0a tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Created volume successfully. Nov 01 12:38:54 devstack sudo[105901]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1a3fa538-ff30-4734-9f8c-639857e2b377 tempest-CreateVolumesFromSnapshotTest-1885067804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.263s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:54 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-1a3fa538-ff30-4734-9f8c-639857e2b377 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:38:54 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-1a3fa538-ff30-4734-9f8c-639857e2b377 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Deleted volume successfully. Nov 01 12:38:54 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-1a3fa538-ff30-4734-9f8c-639857e2b377 tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "cinder-19dcb9b7-770e-43e7-9ab5-9b11cea0cc52-delete_volume" released by "delete_volume" :: held 1.597s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:54 devstack sudo[105903]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f26a32a6-73ed-43ee-8916-9177ad0a9d17 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f0169914-fbd3-4b82-93ab-30da137a9826" returned: 0 in 0.295s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:54 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f26a32a6-73ed-43ee-8916-9177ad0a9d17 tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-f0169914-fbd3-4b82-93ab-30da137a9826" released by "delete_volume" :: held 0.800s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:54 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-f26a32a6-73ed-43ee-8916-9177ad0a9d17 tempest-ProjectMemberTests-538781697 None] Created reservations ['e854f108-81a7-4a83-b6a4-275b0d95a39e', '69c6da1a-65e1-46f2-8de3-3f021025ebd6', 'ccea5d11-70fa-47a3-a0c3-fc290b6fbac7', '1adc7de0-a052-481c-ac1c-ba606797ad72'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:38:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f26a32a6-73ed-43ee-8916-9177ad0a9d17 tempest-ProjectMemberTests-538781697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f26a32a6-73ed-43ee-8916-9177ad0a9d17 tempest-ProjectMemberTests-538781697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:54 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f26a32a6-73ed-43ee-8916-9177ad0a9d17 tempest-ProjectMemberTests-538781697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:54 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f26a32a6-73ed-43ee-8916-9177ad0a9d17 tempest-ProjectMemberTests-538781697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f26a32a6-73ed-43ee-8916-9177ad0a9d17 tempest-ProjectMemberTests-538781697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f26a32a6-73ed-43ee-8916-9177ad0a9d17 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:54 devstack sudo[105913]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:38:54 devstack sudo[105913]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:54 devstack sudo[105906]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5548062e-7bfb-469c-9e72-1182a02a880c tempest-CreateVolumesFromSourceVolumeTest-207056831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ebbdda3e-f73e-48ac-84a5-c371439cd011 1073741824" returned: 0 in 0.501s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5548062e-7bfb-469c-9e72-1182a02a880c tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ebbdda3e-f73e-48ac-84a5-c371439cd011 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:54 devstack sudo[105917]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ebbdda3e-f73e-48ac-84a5-c371439cd011 Nov 01 12:38:54 devstack sudo[105917]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:54 devstack sudo[105913]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f26a32a6-73ed-43ee-8916-9177ad0a9d17 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.284s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:54 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-f26a32a6-73ed-43ee-8916-9177ad0a9d17 tempest-ProjectMemberTests-538781697 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:38:54 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-f26a32a6-73ed-43ee-8916-9177ad0a9d17 tempest-ProjectMemberTests-538781697 None] Deleted volume successfully. Nov 01 12:38:54 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f26a32a6-73ed-43ee-8916-9177ad0a9d17 tempest-ProjectMemberTests-538781697 None] Lock "cinder-f0169914-fbd3-4b82-93ab-30da137a9826-delete_volume" released by "delete_volume" :: held 1.324s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-081b85ef-6e5c-452b-8d2b-83adae4af7fc tempest-CreateVolumesFromSnapshotTest-1885067804 None] Acquiring lock "cinder-2d8a610f-abb4-4c08-bec4-4b8ef3fe2438-delete_snapshot" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:55 devstack sudo[105917]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-5548062e-7bfb-469c-9e72-1182a02a880c tempest-CreateVolumesFromSourceVolumeTest-207056831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ebbdda3e-f73e-48ac-84a5-c371439cd011" returned: 0 in 0.286s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-5548062e-7bfb-469c-9e72-1182a02a880c tempest-CreateVolumesFromSourceVolumeTest-207056831 None] <== create_volume: return (837ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-5548062e-7bfb-469c-9e72-1182a02a880c tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.842s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-776f5738-1da4-4949-a18b-44ee80bb7c14 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.840s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-776f5738-1da4-4949-a18b-44ee80bb7c14 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1488145038',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=92baefc2-d803-4e73-9477-a48d5f726893,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe39de02f39844b1a92697cef58deb07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:53Z,use_quota=True,user_id='e5df31eef66842b2b4cc7ead7a3ba1ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-776f5738-1da4-4949-a18b-44ee80bb7c14 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Creating volume 92baefc2-d803-4e73-9477-a48d5f726893 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-776f5738-1da4-4949-a18b-44ee80bb7c14 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-776f5738-1da4-4949-a18b-44ee80bb7c14 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-776f5738-1da4-4949-a18b-44ee80bb7c14 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-776f5738-1da4-4949-a18b-44ee80bb7c14 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-776f5738-1da4-4949-a18b-44ee80bb7c14 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-776f5738-1da4-4949-a18b-44ee80bb7c14 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:38:55 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-776f5738-1da4-4949-a18b-44ee80bb7c14 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-776f5738-1da4-4949-a18b-44ee80bb7c14 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-92baefc2-d803-4e73-9477-a48d5f726893 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:55 devstack sudo[105920]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-92baefc2-d803-4e73-9477-a48d5f726893 1073741824 Nov 01 12:38:55 devstack sudo[105920]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-081b85ef-6e5c-452b-8d2b-83adae4af7fc tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "cinder-2d8a610f-abb4-4c08-bec4-4b8ef3fe2438-delete_snapshot" acquired by "delete_snapshot" :: waited 0.053s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-081b85ef-6e5c-452b-8d2b-83adae4af7fc tempest-CreateVolumesFromSnapshotTest-1885067804 None] Acquiring lock "cinder-quobyte-4462cbed-00df-479c-9a1c-8815f802555c" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5548062e-7bfb-469c-9e72-1182a02a880c tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1f355139-b8d3-4b15-8086-56fc3fedf551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ebbdda3e-f73e-48ac-84a5-c371439cd011', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5548062e-7bfb-469c-9e72-1182a02a880c tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4fa374f-2341-49d6-ba53-0b76deea6cc5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-081b85ef-6e5c-452b-8d2b-83adae4af7fc tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "cinder-quobyte-4462cbed-00df-479c-9a1c-8815f802555c" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-081b85ef-6e5c-452b-8d2b-83adae4af7fc tempest-CreateVolumesFromSnapshotTest-1885067804 None] Acquiring lock "cinder-quobyte-2d8a610f-abb4-4c08-bec4-4b8ef3fe2438" by "_delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:55 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-5548062e-7bfb-469c-9e72-1182a02a880c tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Volume volume-ebbdda3e-f73e-48ac-84a5-c371439cd011 (ebbdda3e-f73e-48ac-84a5-c371439cd011): created successfully Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5548062e-7bfb-469c-9e72-1182a02a880c tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a4fa374f-2341-49d6-ba53-0b76deea6cc5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-5548062e-7bfb-469c-9e72-1182a02a880c tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Flow 'volume_create_manager' (88ad028d-8513-44a9-b84b-5cccbb9e0540) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:55 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-5548062e-7bfb-469c-9e72-1182a02a880c tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Created volume successfully. Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-081b85ef-6e5c-452b-8d2b-83adae4af7fc tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "cinder-quobyte-2d8a610f-abb4-4c08-bec4-4b8ef3fe2438" acquired by "_delete_snapshot" :: waited 0.043s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-081b85ef-6e5c-452b-8d2b-83adae4af7fc tempest-CreateVolumesFromSnapshotTest-1885067804 None] Deleting offline snapshot 2d8a610f-abb4-4c08-bec4-4b8ef3fe2438 of volume 4462cbed-00df-479c-9a1c-8815f802555c {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-081b85ef-6e5c-452b-8d2b-83adae4af7fc tempest-CreateVolumesFromSnapshotTest-1885067804 None] snapshot_file for this snap is: volume-4462cbed-00df-479c-9a1c-8815f802555c.2d8a610f-abb4-4c08-bec4-4b8ef3fe2438 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[05953bd6-bbcf-4d81-abf1-dca8ba0aaccc]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-081b85ef-6e5c-452b-8d2b-83adae4af7fc tempest-CreateVolumesFromSnapshotTest-1885067804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4462cbed-00df-479c-9a1c-8815f802555c.2d8a610f-abb4-4c08-bec4-4b8ef3fe2438 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-78d00c14-57c2-463c-87cf-a8fc2fa33de1 tempest-ProjectMemberTests-538781697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-78d00c14-57c2-463c-87cf-a8fc2fa33de1 tempest-ProjectMemberTests-538781697 None] Flow 'volume_create_manager' (0d7e7fcc-ef4b-4c5d-a47e-4aee87479296) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-78d00c14-57c2-463c-87cf-a8fc2fa33de1 tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (789c7ee9-c4be-4aba-b33d-e61623fe2510) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-78d00c14-57c2-463c-87cf-a8fc2fa33de1 tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (789c7ee9-c4be-4aba-b33d-e61623fe2510) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1121768279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa1f84bf-7d0d-4b4b-b9bb-856f0784b137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe0ffaf6cf1d4294aa9f030164447d48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:55Z,use_quota=True,user_id='f617cd7e548d4a989b479812bba708f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-78d00c14-57c2-463c-87cf-a8fc2fa33de1 tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5b34dde-36d6-442f-965b-aae4a66703bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-78d00c14-57c2-463c-87cf-a8fc2fa33de1 tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b5b34dde-36d6-442f-965b-aae4a66703bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-78d00c14-57c2-463c-87cf-a8fc2fa33de1 tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b58d988-96ff-4d9a-8a64-4b7712f560cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-78d00c14-57c2-463c-87cf-a8fc2fa33de1 tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b58d988-96ff-4d9a-8a64-4b7712f560cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fa1f84bf-7d0d-4b4b-b9bb-856f0784b137', 'volume_name': 'volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-78d00c14-57c2-463c-87cf-a8fc2fa33de1 tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96274693-61c3-4add-b5b0-e936ffbf10d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-78d00c14-57c2-463c-87cf-a8fc2fa33de1 tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (96274693-61c3-4add-b5b0-e936ffbf10d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-78d00c14-57c2-463c-87cf-a8fc2fa33de1 tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (670a2e74-486c-4175-aed5-7ea8e7a207ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:55 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-78d00c14-57c2-463c-87cf-a8fc2fa33de1 tempest-ProjectMemberTests-538781697 None] Volume fa1f84bf-7d0d-4b4b-b9bb-856f0784b137: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137', 'volume_size': 1} Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-78d00c14-57c2-463c-87cf-a8fc2fa33de1 tempest-ProjectMemberTests-538781697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:55 devstack sudo[105922]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4462cbed-00df-479c-9a1c-8815f802555c.2d8a610f-abb4-4c08-bec4-4b8ef3fe2438 Nov 01 12:38:55 devstack sudo[105922]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:55 devstack sudo[105920]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-776f5738-1da4-4949-a18b-44ee80bb7c14 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-92baefc2-d803-4e73-9477-a48d5f726893 1073741824" returned: 0 in 0.459s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-776f5738-1da4-4949-a18b-44ee80bb7c14 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-92baefc2-d803-4e73-9477-a48d5f726893 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:55 devstack sudo[105930]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-92baefc2-d803-4e73-9477-a48d5f726893 Nov 01 12:38:55 devstack sudo[105930]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:55 devstack sudo[105922]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-081b85ef-6e5c-452b-8d2b-83adae4af7fc tempest-CreateVolumesFromSnapshotTest-1885067804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4462cbed-00df-479c-9a1c-8815f802555c.2d8a610f-abb4-4c08-bec4-4b8ef3fe2438" returned: 0 in 0.406s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-081b85ef-6e5c-452b-8d2b-83adae4af7fc tempest-CreateVolumesFromSnapshotTest-1885067804 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4462cbed-00df-479c-9a1c-8815f802555c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c6f9c84-5012-4672-a9d3-14c7e7af30f7]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-081b85ef-6e5c-452b-8d2b-83adae4af7fc tempest-CreateVolumesFromSnapshotTest-1885067804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4462cbed-00df-479c-9a1c-8815f802555c {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:55 devstack sudo[105933]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4462cbed-00df-479c-9a1c-8815f802555c Nov 01 12:38:55 devstack sudo[105933]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:55 devstack sudo[105930]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-776f5738-1da4-4949-a18b-44ee80bb7c14 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-92baefc2-d803-4e73-9477-a48d5f726893" returned: 0 in 0.251s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-776f5738-1da4-4949-a18b-44ee80bb7c14 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-776f5738-1da4-4949-a18b-44ee80bb7c14 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d512cc63-4130-4fb5-9fa3-b375aa19a036 tempest-VolumeDependencyTests-648381524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 2.307s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-776f5738-1da4-4949-a18b-44ee80bb7c14 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2d5b76bf-f1fe-4ab5-8a53-34ed1ce8e2b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-92baefc2-d803-4e73-9477-a48d5f726893', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-776f5738-1da4-4949-a18b-44ee80bb7c14 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be7b1b09-f378-4116-aaed-87b945246507) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-d512cc63-4130-4fb5-9fa3-b375aa19a036 tempest-VolumeDependencyTests-648381524 None] Creating offline snapshot f26d7383-c093-47ee-ab33-579cf03e25da of volume 22d85a4e-2114-4dd2-b912-a280dfc5c64d {{(pid=86574) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:38:55 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-776f5738-1da4-4949-a18b-44ee80bb7c14 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Volume volume-92baefc2-d803-4e73-9477-a48d5f726893 (92baefc2-d803-4e73-9477-a48d5f726893): created successfully Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-776f5738-1da4-4949-a18b-44ee80bb7c14 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (be7b1b09-f378-4116-aaed-87b945246507) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-776f5738-1da4-4949-a18b-44ee80bb7c14 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Flow 'volume_create_manager' (8c57ef42-3911-4480-a387-f60fd4203088) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[8e2de635-93cb-4a6e-9653-9fca2788137a]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d512cc63-4130-4fb5-9fa3-b375aa19a036 tempest-VolumeDependencyTests-648381524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:55 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-776f5738-1da4-4949-a18b-44ee80bb7c14 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Created volume successfully. Nov 01 12:38:55 devstack sudo[105936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d Nov 01 12:38:55 devstack sudo[105936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:56 devstack sudo[105933]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-081b85ef-6e5c-452b-8d2b-83adae4af7fc tempest-CreateVolumesFromSnapshotTest-1885067804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4462cbed-00df-479c-9a1c-8815f802555c" returned: 0 in 0.395s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-081b85ef-6e5c-452b-8d2b-83adae4af7fc tempest-CreateVolumesFromSnapshotTest-1885067804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4462cbed-00df-479c-9a1c-8815f802555c.2d8a610f-abb4-4c08-bec4-4b8ef3fe2438 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:56 devstack sudo[105941]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4462cbed-00df-479c-9a1c-8815f802555c.2d8a610f-abb4-4c08-bec4-4b8ef3fe2438 Nov 01 12:38:56 devstack sudo[105941]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:56 devstack sudo[105936]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d512cc63-4130-4fb5-9fa3-b375aa19a036 tempest-VolumeDependencyTests-648381524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d" returned: 0 in 0.371s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d512cc63-4130-4fb5-9fa3-b375aa19a036 tempest-VolumeDependencyTests-648381524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d.f26d7383-c093-47ee-ab33-579cf03e25da 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:56 devstack sudo[105946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d.f26d7383-c093-47ee-ab33-579cf03e25da 1G Nov 01 12:38:56 devstack sudo[105946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:56 devstack sudo[105941]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-081b85ef-6e5c-452b-8d2b-83adae4af7fc tempest-CreateVolumesFromSnapshotTest-1885067804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4462cbed-00df-479c-9a1c-8815f802555c.2d8a610f-abb4-4c08-bec4-4b8ef3fe2438" returned: 0 in 0.366s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-081b85ef-6e5c-452b-8d2b-83adae4af7fc tempest-CreateVolumesFromSnapshotTest-1885067804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4462cbed-00df-479c-9a1c-8815f802555c.2d8a610f-abb4-4c08-bec4-4b8ef3fe2438 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:56 devstack sudo[105951]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4462cbed-00df-479c-9a1c-8815f802555c.2d8a610f-abb4-4c08-bec4-4b8ef3fe2438 Nov 01 12:38:56 devstack sudo[105951]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:56 devstack sudo[105946]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d512cc63-4130-4fb5-9fa3-b375aa19a036 tempest-VolumeDependencyTests-648381524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d.f26d7383-c093-47ee-ab33-579cf03e25da 1G" returned: 0 in 0.425s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d512cc63-4130-4fb5-9fa3-b375aa19a036 tempest-VolumeDependencyTests-648381524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d.f26d7383-c093-47ee-ab33-579cf03e25da {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:56 devstack sudo[105951]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-081b85ef-6e5c-452b-8d2b-83adae4af7fc tempest-CreateVolumesFromSnapshotTest-1885067804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4462cbed-00df-479c-9a1c-8815f802555c.2d8a610f-abb4-4c08-bec4-4b8ef3fe2438" returned: 0 in 0.280s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:56 devstack sudo[105957]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d.f26d7383-c093-47ee-ab33-579cf03e25da Nov 01 12:38:56 devstack sudo[105957]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:56 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-081b85ef-6e5c-452b-8d2b-83adae4af7fc tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "cinder-quobyte-2d8a610f-abb4-4c08-bec4-4b8ef3fe2438" released by "_delete_snapshot" :: held 1.569s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:56 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-081b85ef-6e5c-452b-8d2b-83adae4af7fc tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "cinder-quobyte-4462cbed-00df-479c-9a1c-8815f802555c" released by "delete_snapshot" :: held 1.621s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:56 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-081b85ef-6e5c-452b-8d2b-83adae4af7fc tempest-CreateVolumesFromSnapshotTest-1885067804 None] Created reservations ['621da309-10af-4433-852a-0d958427f18b', '8982c576-1647-4808-a99f-980afb09183a', 'c1cd02ce-ad4d-4b19-ac52-7e98ebc09ff1', '566acdfa-24fe-4480-a923-149cff18b8ff'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:38:56 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-081b85ef-6e5c-452b-8d2b-83adae4af7fc tempest-CreateVolumesFromSnapshotTest-1885067804 None] Delete snapshot completed successfully. Nov 01 12:38:56 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-081b85ef-6e5c-452b-8d2b-83adae4af7fc tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "cinder-2d8a610f-abb4-4c08-bec4-4b8ef3fe2438-delete_snapshot" released by "delete_snapshot" :: held 1.781s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:56 devstack sudo[105957]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d512cc63-4130-4fb5-9fa3-b375aa19a036 tempest-VolumeDependencyTests-648381524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d.f26d7383-c093-47ee-ab33-579cf03e25da" returned: 0 in 0.290s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:56 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-d512cc63-4130-4fb5-9fa3-b375aa19a036 tempest-VolumeDependencyTests-648381524 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d.f26d7383-c093-47ee-ab33-579cf03e25da is being set with open permissions: ugo+rw Nov 01 12:38:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d512cc63-4130-4fb5-9fa3-b375aa19a036 tempest-VolumeDependencyTests-648381524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d.f26d7383-c093-47ee-ab33-579cf03e25da {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:56 devstack sudo[105963]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d.f26d7383-c093-47ee-ab33-579cf03e25da Nov 01 12:38:56 devstack sudo[105963]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:57 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d05bc6a9-976f-4b18-9580-7cabe3a4f8ed tempest-CreateVolumesFromSnapshotTest-1885067804 None] Acquiring lock "cinder-4462cbed-00df-479c-9a1c-8815f802555c-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:57 devstack sudo[105963]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d512cc63-4130-4fb5-9fa3-b375aa19a036 tempest-VolumeDependencyTests-648381524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d.f26d7383-c093-47ee-ab33-579cf03e25da" returned: 0 in 0.252s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:57 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d05bc6a9-976f-4b18-9580-7cabe3a4f8ed tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "cinder-4462cbed-00df-479c-9a1c-8815f802555c-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d512cc63-4130-4fb5-9fa3-b375aa19a036 tempest-VolumeDependencyTests-648381524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:57 devstack sudo[105966]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d.info Nov 01 12:38:57 devstack sudo[105966]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:57 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d05bc6a9-976f-4b18-9580-7cabe3a4f8ed tempest-CreateVolumesFromSnapshotTest-1885067804 None] Acquiring lock "cinder-quobyte-4462cbed-00df-479c-9a1c-8815f802555c" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:57 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d05bc6a9-976f-4b18-9580-7cabe3a4f8ed tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "cinder-quobyte-4462cbed-00df-479c-9a1c-8815f802555c" acquired by "delete_volume" :: waited 0.017s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:57 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[1d1c24ff-4647-4686-b589-6505c930fd98]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d05bc6a9-976f-4b18-9580-7cabe3a4f8ed tempest-CreateVolumesFromSnapshotTest-1885067804 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4462cbed-00df-479c-9a1c-8815f802555c {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:57 devstack sudo[105968]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4462cbed-00df-479c-9a1c-8815f802555c Nov 01 12:38:57 devstack sudo[105968]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:57 devstack sudo[105966]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d512cc63-4130-4fb5-9fa3-b375aa19a036 tempest-VolumeDependencyTests-648381524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d.info" returned: 0 in 0.266s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:57 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-d512cc63-4130-4fb5-9fa3-b375aa19a036 tempest-VolumeDependencyTests-648381524 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d.info is being set with open permissions: ugo+rw Nov 01 12:38:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d512cc63-4130-4fb5-9fa3-b375aa19a036 tempest-VolumeDependencyTests-648381524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:57 devstack sudo[105971]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d.info Nov 01 12:38:57 devstack sudo[105971]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:57 devstack sudo[105968]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d05bc6a9-976f-4b18-9580-7cabe3a4f8ed tempest-CreateVolumesFromSnapshotTest-1885067804 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4462cbed-00df-479c-9a1c-8815f802555c" returned: 0 in 0.358s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d05bc6a9-976f-4b18-9580-7cabe3a4f8ed tempest-CreateVolumesFromSnapshotTest-1885067804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4462cbed-00df-479c-9a1c-8815f802555c {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:57 devstack sudo[105976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4462cbed-00df-479c-9a1c-8815f802555c Nov 01 12:38:57 devstack sudo[105976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:57 devstack sudo[105971]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d512cc63-4130-4fb5-9fa3-b375aa19a036 tempest-VolumeDependencyTests-648381524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d.info" returned: 0 in 0.246s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d512cc63-4130-4fb5-9fa3-b375aa19a036 tempest-VolumeDependencyTests-648381524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.993s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d99dfc08-e656-4e7e-ba33-e53910a20ccf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.994s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:57 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d99dfc08-e656-4e7e-ba33-e53910a20ccf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-2095101866',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e0d6ae3-0173-439f-a91e-1df505923c26,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe39de02f39844b1a92697cef58deb07',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:54Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:54Z,use_quota=True,user_id='e5df31eef66842b2b4cc7ead7a3ba1ea',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:38:57 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-d99dfc08-e656-4e7e-ba33-e53910a20ccf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Creating volume 3e0d6ae3-0173-439f-a91e-1df505923c26 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:38:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d99dfc08-e656-4e7e-ba33-e53910a20ccf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d99dfc08-e656-4e7e-ba33-e53910a20ccf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:57 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d99dfc08-e656-4e7e-ba33-e53910a20ccf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:57 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d99dfc08-e656-4e7e-ba33-e53910a20ccf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d99dfc08-e656-4e7e-ba33-e53910a20ccf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:57 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d99dfc08-e656-4e7e-ba33-e53910a20ccf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:38:57 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-d99dfc08-e656-4e7e-ba33-e53910a20ccf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:38:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d99dfc08-e656-4e7e-ba33-e53910a20ccf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3e0d6ae3-0173-439f-a91e-1df505923c26 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:57 devstack sudo[105979]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3e0d6ae3-0173-439f-a91e-1df505923c26 1073741824 Nov 01 12:38:57 devstack sudo[105979]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:57 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-d512cc63-4130-4fb5-9fa3-b375aa19a036 tempest-VolumeDependencyTests-648381524 None] Create snapshot completed successfully Nov 01 12:38:57 devstack sudo[105976]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d05bc6a9-976f-4b18-9580-7cabe3a4f8ed tempest-CreateVolumesFromSnapshotTest-1885067804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-4462cbed-00df-479c-9a1c-8815f802555c" returned: 0 in 0.263s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:58 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d05bc6a9-976f-4b18-9580-7cabe3a4f8ed tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "cinder-quobyte-4462cbed-00df-479c-9a1c-8815f802555c" released by "delete_volume" :: held 0.701s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:58 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-d05bc6a9-976f-4b18-9580-7cabe3a4f8ed tempest-CreateVolumesFromSnapshotTest-1885067804 None] Created reservations ['b890bdaa-dbdb-423b-be72-d90ce58f24bd', '38421f51-95b2-4e64-a765-331a3535ee09', '741181fe-5b06-4473-bcd5-fbfe06380c51', '4e5c2c3b-73df-459f-b468-bbfed4865d7d'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:38:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d05bc6a9-976f-4b18-9580-7cabe3a4f8ed tempest-CreateVolumesFromSnapshotTest-1885067804 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d05bc6a9-976f-4b18-9580-7cabe3a4f8ed tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:58 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d05bc6a9-976f-4b18-9580-7cabe3a4f8ed tempest-CreateVolumesFromSnapshotTest-1885067804 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:58 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d05bc6a9-976f-4b18-9580-7cabe3a4f8ed tempest-CreateVolumesFromSnapshotTest-1885067804 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d05bc6a9-976f-4b18-9580-7cabe3a4f8ed tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d05bc6a9-976f-4b18-9580-7cabe3a4f8ed tempest-CreateVolumesFromSnapshotTest-1885067804 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:58 devstack sudo[105985]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:38:58 devstack sudo[105985]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:58 devstack sudo[105979]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d99dfc08-e656-4e7e-ba33-e53910a20ccf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3e0d6ae3-0173-439f-a91e-1df505923c26 1073741824" returned: 0 in 0.496s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d99dfc08-e656-4e7e-ba33-e53910a20ccf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3e0d6ae3-0173-439f-a91e-1df505923c26 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:58 devstack sudo[105988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3e0d6ae3-0173-439f-a91e-1df505923c26 Nov 01 12:38:58 devstack sudo[105988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:58 devstack sudo[105985]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d05bc6a9-976f-4b18-9580-7cabe3a4f8ed tempest-CreateVolumesFromSnapshotTest-1885067804 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.300s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:58 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-d05bc6a9-976f-4b18-9580-7cabe3a4f8ed tempest-CreateVolumesFromSnapshotTest-1885067804 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:38:58 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-d05bc6a9-976f-4b18-9580-7cabe3a4f8ed tempest-CreateVolumesFromSnapshotTest-1885067804 None] Deleted volume successfully. Nov 01 12:38:58 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d05bc6a9-976f-4b18-9580-7cabe3a4f8ed tempest-CreateVolumesFromSnapshotTest-1885067804 None] Lock "cinder-4462cbed-00df-479c-9a1c-8815f802555c-delete_volume" released by "delete_volume" :: held 1.257s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:38:58 devstack sudo[105988]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d99dfc08-e656-4e7e-ba33-e53910a20ccf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3e0d6ae3-0173-439f-a91e-1df505923c26" returned: 0 in 0.302s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:58 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d99dfc08-e656-4e7e-ba33-e53910a20ccf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] <== create_volume: return (851ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:38:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d99dfc08-e656-4e7e-ba33-e53910a20ccf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.855s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-78d00c14-57c2-463c-87cf-a8fc2fa33de1 tempest-ProjectMemberTests-538781697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.365s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:58 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-78d00c14-57c2-463c-87cf-a8fc2fa33de1 tempest-ProjectMemberTests-538781697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1121768279',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fa1f84bf-7d0d-4b4b-b9bb-856f0784b137,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe0ffaf6cf1d4294aa9f030164447d48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:55Z,use_quota=True,user_id='f617cd7e548d4a989b479812bba708f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:38:58 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-78d00c14-57c2-463c-87cf-a8fc2fa33de1 tempest-ProjectMemberTests-538781697 None] Creating volume fa1f84bf-7d0d-4b4b-b9bb-856f0784b137 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:38:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-78d00c14-57c2-463c-87cf-a8fc2fa33de1 tempest-ProjectMemberTests-538781697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-78d00c14-57c2-463c-87cf-a8fc2fa33de1 tempest-ProjectMemberTests-538781697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:58 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-78d00c14-57c2-463c-87cf-a8fc2fa33de1 tempest-ProjectMemberTests-538781697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:58 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-78d00c14-57c2-463c-87cf-a8fc2fa33de1 tempest-ProjectMemberTests-538781697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-78d00c14-57c2-463c-87cf-a8fc2fa33de1 tempest-ProjectMemberTests-538781697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:58 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-78d00c14-57c2-463c-87cf-a8fc2fa33de1 tempest-ProjectMemberTests-538781697 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:38:58 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-78d00c14-57c2-463c-87cf-a8fc2fa33de1 tempest-ProjectMemberTests-538781697 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:38:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-78d00c14-57c2-463c-87cf-a8fc2fa33de1 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:58 devstack sudo[105993]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137 1073741824 Nov 01 12:38:58 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d99dfc08-e656-4e7e-ba33-e53910a20ccf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9dccb0a-5faf-42a7-a7b0-c126ff49a02a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e0d6ae3-0173-439f-a91e-1df505923c26', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:58 devstack sudo[105993]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:58 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d99dfc08-e656-4e7e-ba33-e53910a20ccf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57e2c6ac-7487-4083-b338-ffd8002635c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:58 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-d99dfc08-e656-4e7e-ba33-e53910a20ccf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Volume volume-3e0d6ae3-0173-439f-a91e-1df505923c26 (3e0d6ae3-0173-439f-a91e-1df505923c26): created successfully Nov 01 12:38:58 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d99dfc08-e656-4e7e-ba33-e53910a20ccf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (57e2c6ac-7487-4083-b338-ffd8002635c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:58 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d99dfc08-e656-4e7e-ba33-e53910a20ccf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Flow 'volume_create_manager' (c0796acd-f9ed-44ef-a36c-592dbbb1ed9b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:58 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-d99dfc08-e656-4e7e-ba33-e53910a20ccf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Created volume successfully. Nov 01 12:38:59 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-48fc9dac-1c4d-4137-b153-b36abb0f4204 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Acquiring lock "cinder-3e0d6ae3-0173-439f-a91e-1df505923c26-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:59 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-48fc9dac-1c4d-4137-b153-b36abb0f4204 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "cinder-3e0d6ae3-0173-439f-a91e-1df505923c26-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:59 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:38:59 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-48fc9dac-1c4d-4137-b153-b36abb0f4204 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Acquiring lock "cinder-quobyte-3e0d6ae3-0173-439f-a91e-1df505923c26" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:59 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-48fc9dac-1c4d-4137-b153-b36abb0f4204 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "cinder-quobyte-3e0d6ae3-0173-439f-a91e-1df505923c26" acquired by "delete_volume" :: waited 0.031s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:59 devstack sudo[105993]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:59 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] Flow 'volume_create_manager' (dad7991d-888c-47a2-abc1-d8d22b14b13c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:59 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6996937c-cfcd-4da7-8b02-ec206540e5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:59 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[56ab767a-37f1-48bc-8b91-f109641056d5]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-48fc9dac-1c4d-4137-b153-b36abb0f4204 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3e0d6ae3-0173-439f-a91e-1df505923c26 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-78d00c14-57c2-463c-87cf-a8fc2fa33de1 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137 1073741824" returned: 0 in 0.721s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:59 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6996937c-cfcd-4da7-8b02-ec206540e5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:38:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeDependencyTests-Volume-907886606',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ca98ccb-8b71-4c12-bff8-04e4f1f3366d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bb39a7a774444abcaa3b6a8cbfef8f95',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:38:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=f26d7383-c093-47ee-ab33-579cf03e25da,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:38:59Z,use_quota=True,user_id='296a919ba5574538ae75a586bd625da3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:59 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f996e0f2-abaf-47a9-9c31-3d9c574d933a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:59 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f996e0f2-abaf-47a9-9c31-3d9c574d933a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:59 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c9d1df6-d5da-4d8c-88ee-6f4d7484ea8e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:59 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6c9d1df6-d5da-4d8c-88ee-6f4d7484ea8e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '7ca98ccb-8b71-4c12-bff8-04e4f1f3366d', 'volume_name': 'volume-7ca98ccb-8b71-4c12-bff8-04e4f1f3366d', 'volume_size': 1, 'snapshot_id': 'f26d7383-c093-47ee-ab33-579cf03e25da'}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:59 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0f5c4ad-4168-4587-9339-1289b68b21a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:59 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c0f5c4ad-4168-4587-9339-1289b68b21a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:59 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (896dcb90-52d5-42f9-9f6c-69bae2dbdbfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:59 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] Volume 7ca98ccb-8b71-4c12-bff8-04e4f1f3366d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-7ca98ccb-8b71-4c12-bff8-04e4f1f3366d', 'volume_size': 1, 'snapshot_id': 'f26d7383-c093-47ee-ab33-579cf03e25da'} Nov 01 12:38:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-78d00c14-57c2-463c-87cf-a8fc2fa33de1 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:59 devstack sudo[105999]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3e0d6ae3-0173-439f-a91e-1df505923c26 Nov 01 12:38:59 devstack sudo[105999]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:59 devstack sudo[106000]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137 Nov 01 12:38:59 devstack sudo[106000]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:59 devstack sudo[106000]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-78d00c14-57c2-463c-87cf-a8fc2fa33de1 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137" returned: 0 in 0.273s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:59 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-78d00c14-57c2-463c-87cf-a8fc2fa33de1 tempest-ProjectMemberTests-538781697 None] <== create_volume: return (1088ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:38:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-78d00c14-57c2-463c-87cf-a8fc2fa33de1 tempest-ProjectMemberTests-538781697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.093s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.299s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:59 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] Acquiring lock "cinder-quobyte-f26d7383-c093-47ee-ab33-579cf03e25da-7ca98ccb-8b71-4c12-bff8-04e4f1f3366d" by "_create_volume_from_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:59 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-78d00c14-57c2-463c-87cf-a8fc2fa33de1 tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (670a2e74-486c-4175-aed5-7ea8e7a207ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:59 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-78d00c14-57c2-463c-87cf-a8fc2fa33de1 tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0601f880-ece1-45f6-915b-f5a7c75e1922) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:38:59 devstack sudo[105999]: pam_unix(sudo:session): session closed for user root Nov 01 12:38:59 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] Lock "cinder-quobyte-f26d7383-c093-47ee-ab33-579cf03e25da-7ca98ccb-8b71-4c12-bff8-04e4f1f3366d" acquired by "_create_volume_from_snapshot" :: waited 0.042s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:59 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] Creating volume 7ca98ccb-8b71-4c12-bff8-04e4f1f3366d from snapshot f26d7383-c093-47ee-ab33-579cf03e25da {{(pid=86574) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 01 12:38:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:59 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:59 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:59 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:38:59 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] Acquiring lock "cinder-quobyte-7ca98ccb-8b71-4c12-bff8-04e4f1f3366d" by "_copy_volume_from_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:38:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-48fc9dac-1c4d-4137-b153-b36abb0f4204 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3e0d6ae3-0173-439f-a91e-1df505923c26" returned: 0 in 0.448s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:38:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-48fc9dac-1c4d-4137-b153-b36abb0f4204 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3e0d6ae3-0173-439f-a91e-1df505923c26 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:38:59 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-78d00c14-57c2-463c-87cf-a8fc2fa33de1 tempest-ProjectMemberTests-538781697 None] Volume volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137 (fa1f84bf-7d0d-4b4b-b9bb-856f0784b137): created successfully Nov 01 12:38:59 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-78d00c14-57c2-463c-87cf-a8fc2fa33de1 tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0601f880-ece1-45f6-915b-f5a7c75e1922) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:38:59 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-78d00c14-57c2-463c-87cf-a8fc2fa33de1 tempest-ProjectMemberTests-538781697 None] Flow 'volume_create_manager' (0d7e7fcc-ef4b-4c5d-a47e-4aee87479296) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:38:59 devstack sudo[106007]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3e0d6ae3-0173-439f-a91e-1df505923c26 Nov 01 12:38:59 devstack sudo[106007]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:38:59 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] Lock "cinder-quobyte-7ca98ccb-8b71-4c12-bff8-04e4f1f3366d" acquired by "_copy_volume_from_snapshot" :: waited 0.058s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:38:59 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] snapshot: f26d7383-c093-47ee-ab33-579cf03e25da, volume: 7ca98ccb-8b71-4c12-bff8-04e4f1f3366d, {{(pid=86574) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 01 12:38:59 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-78d00c14-57c2-463c-87cf-a8fc2fa33de1 tempest-ProjectMemberTests-538781697 None] Created volume successfully. Nov 01 12:38:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:38:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:38:59 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:38:59 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:38:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:38:59 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[31d4cbe7-7f77-4e23-8938-70fa63fef845]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:38:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d.f26d7383-c093-47ee-ab33-579cf03e25da {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:00 devstack sudo[106009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d.f26d7383-c093-47ee-ab33-579cf03e25da Nov 01 12:39:00 devstack sudo[106009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:00 devstack sudo[106007]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-48fc9dac-1c4d-4137-b153-b36abb0f4204 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-3e0d6ae3-0173-439f-a91e-1df505923c26" returned: 0 in 0.306s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:00 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-48fc9dac-1c4d-4137-b153-b36abb0f4204 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "cinder-quobyte-3e0d6ae3-0173-439f-a91e-1df505923c26" released by "delete_volume" :: held 0.848s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:00 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-48fc9dac-1c4d-4137-b153-b36abb0f4204 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Created reservations ['a67a7102-ba31-488d-9308-1315ec64df59', '25e3527d-20e6-439c-84d4-270332e93b6b', 'd3dc6a20-b04d-4e52-8fa8-4686226ae3fd', 'db9c782e-a665-4995-bd0f-369b2d8fd59f'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:39:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-48fc9dac-1c4d-4137-b153-b36abb0f4204 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-48fc9dac-1c4d-4137-b153-b36abb0f4204 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:00 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-48fc9dac-1c4d-4137-b153-b36abb0f4204 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:39:00 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-48fc9dac-1c4d-4137-b153-b36abb0f4204 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:39:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-48fc9dac-1c4d-4137-b153-b36abb0f4204 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-48fc9dac-1c4d-4137-b153-b36abb0f4204 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:00 devstack sudo[106014]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:39:00 devstack sudo[106014]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:00 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ea31a94c-62b9-4f91-86e6-cf47c5293abe tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Acquiring lock "cinder-92baefc2-d803-4e73-9477-a48d5f726893-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:00 devstack sudo[106009]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:00 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ea31a94c-62b9-4f91-86e6-cf47c5293abe tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "cinder-92baefc2-d803-4e73-9477-a48d5f726893-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d.f26d7383-c093-47ee-ab33-579cf03e25da" returned: 0 in 0.508s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:00 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:39:00 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ea31a94c-62b9-4f91-86e6-cf47c5293abe tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Acquiring lock "cinder-quobyte-92baefc2-d803-4e73-9477-a48d5f726893" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:00 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[b64b1a8e-70de-4635-8202-7035dd13bcda]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:00 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ea31a94c-62b9-4f91-86e6-cf47c5293abe tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "cinder-quobyte-92baefc2-d803-4e73-9477-a48d5f726893" acquired by "delete_volume" :: waited 0.031s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:00 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[bb8dca17-2794-4c27-a482-74635782e1ab]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ea31a94c-62b9-4f91-86e6-cf47c5293abe tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-92baefc2-d803-4e73-9477-a48d5f726893 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:00 devstack sudo[106017]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d Nov 01 12:39:00 devstack sudo[106017]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:00 devstack sudo[106018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-92baefc2-d803-4e73-9477-a48d5f726893 Nov 01 12:39:00 devstack sudo[106018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:00 devstack sudo[106014]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-48fc9dac-1c4d-4137-b153-b36abb0f4204 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.531s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:00 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-48fc9dac-1c4d-4137-b153-b36abb0f4204 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:39:00 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-48fc9dac-1c4d-4137-b153-b36abb0f4204 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Deleted volume successfully. Nov 01 12:39:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f59734b8-7df9-4879-b5be-2ed6c037cf04 tempest-ProjectMemberTests-538781697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:00 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-48fc9dac-1c4d-4137-b153-b36abb0f4204 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "cinder-3e0d6ae3-0173-439f-a91e-1df505923c26-delete_volume" released by "delete_volume" :: held 1.690s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:00 devstack sudo[106017]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d" returned: 0 in 0.489s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:01 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d {{(pid=86574) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 01 12:39:01 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] Creating direct copy from snapshot {{(pid=86574) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 01 12:39:01 devstack cinder-volume[86574]: DEBUG cinder.utils [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] Path /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7ca98ccb-8b71-4c12-bff8-04e4f1f3366d not found in is_blk_device check {{(pid=86574) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 01 12:39:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7ca98ccb-8b71-4c12-bff8-04e4f1f3366d {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:01 devstack sudo[106018]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ea31a94c-62b9-4f91-86e6-cf47c5293abe tempest-CreateVolumesFromSourceVolumeTest-207056831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-92baefc2-d803-4e73-9477-a48d5f726893" returned: 0 in 0.460s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ea31a94c-62b9-4f91-86e6-cf47c5293abe tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-92baefc2-d803-4e73-9477-a48d5f726893 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:01 devstack sudo[106030]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7ca98ccb-8b71-4c12-bff8-04e4f1f3366d Nov 01 12:39:01 devstack sudo[106030]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:01 devstack sudo[106032]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-92baefc2-d803-4e73-9477-a48d5f726893 Nov 01 12:39:01 devstack sudo[106032]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:01 devstack sudo[106032]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ea31a94c-62b9-4f91-86e6-cf47c5293abe tempest-CreateVolumesFromSourceVolumeTest-207056831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-92baefc2-d803-4e73-9477-a48d5f726893" returned: 0 in 0.268s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:01 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ea31a94c-62b9-4f91-86e6-cf47c5293abe tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "cinder-quobyte-92baefc2-d803-4e73-9477-a48d5f726893" released by "delete_volume" :: held 0.795s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:01 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-ea31a94c-62b9-4f91-86e6-cf47c5293abe tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Created reservations ['f03869a3-4271-4a92-bf3f-5556e5e9217b', 'a92da297-af11-47a4-b99a-e6df1e55aea4', 'c0d9e171-f6a3-47fb-8610-1efbf4959d95', '6f8f4718-e5b5-47b7-868b-d4147f721178'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:39:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ea31a94c-62b9-4f91-86e6-cf47c5293abe tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ea31a94c-62b9-4f91-86e6-cf47c5293abe tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:01 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ea31a94c-62b9-4f91-86e6-cf47c5293abe tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:39:01 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ea31a94c-62b9-4f91-86e6-cf47c5293abe tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:39:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ea31a94c-62b9-4f91-86e6-cf47c5293abe tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ea31a94c-62b9-4f91-86e6-cf47c5293abe tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:01 devstack sudo[106039]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:39:01 devstack sudo[106039]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:01 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-666e4054-1bc8-41d7-a20c-f9e7402f02ff tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Acquiring lock "cinder-ebbdda3e-f73e-48ac-84a5-c371439cd011-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:01 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-666e4054-1bc8-41d7-a20c-f9e7402f02ff tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "cinder-ebbdda3e-f73e-48ac-84a5-c371439cd011-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:01 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-666e4054-1bc8-41d7-a20c-f9e7402f02ff tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Acquiring lock "cinder-quobyte-ebbdda3e-f73e-48ac-84a5-c371439cd011" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:01 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-666e4054-1bc8-41d7-a20c-f9e7402f02ff tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "cinder-quobyte-ebbdda3e-f73e-48ac-84a5-c371439cd011" acquired by "delete_volume" :: waited 0.045s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:02 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[24e9253c-5f78-4bb8-9ce6-6d172f870461]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-666e4054-1bc8-41d7-a20c-f9e7402f02ff tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ebbdda3e-f73e-48ac-84a5-c371439cd011 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:02 devstack sudo[106039]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ea31a94c-62b9-4f91-86e6-cf47c5293abe tempest-CreateVolumesFromSourceVolumeTest-207056831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.587s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:02 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-ea31a94c-62b9-4f91-86e6-cf47c5293abe tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:39:02 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-ea31a94c-62b9-4f91-86e6-cf47c5293abe tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Deleted volume successfully. Nov 01 12:39:02 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ea31a94c-62b9-4f91-86e6-cf47c5293abe tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "cinder-92baefc2-d803-4e73-9477-a48d5f726893-delete_volume" released by "delete_volume" :: held 1.688s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:02 devstack sudo[106048]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ebbdda3e-f73e-48ac-84a5-c371439cd011 Nov 01 12:39:02 devstack sudo[106048]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:02 devstack sudo[106048]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-666e4054-1bc8-41d7-a20c-f9e7402f02ff tempest-CreateVolumesFromSourceVolumeTest-207056831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ebbdda3e-f73e-48ac-84a5-c371439cd011" returned: 0 in 0.752s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-666e4054-1bc8-41d7-a20c-f9e7402f02ff tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ebbdda3e-f73e-48ac-84a5-c371439cd011 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:02 devstack sudo[106054]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ebbdda3e-f73e-48ac-84a5-c371439cd011 Nov 01 12:39:02 devstack sudo[106054]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:03 devstack sudo[106054]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-666e4054-1bc8-41d7-a20c-f9e7402f02ff tempest-CreateVolumesFromSourceVolumeTest-207056831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ebbdda3e-f73e-48ac-84a5-c371439cd011" returned: 0 in 0.460s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:03 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-666e4054-1bc8-41d7-a20c-f9e7402f02ff tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "cinder-quobyte-ebbdda3e-f73e-48ac-84a5-c371439cd011" released by "delete_volume" :: held 1.326s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:03 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-666e4054-1bc8-41d7-a20c-f9e7402f02ff tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Created reservations ['8f6473a2-4127-44de-9291-a816c1f6f62c', '79c727a8-3806-4a78-95ba-d2d87bd5ed13', 'a0a31822-6abd-4ea3-b92a-36364b130bd4', '00563b34-f701-4076-a375-cc07b8920ff2'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:39:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-666e4054-1bc8-41d7-a20c-f9e7402f02ff tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-666e4054-1bc8-41d7-a20c-f9e7402f02ff tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-666e4054-1bc8-41d7-a20c-f9e7402f02ff tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:39:03 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-666e4054-1bc8-41d7-a20c-f9e7402f02ff tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:39:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-666e4054-1bc8-41d7-a20c-f9e7402f02ff tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-666e4054-1bc8-41d7-a20c-f9e7402f02ff tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:03 devstack sudo[106057]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:39:03 devstack sudo[106057]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:03 devstack sudo[106057]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-666e4054-1bc8-41d7-a20c-f9e7402f02ff tempest-CreateVolumesFromSourceVolumeTest-207056831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.416s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:03 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-666e4054-1bc8-41d7-a20c-f9e7402f02ff tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:39:03 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-666e4054-1bc8-41d7-a20c-f9e7402f02ff tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Deleted volume successfully. Nov 01 12:39:03 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-666e4054-1bc8-41d7-a20c-f9e7402f02ff tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "cinder-ebbdda3e-f73e-48ac-84a5-c371439cd011-delete_volume" released by "delete_volume" :: held 2.222s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:04 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-8580bab7-0c35-40b5-bf56-80c1f93a8884 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Acquiring lock "cinder-2db46282-c878-45b1-bfb8-fc86ea419ba2-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:04 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-8580bab7-0c35-40b5-bf56-80c1f93a8884 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "cinder-2db46282-c878-45b1-bfb8-fc86ea419ba2-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:04 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-8580bab7-0c35-40b5-bf56-80c1f93a8884 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Acquiring lock "cinder-quobyte-2db46282-c878-45b1-bfb8-fc86ea419ba2" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:04 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-8580bab7-0c35-40b5-bf56-80c1f93a8884 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "cinder-quobyte-2db46282-c878-45b1-bfb8-fc86ea419ba2" acquired by "delete_volume" :: waited 0.032s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:04 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b03a075-ee6b-4bd1-9c5a-13269bdee4a7]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8580bab7-0c35-40b5-bf56-80c1f93a8884 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-2db46282-c878-45b1-bfb8-fc86ea419ba2 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:04 devstack sudo[106061]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-2db46282-c878-45b1-bfb8-fc86ea419ba2 Nov 01 12:39:04 devstack sudo[106061]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:05 devstack sudo[106061]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8580bab7-0c35-40b5-bf56-80c1f93a8884 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-2db46282-c878-45b1-bfb8-fc86ea419ba2" returned: 0 in 0.715s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8580bab7-0c35-40b5-bf56-80c1f93a8884 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-2db46282-c878-45b1-bfb8-fc86ea419ba2 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:05 devstack sudo[106066]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-2db46282-c878-45b1-bfb8-fc86ea419ba2 Nov 01 12:39:05 devstack sudo[106066]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:05 devstack sudo[106066]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8580bab7-0c35-40b5-bf56-80c1f93a8884 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-2db46282-c878-45b1-bfb8-fc86ea419ba2" returned: 0 in 0.442s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:05 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-8580bab7-0c35-40b5-bf56-80c1f93a8884 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "cinder-quobyte-2db46282-c878-45b1-bfb8-fc86ea419ba2" released by "delete_volume" :: held 1.270s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:05 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-8580bab7-0c35-40b5-bf56-80c1f93a8884 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Created reservations ['748bd1c6-b588-4822-966c-7964213cc832', '427628ce-bdc5-45e1-a0e7-80688c5baa20', 'b369dad5-3dc3-4271-9d69-07782c8c202d', '1d7e8186-6e79-49d0-ba43-545014b67075'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:39:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8580bab7-0c35-40b5-bf56-80c1f93a8884 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8580bab7-0c35-40b5-bf56-80c1f93a8884 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:05 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-8580bab7-0c35-40b5-bf56-80c1f93a8884 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:39:05 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-8580bab7-0c35-40b5-bf56-80c1f93a8884 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:39:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8580bab7-0c35-40b5-bf56-80c1f93a8884 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8580bab7-0c35-40b5-bf56-80c1f93a8884 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:05 devstack sudo[106069]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:39:05 devstack sudo[106069]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:06 devstack sudo[106069]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8580bab7-0c35-40b5-bf56-80c1f93a8884 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.432s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:06 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-8580bab7-0c35-40b5-bf56-80c1f93a8884 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:39:06 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-8580bab7-0c35-40b5-bf56-80c1f93a8884 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Deleted volume successfully. Nov 01 12:39:06 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-8580bab7-0c35-40b5-bf56-80c1f93a8884 tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "cinder-2db46282-c878-45b1-bfb8-fc86ea419ba2-delete_volume" released by "delete_volume" :: held 2.103s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:06 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-78fe2677-5de6-4a66-b4fa-2b3832b08aba tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Acquiring lock "cinder-d0249fc2-21f9-410b-9af7-12979e365338-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:06 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-78fe2677-5de6-4a66-b4fa-2b3832b08aba tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "cinder-d0249fc2-21f9-410b-9af7-12979e365338-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:06 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-78fe2677-5de6-4a66-b4fa-2b3832b08aba tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Acquiring lock "cinder-quobyte-d0249fc2-21f9-410b-9af7-12979e365338" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:06 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-78fe2677-5de6-4a66-b4fa-2b3832b08aba tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "cinder-quobyte-d0249fc2-21f9-410b-9af7-12979e365338" acquired by "delete_volume" :: waited 0.021s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:06 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[397cf17b-dd3d-48a5-ace3-0c49e6ae367b]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-78fe2677-5de6-4a66-b4fa-2b3832b08aba tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d0249fc2-21f9-410b-9af7-12979e365338 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:07 devstack sudo[106074]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d0249fc2-21f9-410b-9af7-12979e365338 Nov 01 12:39:07 devstack sudo[106074]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:07 devstack sudo[106074]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-78fe2677-5de6-4a66-b4fa-2b3832b08aba tempest-CreateVolumesFromSourceVolumeTest-207056831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d0249fc2-21f9-410b-9af7-12979e365338" returned: 0 in 0.631s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-78fe2677-5de6-4a66-b4fa-2b3832b08aba tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d0249fc2-21f9-410b-9af7-12979e365338 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:07 devstack sudo[106079]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d0249fc2-21f9-410b-9af7-12979e365338 Nov 01 12:39:07 devstack sudo[106079]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:07 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:39:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Flow 'volume_create_manager' (dd241c93-0176-4c0f-a15d-fc09736003fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:39:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34a38f41-9a8f-4711-85d9-528aa964b74b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (34a38f41-9a8f-4711-85d9-528aa964b74b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:39:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86df19b4-85a4-4f70-ae3b-916d1d270ac7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8a56df23c8741fcb2ff434b5c4bc6bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:39:08Z,use_quota=True,user_id='17ae6ad64b4e41f4b28304d1827ee3ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0836d4eb-128e-4df1-b504-40070f5647f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0836d4eb-128e-4df1-b504-40070f5647f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:07 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8426d45-fe6e-4f64-a62f-b20db69b98eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:07 devstack cinder-volume[86574]: DEBUG cinder.image.glance [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Creating Keystone auth plugin from conf {{(pid=86574) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:135}} Nov 01 12:39:08 devstack sudo[106079]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-78fe2677-5de6-4a66-b4fa-2b3832b08aba tempest-CreateVolumesFromSourceVolumeTest-207056831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-d0249fc2-21f9-410b-9af7-12979e365338" returned: 0 in 0.759s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:08 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-78fe2677-5de6-4a66-b4fa-2b3832b08aba tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "cinder-quobyte-d0249fc2-21f9-410b-9af7-12979e365338" released by "delete_volume" :: held 1.518s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:08 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c8426d45-fe6e-4f64-a62f-b20db69b98eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '86df19b4-85a4-4f70-ae3b-916d1d270ac7', 'volume_name': 'volume-86df19b4-85a4-4f70-ae3b-916d1d270ac7', 'volume_size': 1, 'image_id': '19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4ebf3eb865c4ebe6d481c688f973e726', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a8a56df23c8741fcb2ff434b5c4bc6bc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '693b3e6d4329692378477c5b1b61796bea45fc9f6d25b64b7a1ad71210e58f0653b00d18be1a74f9f88f22d3a5e7414922f6c3ab799298ced8be1d3dd166f16e', 'id': '19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3', 'created_at': datetime.datetime(2026, 11, 1, 11, 39, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 39, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3/file', 'properties': {}}, 'image_service': }' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:08 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df698efe-d360-4420-a252-dc0982964dbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:08 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (df698efe-d360-4420-a252-dc0982964dbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:08 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1df2359d-841a-48d0-9f08-cf3c4526ad0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:08 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Volume 86df19b4-85a4-4f70-ae3b-916d1d270ac7: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-86df19b4-85a4-4f70-ae3b-916d1d270ac7', 'volume_size': 1, 'image_id': '19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4ebf3eb865c4ebe6d481c688f973e726', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a8a56df23c8741fcb2ff434b5c4bc6bc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '693b3e6d4329692378477c5b1b61796bea45fc9f6d25b64b7a1ad71210e58f0653b00d18be1a74f9f88f22d3a5e7414922f6c3ab799298ced8be1d3dd166f16e', 'id': '19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3', 'created_at': datetime.datetime(2026, 11, 1, 11, 39, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 39, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3/file', 'properties': {}}, 'image_service': } Nov 01 12:39:08 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Trying to clone 86df19b4-85a4-4f70-ae3b-916d1d270ac7 from image 19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3 at location (None, [{'url': 'file:///opt/stack/data/glance/images/19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3', 'metadata': {}}]). {{(pid=86574) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1091}} Nov 01 12:39:08 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-78fe2677-5de6-4a66-b4fa-2b3832b08aba tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Created reservations ['3495b596-afc1-4a00-af70-ca2991ea25c8', '6fc3f564-0dc2-425e-9b2c-31ab9c31ce55', '1d477387-76bd-4bc1-8b4d-0f762f674aaa', '3158631c-7fd5-4a38-a0bc-e6cb64645e26'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:39:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-78fe2677-5de6-4a66-b4fa-2b3832b08aba tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-78fe2677-5de6-4a66-b4fa-2b3832b08aba tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:08 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-78fe2677-5de6-4a66-b4fa-2b3832b08aba tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:39:08 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-78fe2677-5de6-4a66-b4fa-2b3832b08aba tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:39:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-78fe2677-5de6-4a66-b4fa-2b3832b08aba tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-78fe2677-5de6-4a66-b4fa-2b3832b08aba tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:08 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3_nkrnk7badevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=86574) fetch /opt/stack/cinder/cinder/image/image_utils.py:759}} Nov 01 12:39:08 devstack cinder-volume[86574]: INFO cinder.image.image_utils [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Image download 0.00 MB at 0.00 MB/s Nov 01 12:39:08 devstack sudo[106083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:39:08 devstack sudo[106083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:08 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[ea9713ea-327b-46e4-b254-63e00a421363]: (4, 'raw') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3_nkrnk7badevstack@QuobyteHD {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:08 devstack sudo[106083]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-78fe2677-5de6-4a66-b4fa-2b3832b08aba tempest-CreateVolumesFromSourceVolumeTest-207056831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.375s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:08 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-78fe2677-5de6-4a66-b4fa-2b3832b08aba tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:39:08 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-78fe2677-5de6-4a66-b4fa-2b3832b08aba tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Deleted volume successfully. Nov 01 12:39:09 devstack sudo[106085]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3_nkrnk7badevstack@QuobyteHD Nov 01 12:39:09 devstack sudo[106085]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:09 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-78fe2677-5de6-4a66-b4fa-2b3832b08aba tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "cinder-d0249fc2-21f9-410b-9af7-12979e365338-delete_volume" released by "delete_volume" :: held 2.386s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:09 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e98c49a8-2899-4587-9cd1-f0ea53f811cf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Acquiring lock "cinder-37e3f6d1-d91c-4558-ad03-6bc4cf27a539-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:09 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e98c49a8-2899-4587-9cd1-f0ea53f811cf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "cinder-37e3f6d1-d91c-4558-ad03-6bc4cf27a539-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7ca98ccb-8b71-4c12-bff8-04e4f1f3366d" returned: 0 in 8.155s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:09 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] Image conversion details: src /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d, size 1024.00 MB, duration 8.16 sec, destination /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7ca98ccb-8b71-4c12-bff8-04e4f1f3366d {{(pid=86574) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 12:39:09 devstack cinder-volume[86574]: INFO cinder.image.image_utils [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] Converted 1024.00 MB image at 125.54 MB/s Nov 01 12:39:09 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7ca98ccb-8b71-4c12-bff8-04e4f1f3366d is being set with open permissions: ugo+rw Nov 01 12:39:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7ca98ccb-8b71-4c12-bff8-04e4f1f3366d {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:09 devstack sudo[106088]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7ca98ccb-8b71-4c12-bff8-04e4f1f3366d Nov 01 12:39:09 devstack sudo[106088]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:09 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e98c49a8-2899-4587-9cd1-f0ea53f811cf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Acquiring lock "cinder-quobyte-37e3f6d1-d91c-4558-ad03-6bc4cf27a539" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:09 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e98c49a8-2899-4587-9cd1-f0ea53f811cf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "cinder-quobyte-37e3f6d1-d91c-4558-ad03-6bc4cf27a539" acquired by "delete_volume" :: waited 0.015s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:09 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec96f3b5-2d9e-4dbd-8c3f-56956262f009]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e98c49a8-2899-4587-9cd1-f0ea53f811cf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-37e3f6d1-d91c-4558-ad03-6bc4cf27a539 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:09 devstack sudo[106085]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3_nkrnk7badevstack@QuobyteHD" returned: 0 in 0.602s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3_nkrnk7badevstack@QuobyteHD {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:09 devstack sudo[106090]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-37e3f6d1-d91c-4558-ad03-6bc4cf27a539 Nov 01 12:39:09 devstack sudo[106090]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:09 devstack sudo[106088]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7ca98ccb-8b71-4c12-bff8-04e4f1f3366d" returned: 0 in 0.270s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:09 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] Lock "cinder-quobyte-7ca98ccb-8b71-4c12-bff8-04e4f1f3366d" released by "_copy_volume_from_snapshot" :: held 9.562s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:09 devstack sudo[106093]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3_nkrnk7badevstack@QuobyteHD Nov 01 12:39:09 devstack sudo[106093]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:09 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] Lock "cinder-quobyte-f26d7383-c093-47ee-ab33-579cf03e25da-7ca98ccb-8b71-4c12-bff8-04e4f1f3366d" released by "_create_volume_from_snapshot" :: held 9.679s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 9.724s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f59734b8-7df9-4879-b5be-2ed6c037cf04 tempest-ProjectMemberTests-538781697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 8.628s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:09 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-f59734b8-7df9-4879-b5be-2ed6c037cf04 tempest-ProjectMemberTests-538781697 None] Creating offline snapshot 5dc7217c-21ac-4565-8ac6-efa1e4937974 of volume fa1f84bf-7d0d-4b4b-b9bb-856f0784b137 {{(pid=86574) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:39:09 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (896dcb90-52d5-42f9-9f6c-69bae2dbdbfd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ca98ccb-8b71-4c12-bff8-04e4f1f3366d', 'volume_size': 1, 'snapshot_id': 'f26d7383-c093-47ee-ab33-579cf03e25da'}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:09 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d74097de-9798-41fd-ac9d-d03ab614ac22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:09 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[edcd33f0-eef5-4e4d-8714-9831212aafce]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f59734b8-7df9-4879-b5be-2ed6c037cf04 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:09 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] Volume volume-7ca98ccb-8b71-4c12-bff8-04e4f1f3366d (7ca98ccb-8b71-4c12-bff8-04e4f1f3366d): created successfully Nov 01 12:39:09 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d74097de-9798-41fd-ac9d-d03ab614ac22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:09 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] Flow 'volume_create_manager' (dad7991d-888c-47a2-abc1-d8d22b14b13c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:39:09 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-9aee3f14-f991-4cd9-8908-1e66af320197 tempest-VolumeDependencyTests-648381524 None] Created volume successfully. Nov 01 12:39:09 devstack sudo[106090]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e98c49a8-2899-4587-9cd1-f0ea53f811cf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-37e3f6d1-d91c-4558-ad03-6bc4cf27a539" returned: 0 in 0.432s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e98c49a8-2899-4587-9cd1-f0ea53f811cf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-37e3f6d1-d91c-4558-ad03-6bc4cf27a539 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:09 devstack sudo[106098]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137 Nov 01 12:39:09 devstack sudo[106098]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:09 devstack sudo[106101]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-37e3f6d1-d91c-4558-ad03-6bc4cf27a539 Nov 01 12:39:09 devstack sudo[106101]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:09 devstack sudo[106093]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3_nkrnk7badevstack@QuobyteHD" returned: 1 in 0.410s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3_nkrnk7badevstack@QuobyteHD' failed. Not Retrying. {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 12:39:09 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Temporary image 19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3 is fetched for user 17ae6ad64b4e41f4b28304d1827ee3ff. {{(pid=86574) fetch /opt/stack/cinder/cinder/image/image_utils.py:1458}} Nov 01 12:39:09 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[db4b3e17-0e34-4174-af0e-5c9315a66748]: (4, 'raw') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3_nkrnk7badevstack@QuobyteHD {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:09 devstack sudo[106101]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e98c49a8-2899-4587-9cd1-f0ea53f811cf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-37e3f6d1-d91c-4558-ad03-6bc4cf27a539" returned: 0 in 0.267s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:09 devstack sudo[106107]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3_nkrnk7badevstack@QuobyteHD Nov 01 12:39:09 devstack sudo[106107]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:09 devstack sudo[106098]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:09 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e98c49a8-2899-4587-9cd1-f0ea53f811cf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "cinder-quobyte-37e3f6d1-d91c-4558-ad03-6bc4cf27a539" released by "delete_volume" :: held 0.747s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f59734b8-7df9-4879-b5be-2ed6c037cf04 tempest-ProjectMemberTests-538781697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137" returned: 0 in 0.413s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f59734b8-7df9-4879-b5be-2ed6c037cf04 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137.5dc7217c-21ac-4565-8ac6-efa1e4937974 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:09 devstack sudo[106113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137.5dc7217c-21ac-4565-8ac6-efa1e4937974 1G Nov 01 12:39:09 devstack sudo[106113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:10 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-e98c49a8-2899-4587-9cd1-f0ea53f811cf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Created reservations ['0ce672d1-3c55-4ff0-a215-9a1e5cf2701f', '7f813dcc-13e4-421b-b49b-4de5c6d453c1', 'b04ef61d-b1d7-46a3-96c8-7375004ced70', '407b28d8-c509-473d-aeea-5d6a227031e2'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:39:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e98c49a8-2899-4587-9cd1-f0ea53f811cf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e98c49a8-2899-4587-9cd1-f0ea53f811cf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:10 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e98c49a8-2899-4587-9cd1-f0ea53f811cf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:39:10 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e98c49a8-2899-4587-9cd1-f0ea53f811cf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:39:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e98c49a8-2899-4587-9cd1-f0ea53f811cf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e98c49a8-2899-4587-9cd1-f0ea53f811cf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:10 devstack sudo[106115]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:39:10 devstack sudo[106115]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:10 devstack sudo[106107]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3_nkrnk7badevstack@QuobyteHD" returned: 0 in 0.354s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3_nkrnk7badevstack@QuobyteHD {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:10 devstack sudo[106121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3_nkrnk7badevstack@QuobyteHD Nov 01 12:39:10 devstack sudo[106121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:10 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-3e6958be-6eae-40af-800e-d9cf8da3c663 tempest-VolumeDependencyTests-648381524 None] Acquiring lock "cinder-f26d7383-c093-47ee-ab33-579cf03e25da-delete_snapshot" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:10 devstack sudo[106115]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e98c49a8-2899-4587-9cd1-f0ea53f811cf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.389s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:10 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-e98c49a8-2899-4587-9cd1-f0ea53f811cf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:39:10 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-3e6958be-6eae-40af-800e-d9cf8da3c663 tempest-VolumeDependencyTests-648381524 None] Lock "cinder-f26d7383-c093-47ee-ab33-579cf03e25da-delete_snapshot" acquired by "delete_snapshot" :: waited 0.140s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:10 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-3e6958be-6eae-40af-800e-d9cf8da3c663 tempest-VolumeDependencyTests-648381524 None] Acquiring lock "cinder-quobyte-22d85a4e-2114-4dd2-b912-a280dfc5c64d" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:10 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-e98c49a8-2899-4587-9cd1-f0ea53f811cf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Deleted volume successfully. Nov 01 12:39:10 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-3e6958be-6eae-40af-800e-d9cf8da3c663 tempest-VolumeDependencyTests-648381524 None] Lock "cinder-quobyte-22d85a4e-2114-4dd2-b912-a280dfc5c64d" acquired by "delete_snapshot" :: waited 0.045s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:10 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-3e6958be-6eae-40af-800e-d9cf8da3c663 tempest-VolumeDependencyTests-648381524 None] Acquiring lock "cinder-quobyte-f26d7383-c093-47ee-ab33-579cf03e25da" by "_delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:10 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e98c49a8-2899-4587-9cd1-f0ea53f811cf tempest-CreateVolumesFromSourceVolumeTest-207056831 None] Lock "cinder-37e3f6d1-d91c-4558-ad03-6bc4cf27a539-delete_volume" released by "delete_volume" :: held 1.437s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:10 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-3e6958be-6eae-40af-800e-d9cf8da3c663 tempest-VolumeDependencyTests-648381524 None] Lock "cinder-quobyte-f26d7383-c093-47ee-ab33-579cf03e25da" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:10 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-3e6958be-6eae-40af-800e-d9cf8da3c663 tempest-VolumeDependencyTests-648381524 None] Deleting offline snapshot f26d7383-c093-47ee-ab33-579cf03e25da of volume 22d85a4e-2114-4dd2-b912-a280dfc5c64d {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:39:10 devstack sudo[106113]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:10 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-3e6958be-6eae-40af-800e-d9cf8da3c663 tempest-VolumeDependencyTests-648381524 None] snapshot_file for this snap is: volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d.f26d7383-c093-47ee-ab33-579cf03e25da {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:39:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f59734b8-7df9-4879-b5be-2ed6c037cf04 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137.5dc7217c-21ac-4565-8ac6-efa1e4937974 1G" returned: 0 in 0.640s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f59734b8-7df9-4879-b5be-2ed6c037cf04 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137.5dc7217c-21ac-4565-8ac6-efa1e4937974 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:10 devstack sudo[106121]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:10 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[26b90beb-518f-4d6e-80bb-80a3e138d781]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3e6958be-6eae-40af-800e-d9cf8da3c663 tempest-VolumeDependencyTests-648381524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d.f26d7383-c093-47ee-ab33-579cf03e25da {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:10 devstack sudo[106129]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137.5dc7217c-21ac-4565-8ac6-efa1e4937974 Nov 01 12:39:10 devstack sudo[106129]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3_nkrnk7badevstack@QuobyteHD" returned: 1 in 0.452s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3_nkrnk7badevstack@QuobyteHD' failed. Not Retrying. {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 12:39:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:10 devstack sudo[106130]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d.f26d7383-c093-47ee-ab33-579cf03e25da Nov 01 12:39:10 devstack sudo[106130]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:10 devstack sudo[106129]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f59734b8-7df9-4879-b5be-2ed6c037cf04 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137.5dc7217c-21ac-4565-8ac6-efa1e4937974" returned: 0 in 0.296s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:10 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-f59734b8-7df9-4879-b5be-2ed6c037cf04 tempest-ProjectMemberTests-538781697 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137.5dc7217c-21ac-4565-8ac6-efa1e4937974 is being set with open permissions: ugo+rw Nov 01 12:39:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f59734b8-7df9-4879-b5be-2ed6c037cf04 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137.5dc7217c-21ac-4565-8ac6-efa1e4937974 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:10 devstack sudo[106136]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137.5dc7217c-21ac-4565-8ac6-efa1e4937974 Nov 01 12:39:10 devstack sudo[106136]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:11 devstack sudo[106130]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3e6958be-6eae-40af-800e-d9cf8da3c663 tempest-VolumeDependencyTests-648381524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d.f26d7383-c093-47ee-ab33-579cf03e25da" returned: 0 in 0.414s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:11 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-3e6958be-6eae-40af-800e-d9cf8da3c663 tempest-VolumeDependencyTests-648381524 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:39:11 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1926f5f-4d17-47b3-b978-4be6a459a871]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3e6958be-6eae-40af-800e-d9cf8da3c663 tempest-VolumeDependencyTests-648381524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:11 devstack sudo[106136]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f59734b8-7df9-4879-b5be-2ed6c037cf04 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137.5dc7217c-21ac-4565-8ac6-efa1e4937974" returned: 0 in 0.289s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f59734b8-7df9-4879-b5be-2ed6c037cf04 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:11 devstack sudo[106141]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d Nov 01 12:39:11 devstack sudo[106141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:11 devstack sudo[106144]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137.info Nov 01 12:39:11 devstack sudo[106144]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:11 devstack sudo[106144]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f59734b8-7df9-4879-b5be-2ed6c037cf04 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137.info" returned: 0 in 0.339s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:11 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-f59734b8-7df9-4879-b5be-2ed6c037cf04 tempest-ProjectMemberTests-538781697 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137.info is being set with open permissions: ugo+rw Nov 01 12:39:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f59734b8-7df9-4879-b5be-2ed6c037cf04 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:11 devstack sudo[106150]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137.info Nov 01 12:39:11 devstack sudo[106150]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:11 devstack sudo[106141]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3e6958be-6eae-40af-800e-d9cf8da3c663 tempest-VolumeDependencyTests-648381524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d" returned: 0 in 0.657s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3e6958be-6eae-40af-800e-d9cf8da3c663 tempest-VolumeDependencyTests-648381524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d.f26d7383-c093-47ee-ab33-579cf03e25da {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:11 devstack sudo[106153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d.f26d7383-c093-47ee-ab33-579cf03e25da Nov 01 12:39:11 devstack sudo[106153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:11 devstack sudo[106150]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f59734b8-7df9-4879-b5be-2ed6c037cf04 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137.info" returned: 0 in 0.322s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f59734b8-7df9-4879-b5be-2ed6c037cf04 tempest-ProjectMemberTests-538781697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.424s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.281s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:11 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:39:07Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=86df19b4-85a4-4f70-ae3b-916d1d270ac7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a8a56df23c8741fcb2ff434b5c4bc6bc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:39:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:39:08Z,use_quota=True,user_id='17ae6ad64b4e41f4b28304d1827ee3ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:39:11 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Creating volume 86df19b4-85a4-4f70-ae3b-916d1d270ac7 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:39:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:11 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:39:11 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:39:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:11 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:39:11 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:39:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-86df19b4-85a4-4f70-ae3b-916d1d270ac7 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:11 devstack sudo[106156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-86df19b4-85a4-4f70-ae3b-916d1d270ac7 1073741824 Nov 01 12:39:11 devstack sudo[106156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:11 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-f59734b8-7df9-4879-b5be-2ed6c037cf04 tempest-ProjectMemberTests-538781697 None] Create snapshot completed successfully Nov 01 12:39:12 devstack sudo[106153]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3e6958be-6eae-40af-800e-d9cf8da3c663 tempest-VolumeDependencyTests-648381524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d.f26d7383-c093-47ee-ab33-579cf03e25da" returned: 0 in 0.397s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3e6958be-6eae-40af-800e-d9cf8da3c663 tempest-VolumeDependencyTests-648381524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d.f26d7383-c093-47ee-ab33-579cf03e25da {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:12 devstack sudo[106161]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d.f26d7383-c093-47ee-ab33-579cf03e25da Nov 01 12:39:12 devstack sudo[106161]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:12 devstack sudo[106156]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-86df19b4-85a4-4f70-ae3b-916d1d270ac7 1073741824" returned: 0 in 0.484s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:12 devstack sudo[106161]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3e6958be-6eae-40af-800e-d9cf8da3c663 tempest-VolumeDependencyTests-648381524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d.f26d7383-c093-47ee-ab33-579cf03e25da" returned: 0 in 0.296s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:12 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-3e6958be-6eae-40af-800e-d9cf8da3c663 tempest-VolumeDependencyTests-648381524 None] Lock "cinder-quobyte-f26d7383-c093-47ee-ab33-579cf03e25da" released by "_delete_snapshot" :: held 1.906s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-86df19b4-85a4-4f70-ae3b-916d1d270ac7 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:12 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-3e6958be-6eae-40af-800e-d9cf8da3c663 tempest-VolumeDependencyTests-648381524 None] Lock "cinder-quobyte-22d85a4e-2114-4dd2-b912-a280dfc5c64d" released by "delete_snapshot" :: held 1.960s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:12 devstack sudo[106168]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-86df19b4-85a4-4f70-ae3b-916d1d270ac7 Nov 01 12:39:12 devstack sudo[106168]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:12 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-3e6958be-6eae-40af-800e-d9cf8da3c663 tempest-VolumeDependencyTests-648381524 None] Created reservations ['8c02072d-1c17-4b5b-a4fc-226847c2c835', 'b4ce1316-eaac-4516-b443-7992d2eefcd0', 'b73a0c1f-0878-42ad-a8ae-0c26095dae49', 'faede43c-f190-44fe-a29d-05fc7d55772f'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:39:12 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-21ec97ad-921a-493b-ad04-02c3678464ac tempest-ProjectMemberTests-538781697 None] Acquiring lock "cinder-5dc7217c-21ac-4565-8ac6-efa1e4937974-delete_snapshot" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:12 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-21ec97ad-921a-493b-ad04-02c3678464ac tempest-ProjectMemberTests-538781697 None] Lock "cinder-5dc7217c-21ac-4565-8ac6-efa1e4937974-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:12 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-21ec97ad-921a-493b-ad04-02c3678464ac tempest-ProjectMemberTests-538781697 None] Acquiring lock "cinder-quobyte-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:12 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-21ec97ad-921a-493b-ad04-02c3678464ac tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:12 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-21ec97ad-921a-493b-ad04-02c3678464ac tempest-ProjectMemberTests-538781697 None] Acquiring lock "cinder-quobyte-5dc7217c-21ac-4565-8ac6-efa1e4937974" by "_delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:12 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-3e6958be-6eae-40af-800e-d9cf8da3c663 tempest-VolumeDependencyTests-648381524 None] Delete snapshot completed successfully. Nov 01 12:39:12 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-21ec97ad-921a-493b-ad04-02c3678464ac tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-5dc7217c-21ac-4565-8ac6-efa1e4937974" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:12 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-21ec97ad-921a-493b-ad04-02c3678464ac tempest-ProjectMemberTests-538781697 None] Deleting offline snapshot 5dc7217c-21ac-4565-8ac6-efa1e4937974 of volume fa1f84bf-7d0d-4b4b-b9bb-856f0784b137 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:39:12 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-21ec97ad-921a-493b-ad04-02c3678464ac tempest-ProjectMemberTests-538781697 None] snapshot_file for this snap is: volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137.5dc7217c-21ac-4565-8ac6-efa1e4937974 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:39:12 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-3e6958be-6eae-40af-800e-d9cf8da3c663 tempest-VolumeDependencyTests-648381524 None] Lock "cinder-f26d7383-c093-47ee-ab33-579cf03e25da-delete_snapshot" released by "delete_snapshot" :: held 2.266s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:12 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[4dd89cc5-d0ba-40b3-8346-79df194f1b4b]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-21ec97ad-921a-493b-ad04-02c3678464ac tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137.5dc7217c-21ac-4565-8ac6-efa1e4937974 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:12 devstack sudo[106168]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-86df19b4-85a4-4f70-ae3b-916d1d270ac7" returned: 0 in 0.319s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:12 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] <== create_volume: return (878ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:39:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:12 devstack cinder-volume[86574]: DEBUG cinder.volume.volume_utils [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Attempting download of 19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3 ((None, [{'url': 'file:///opt/stack/data/glance/images/19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3', 'metadata': {}}])) to volume 86df19b4-85a4-4f70-ae3b-916d1d270ac7. {{(pid=86574) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1190}} Nov 01 12:39:12 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[3a7c9fb7-8750-4426-9402-8b7911fbb28d]: (4, 'raw') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3_vitpkohw {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:12 devstack sudo[106171]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137.5dc7217c-21ac-4565-8ac6-efa1e4937974 Nov 01 12:39:12 devstack sudo[106171]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:13 devstack sudo[106173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3_vitpkohw Nov 01 12:39:13 devstack sudo[106173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:13 devstack sudo[106171]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-21ec97ad-921a-493b-ad04-02c3678464ac tempest-ProjectMemberTests-538781697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137.5dc7217c-21ac-4565-8ac6-efa1e4937974" returned: 0 in 0.419s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:13 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-21ec97ad-921a-493b-ad04-02c3678464ac tempest-ProjectMemberTests-538781697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:39:13 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[5e421d40-80da-4390-983c-abeb900a4e3c]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-21ec97ad-921a-493b-ad04-02c3678464ac tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:13 devstack sudo[106173]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3_vitpkohw" returned: 0 in 0.345s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3_vitpkohw {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:13 devstack sudo[106180]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137 Nov 01 12:39:13 devstack sudo[106180]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:13 devstack sudo[106181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3_vitpkohw Nov 01 12:39:13 devstack sudo[106181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:13 devstack sudo[106181]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3_vitpkohw" returned: 1 in 0.380s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3_vitpkohw' failed. Not Retrying. {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 12:39:13 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[5d3ddc6e-de07-4d7e-9536-45ef91c9311f]: (4, 'raw') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3_nkrnk7badevstack@QuobyteHD {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:13 devstack sudo[106180]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-21ec97ad-921a-493b-ad04-02c3678464ac tempest-ProjectMemberTests-538781697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137" returned: 0 in 0.428s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-21ec97ad-921a-493b-ad04-02c3678464ac tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137.5dc7217c-21ac-4565-8ac6-efa1e4937974 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:13 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a1d13fad-4d86-4828-9a63-074afb6c7cee tempest-VolumeDependencyTests-648381524 None] Acquiring lock "cinder-22d85a4e-2114-4dd2-b912-a280dfc5c64d-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:13 devstack sudo[106190]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137.5dc7217c-21ac-4565-8ac6-efa1e4937974 Nov 01 12:39:13 devstack sudo[106190]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:13 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a1d13fad-4d86-4828-9a63-074afb6c7cee tempest-VolumeDependencyTests-648381524 None] Lock "cinder-22d85a4e-2114-4dd2-b912-a280dfc5c64d-delete_volume" acquired by "delete_volume" :: waited 0.042s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:13 devstack sudo[106189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3_nkrnk7badevstack@QuobyteHD Nov 01 12:39:13 devstack sudo[106189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:13 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a1d13fad-4d86-4828-9a63-074afb6c7cee tempest-VolumeDependencyTests-648381524 None] Acquiring lock "cinder-quobyte-22d85a4e-2114-4dd2-b912-a280dfc5c64d" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:13 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a1d13fad-4d86-4828-9a63-074afb6c7cee tempest-VolumeDependencyTests-648381524 None] Lock "cinder-quobyte-22d85a4e-2114-4dd2-b912-a280dfc5c64d" acquired by "delete_volume" :: waited 0.017s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:13 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d7eab5f-aba1-4b95-a36e-c00707af37ed]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a1d13fad-4d86-4828-9a63-074afb6c7cee tempest-VolumeDependencyTests-648381524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:14 devstack sudo[106193]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d Nov 01 12:39:14 devstack sudo[106193]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:14 devstack sudo[106189]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:14 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3_nkrnk7badevstack@QuobyteHD" returned: 0 in 0.394s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:14 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3_nkrnk7badevstack@QuobyteHD {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:14 devstack sudo[106190]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:14 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-21ec97ad-921a-493b-ad04-02c3678464ac tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137.5dc7217c-21ac-4565-8ac6-efa1e4937974" returned: 0 in 0.457s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:14 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-21ec97ad-921a-493b-ad04-02c3678464ac tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137.5dc7217c-21ac-4565-8ac6-efa1e4937974 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:14 devstack sudo[106202]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137.5dc7217c-21ac-4565-8ac6-efa1e4937974 Nov 01 12:39:14 devstack sudo[106202]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:14 devstack sudo[106200]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3_nkrnk7badevstack@QuobyteHD Nov 01 12:39:14 devstack sudo[106200]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:14 devstack sudo[106193]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:14 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a1d13fad-4d86-4828-9a63-074afb6c7cee tempest-VolumeDependencyTests-648381524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d" returned: 0 in 0.444s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:14 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a1d13fad-4d86-4828-9a63-074afb6c7cee tempest-VolumeDependencyTests-648381524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:14 devstack sudo[106208]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d Nov 01 12:39:14 devstack sudo[106208]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:14 devstack sudo[106200]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:14 devstack sudo[106202]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:14 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3_nkrnk7badevstack@QuobyteHD" returned: 1 in 0.403s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:14 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] '/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3_nkrnk7badevstack@QuobyteHD' failed. Not Retrying. {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:543}} Nov 01 12:39:14 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] 19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3 was raw, converting to qcow2 {{(pid=86574) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1147}} Nov 01 12:39:14 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3_nkrnk7badevstack@QuobyteHD /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-86df19b4-85a4-4f70-ae3b-916d1d270ac7 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:14 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-21ec97ad-921a-493b-ad04-02c3678464ac tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137.5dc7217c-21ac-4565-8ac6-efa1e4937974" returned: 0 in 0.333s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:14 devstack sudo[106214]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3_nkrnk7badevstack@QuobyteHD /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-86df19b4-85a4-4f70-ae3b-916d1d270ac7 Nov 01 12:39:14 devstack sudo[106214]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:14 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-21ec97ad-921a-493b-ad04-02c3678464ac tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-5dc7217c-21ac-4565-8ac6-efa1e4937974" released by "_delete_snapshot" :: held 1.782s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:14 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-21ec97ad-921a-493b-ad04-02c3678464ac tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137" released by "delete_snapshot" :: held 1.816s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:14 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-21ec97ad-921a-493b-ad04-02c3678464ac tempest-ProjectMemberTests-538781697 None] Created reservations ['323fdf9e-790c-4b4b-bfe2-4791e902c585', 'ecbb3dc1-d90f-46d5-8e61-7e6744f04682', 'fbc95e06-2976-41fd-b1a9-c856145f1da1', 'b29ce47c-c59b-4577-a0aa-2fe94cba443c'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:39:14 devstack sudo[106208]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:14 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a1d13fad-4d86-4828-9a63-074afb6c7cee tempest-VolumeDependencyTests-648381524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-22d85a4e-2114-4dd2-b912-a280dfc5c64d" returned: 0 in 0.335s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:14 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a1d13fad-4d86-4828-9a63-074afb6c7cee tempest-VolumeDependencyTests-648381524 None] Lock "cinder-quobyte-22d85a4e-2114-4dd2-b912-a280dfc5c64d" released by "delete_volume" :: held 0.874s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:14 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-21ec97ad-921a-493b-ad04-02c3678464ac tempest-ProjectMemberTests-538781697 None] Delete snapshot completed successfully. Nov 01 12:39:14 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-21ec97ad-921a-493b-ad04-02c3678464ac tempest-ProjectMemberTests-538781697 None] Lock "cinder-5dc7217c-21ac-4565-8ac6-efa1e4937974-delete_snapshot" released by "delete_snapshot" :: held 2.027s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:14 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-a1d13fad-4d86-4828-9a63-074afb6c7cee tempest-VolumeDependencyTests-648381524 None] Created reservations ['e42f06fd-30fd-4715-956f-a638f820108e', '904671c0-d516-4fa6-b34d-a84839b71453', 'd6028945-2ddc-4249-8657-7510675d4f5f', 'c3114b7e-a18a-441b-aad8-7f19734ad103'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:39:14 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a1d13fad-4d86-4828-9a63-074afb6c7cee tempest-VolumeDependencyTests-648381524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:14 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a1d13fad-4d86-4828-9a63-074afb6c7cee tempest-VolumeDependencyTests-648381524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:14 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a1d13fad-4d86-4828-9a63-074afb6c7cee tempest-VolumeDependencyTests-648381524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:39:14 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a1d13fad-4d86-4828-9a63-074afb6c7cee tempest-VolumeDependencyTests-648381524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:39:14 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a1d13fad-4d86-4828-9a63-074afb6c7cee tempest-VolumeDependencyTests-648381524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:14 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a1d13fad-4d86-4828-9a63-074afb6c7cee tempest-VolumeDependencyTests-648381524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:14 devstack sudo[106221]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:39:14 devstack sudo[106221]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:14 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ae729b79-0d3b-4cc9-a484-7d0d49db4691 tempest-ProjectMemberTests-538781697 None] Acquiring lock "cinder-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:14 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ae729b79-0d3b-4cc9-a484-7d0d49db4691 tempest-ProjectMemberTests-538781697 None] Lock "cinder-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:14 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ae729b79-0d3b-4cc9-a484-7d0d49db4691 tempest-ProjectMemberTests-538781697 None] Acquiring lock "cinder-quobyte-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:15 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ae729b79-0d3b-4cc9-a484-7d0d49db4691 tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137" acquired by "delete_volume" :: waited 0.029s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:15 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a534be4d-ce3d-4188-b80b-7907a2509615 tempest-VolumeDependencyTests-648381524 None] Acquiring lock "cinder-7ca98ccb-8b71-4c12-bff8-04e4f1f3366d-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:15 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d1ca9bb-edc4-41b3-b8ce-8b9a7d5181a1]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ae729b79-0d3b-4cc9-a484-7d0d49db4691 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:15 devstack sudo[106214]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:15 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a534be4d-ce3d-4188-b80b-7907a2509615 tempest-VolumeDependencyTests-648381524 None] Lock "cinder-7ca98ccb-8b71-4c12-bff8-04e4f1f3366d-delete_volume" acquired by "delete_volume" :: waited 0.053s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 -f raw /opt/stack/data/cinder/conversion/image_fetch_19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3_nkrnk7badevstack@QuobyteHD /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-86df19b4-85a4-4f70-ae3b-916d1d270ac7" returned: 0 in 0.698s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:15 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3_nkrnk7badevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-86df19b4-85a4-4f70-ae3b-916d1d270ac7 {{(pid=86574) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 12:39:15 devstack cinder-volume[86574]: INFO cinder.image.image_utils [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Converted 0.00 MB image at 0.00 MB/s Nov 01 12:39:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-86df19b4-85a4-4f70-ae3b-916d1d270ac7 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:15 devstack sudo[106225]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-86df19b4-85a4-4f70-ae3b-916d1d270ac7 1G Nov 01 12:39:15 devstack sudo[106225]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:15 devstack sudo[106221]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a1d13fad-4d86-4828-9a63-074afb6c7cee tempest-VolumeDependencyTests-648381524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.379s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:15 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-a1d13fad-4d86-4828-9a63-074afb6c7cee tempest-VolumeDependencyTests-648381524 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:39:15 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-a1d13fad-4d86-4828-9a63-074afb6c7cee tempest-VolumeDependencyTests-648381524 None] Deleted volume successfully. Nov 01 12:39:15 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a534be4d-ce3d-4188-b80b-7907a2509615 tempest-VolumeDependencyTests-648381524 None] Acquiring lock "cinder-quobyte-7ca98ccb-8b71-4c12-bff8-04e4f1f3366d" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:15 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a1d13fad-4d86-4828-9a63-074afb6c7cee tempest-VolumeDependencyTests-648381524 None] Lock "cinder-22d85a4e-2114-4dd2-b912-a280dfc5c64d-delete_volume" released by "delete_volume" :: held 1.539s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:15 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a534be4d-ce3d-4188-b80b-7907a2509615 tempest-VolumeDependencyTests-648381524 None] Lock "cinder-quobyte-7ca98ccb-8b71-4c12-bff8-04e4f1f3366d" acquired by "delete_volume" :: waited 0.024s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:15 devstack sudo[106223]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137 Nov 01 12:39:15 devstack sudo[106223]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:15 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[55ce06bc-14ef-4d34-a812-8721743555d2]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a534be4d-ce3d-4188-b80b-7907a2509615 tempest-VolumeDependencyTests-648381524 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7ca98ccb-8b71-4c12-bff8-04e4f1f3366d {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:15 devstack sudo[106228]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7ca98ccb-8b71-4c12-bff8-04e4f1f3366d Nov 01 12:39:15 devstack sudo[106228]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:15 devstack sudo[106225]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img resize /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-86df19b4-85a4-4f70-ae3b-916d1d270ac7 1G" returned: 0 in 0.422s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:15 devstack cinder-volume[86574]: DEBUG cinder.volume.volume_utils [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Downloaded image 19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3 ((None, [{'url': 'file:///opt/stack/data/glance/images/19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3', 'metadata': {}}])) to volume 86df19b4-85a4-4f70-ae3b-916d1d270ac7 successfully. {{(pid=86574) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1235}} Nov 01 12:39:15 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Temporary image 19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3 for user 17ae6ad64b4e41f4b28304d1827ee3ff is deleted. {{(pid=86574) fetch /opt/stack/cinder/cinder/image/image_utils.py:1462}} Nov 01 12:39:15 devstack cinder-volume[86574]: DEBUG cinder.volume.volume_utils [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Marking volume 86df19b4-85a4-4f70-ae3b-916d1d270ac7 as bootable. {{(pid=86574) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1139}} Nov 01 12:39:15 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Copying metadata from image 19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3 to 86df19b4-85a4-4f70-ae3b-916d1d270ac7. {{(pid=86574) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}} Nov 01 12:39:15 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Creating volume glance metadata for volume 86df19b4-85a4-4f70-ae3b-916d1d270ac7 backed by image 19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3 with: {'image_id': '19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': '4ebf3eb865c4ebe6d481c688f973e726', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=86574) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}} Nov 01 12:39:15 devstack sudo[106223]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ae729b79-0d3b-4cc9-a484-7d0d49db4691 tempest-ProjectMemberTests-538781697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137" returned: 0 in 0.547s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ae729b79-0d3b-4cc9-a484-7d0d49db4691 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:15 devstack sudo[106237]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137 Nov 01 12:39:15 devstack sudo[106237]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:15 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1df2359d-841a-48d0-9f08-cf3c4526ad0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-86df19b4-85a4-4f70-ae3b-916d1d270ac7', 'volume_size': 1, 'image_id': '19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': '4ebf3eb865c4ebe6d481c688f973e726', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'a8a56df23c8741fcb2ff434b5c4bc6bc', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '693b3e6d4329692378477c5b1b61796bea45fc9f6d25b64b7a1ad71210e58f0653b00d18be1a74f9f88f22d3a5e7414922f6c3ab799298ced8be1d3dd166f16e', 'id': '19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3', 'created_at': datetime.datetime(2026, 11, 1, 11, 39, 3, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2026, 11, 1, 11, 39, 6, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/19df3ba5-6cb7-4786-a5bb-f0f08a0ef7f3/file', 'properties': {}}, 'image_service': }' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:15 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d92fa61-51a3-412a-97ae-b2c1bff8c844) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:15 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Volume volume-86df19b4-85a4-4f70-ae3b-916d1d270ac7 (86df19b4-85a4-4f70-ae3b-916d1d270ac7): created successfully Nov 01 12:39:15 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1d92fa61-51a3-412a-97ae-b2c1bff8c844) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:15 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Flow 'volume_create_manager' (dd241c93-0176-4c0f-a15d-fc09736003fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:39:15 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-338958a6-b172-4f14-bdd9-780f216aaf00 tempest-VolumeImageDependencyTests-730346209 None] Created volume successfully. Nov 01 12:39:15 devstack sudo[106228]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a534be4d-ce3d-4188-b80b-7907a2509615 tempest-VolumeDependencyTests-648381524 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7ca98ccb-8b71-4c12-bff8-04e4f1f3366d" returned: 0 in 0.470s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a534be4d-ce3d-4188-b80b-7907a2509615 tempest-VolumeDependencyTests-648381524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7ca98ccb-8b71-4c12-bff8-04e4f1f3366d {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:15 devstack sudo[106242]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7ca98ccb-8b71-4c12-bff8-04e4f1f3366d Nov 01 12:39:15 devstack sudo[106242]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:15 devstack sudo[106237]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ae729b79-0d3b-4cc9-a484-7d0d49db4691 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137" returned: 0 in 0.279s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:15 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ae729b79-0d3b-4cc9-a484-7d0d49db4691 tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137" released by "delete_volume" :: held 0.957s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:16 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-ae729b79-0d3b-4cc9-a484-7d0d49db4691 tempest-ProjectMemberTests-538781697 None] Created reservations ['030238e1-5151-4a98-bc5c-2679d8296291', '971c7d74-6698-41bb-be46-5774ae3f4428', '4b029441-95ae-4c4f-b59d-4abcbbf990df', 'b5b188f5-71cb-49c1-b392-04807c6f275e'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:39:16 devstack sudo[106242]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:16 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a534be4d-ce3d-4188-b80b-7907a2509615 tempest-VolumeDependencyTests-648381524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-7ca98ccb-8b71-4c12-bff8-04e4f1f3366d" returned: 0 in 0.272s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:16 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a534be4d-ce3d-4188-b80b-7907a2509615 tempest-VolumeDependencyTests-648381524 None] Lock "cinder-quobyte-7ca98ccb-8b71-4c12-bff8-04e4f1f3366d" released by "delete_volume" :: held 0.800s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:16 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ae729b79-0d3b-4cc9-a484-7d0d49db4691 tempest-ProjectMemberTests-538781697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:16 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ae729b79-0d3b-4cc9-a484-7d0d49db4691 tempest-ProjectMemberTests-538781697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:16 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ae729b79-0d3b-4cc9-a484-7d0d49db4691 tempest-ProjectMemberTests-538781697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:39:16 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ae729b79-0d3b-4cc9-a484-7d0d49db4691 tempest-ProjectMemberTests-538781697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:39:16 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ae729b79-0d3b-4cc9-a484-7d0d49db4691 tempest-ProjectMemberTests-538781697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:16 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ae729b79-0d3b-4cc9-a484-7d0d49db4691 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:16 devstack sudo[106246]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:39:16 devstack sudo[106246]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:16 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-a534be4d-ce3d-4188-b80b-7907a2509615 tempest-VolumeDependencyTests-648381524 None] Created reservations ['27636f90-594b-41e1-b67b-6005c60a102a', '7bf4517e-259e-4aa5-b548-cdfc7b065cb9', '2873ec51-19bc-47e8-8c2a-d95c9f50e14e', '606adc69-e436-4954-b76e-caa47c60d48f'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:39:16 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a534be4d-ce3d-4188-b80b-7907a2509615 tempest-VolumeDependencyTests-648381524 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:16 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a534be4d-ce3d-4188-b80b-7907a2509615 tempest-VolumeDependencyTests-648381524 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:16 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a534be4d-ce3d-4188-b80b-7907a2509615 tempest-VolumeDependencyTests-648381524 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:39:16 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a534be4d-ce3d-4188-b80b-7907a2509615 tempest-VolumeDependencyTests-648381524 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:39:16 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a534be4d-ce3d-4188-b80b-7907a2509615 tempest-VolumeDependencyTests-648381524 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:16 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a534be4d-ce3d-4188-b80b-7907a2509615 tempest-VolumeDependencyTests-648381524 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:16 devstack sudo[106248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:39:16 devstack sudo[106248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:16 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-415e04e2-6c70-4a48-a8a2-6564a14e0399 tempest-VolumeImageDependencyTests-730346209 None] Acquiring lock "cinder-86df19b4-85a4-4f70-ae3b-916d1d270ac7-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:16 devstack sudo[106246]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:16 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ae729b79-0d3b-4cc9-a484-7d0d49db4691 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.413s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:16 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-ae729b79-0d3b-4cc9-a484-7d0d49db4691 tempest-ProjectMemberTests-538781697 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:39:16 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-415e04e2-6c70-4a48-a8a2-6564a14e0399 tempest-VolumeImageDependencyTests-730346209 None] Lock "cinder-86df19b4-85a4-4f70-ae3b-916d1d270ac7-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:16 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-ae729b79-0d3b-4cc9-a484-7d0d49db4691 tempest-ProjectMemberTests-538781697 None] Deleted volume successfully. Nov 01 12:39:16 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ae729b79-0d3b-4cc9-a484-7d0d49db4691 tempest-ProjectMemberTests-538781697 None] Lock "cinder-fa1f84bf-7d0d-4b4b-b9bb-856f0784b137-delete_volume" released by "delete_volume" :: held 1.744s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:16 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-415e04e2-6c70-4a48-a8a2-6564a14e0399 tempest-VolumeImageDependencyTests-730346209 None] Acquiring lock "cinder-quobyte-86df19b4-85a4-4f70-ae3b-916d1d270ac7" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:16 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-415e04e2-6c70-4a48-a8a2-6564a14e0399 tempest-VolumeImageDependencyTests-730346209 None] Lock "cinder-quobyte-86df19b4-85a4-4f70-ae3b-916d1d270ac7" acquired by "delete_volume" :: waited 0.038s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:16 devstack sudo[106248]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:16 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a534be4d-ce3d-4188-b80b-7907a2509615 tempest-VolumeDependencyTests-648381524 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.510s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:16 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-a534be4d-ce3d-4188-b80b-7907a2509615 tempest-VolumeDependencyTests-648381524 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:39:16 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[2039dd68-0033-4c16-91c5-8dbe42e991b3]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:16 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-415e04e2-6c70-4a48-a8a2-6564a14e0399 tempest-VolumeImageDependencyTests-730346209 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-86df19b4-85a4-4f70-ae3b-916d1d270ac7 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:16 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-a534be4d-ce3d-4188-b80b-7907a2509615 tempest-VolumeDependencyTests-648381524 None] Deleted volume successfully. Nov 01 12:39:16 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-a534be4d-ce3d-4188-b80b-7907a2509615 tempest-VolumeDependencyTests-648381524 None] Lock "cinder-7ca98ccb-8b71-4c12-bff8-04e4f1f3366d-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:16 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-e5cd16ea-c490-48b1-9090-37861ac02683 tempest-ProjectMemberTests-538781697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:39:16 devstack sudo[106252]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-86df19b4-85a4-4f70-ae3b-916d1d270ac7 Nov 01 12:39:16 devstack sudo[106252]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:16 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e5cd16ea-c490-48b1-9090-37861ac02683 tempest-ProjectMemberTests-538781697 None] Flow 'volume_create_manager' (518bdca1-4a17-46d6-8b22-3226ab43ed7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:39:16 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e5cd16ea-c490-48b1-9090-37861ac02683 tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dea96d38-006b-4c55-85e2-3976feee3737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:16 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e5cd16ea-c490-48b1-9090-37861ac02683 tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dea96d38-006b-4c55-85e2-3976feee3737) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1551974097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c4211ac-d336-4a42-888b-06e47efa6de6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe0ffaf6cf1d4294aa9f030164447d48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:39:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:39:17Z,use_quota=True,user_id='f617cd7e548d4a989b479812bba708f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:17 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e5cd16ea-c490-48b1-9090-37861ac02683 tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9998d41-c1db-44de-9262-ae9612889b52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:17 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e5cd16ea-c490-48b1-9090-37861ac02683 tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9998d41-c1db-44de-9262-ae9612889b52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:17 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e5cd16ea-c490-48b1-9090-37861ac02683 tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02da78b0-910f-43c4-9f1f-40d92d84efd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:17 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e5cd16ea-c490-48b1-9090-37861ac02683 tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (02da78b0-910f-43c4-9f1f-40d92d84efd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8c4211ac-d336-4a42-888b-06e47efa6de6', 'volume_name': 'volume-8c4211ac-d336-4a42-888b-06e47efa6de6', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:17 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e5cd16ea-c490-48b1-9090-37861ac02683 tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5231f741-ba43-4782-beab-2c3823ea8f2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:17 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e5cd16ea-c490-48b1-9090-37861ac02683 tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5231f741-ba43-4782-beab-2c3823ea8f2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:17 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e5cd16ea-c490-48b1-9090-37861ac02683 tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9322df1e-19ef-46b4-bec2-6e652fe2722a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:17 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-e5cd16ea-c490-48b1-9090-37861ac02683 tempest-ProjectMemberTests-538781697 None] Volume 8c4211ac-d336-4a42-888b-06e47efa6de6: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8c4211ac-d336-4a42-888b-06e47efa6de6', 'volume_size': 1} Nov 01 12:39:17 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e5cd16ea-c490-48b1-9090-37861ac02683 tempest-ProjectMemberTests-538781697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:17 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e5cd16ea-c490-48b1-9090-37861ac02683 tempest-ProjectMemberTests-538781697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:17 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e5cd16ea-c490-48b1-9090-37861ac02683 tempest-ProjectMemberTests-538781697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:39:16Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1551974097',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8c4211ac-d336-4a42-888b-06e47efa6de6,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe0ffaf6cf1d4294aa9f030164447d48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:39:17Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:39:17Z,use_quota=True,user_id='f617cd7e548d4a989b479812bba708f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:39:17 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-e5cd16ea-c490-48b1-9090-37861ac02683 tempest-ProjectMemberTests-538781697 None] Creating volume 8c4211ac-d336-4a42-888b-06e47efa6de6 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:39:17 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e5cd16ea-c490-48b1-9090-37861ac02683 tempest-ProjectMemberTests-538781697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:17 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e5cd16ea-c490-48b1-9090-37861ac02683 tempest-ProjectMemberTests-538781697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:17 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e5cd16ea-c490-48b1-9090-37861ac02683 tempest-ProjectMemberTests-538781697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:39:17 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e5cd16ea-c490-48b1-9090-37861ac02683 tempest-ProjectMemberTests-538781697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:39:17 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e5cd16ea-c490-48b1-9090-37861ac02683 tempest-ProjectMemberTests-538781697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:17 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e5cd16ea-c490-48b1-9090-37861ac02683 tempest-ProjectMemberTests-538781697 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:39:17 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-e5cd16ea-c490-48b1-9090-37861ac02683 tempest-ProjectMemberTests-538781697 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:39:17 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e5cd16ea-c490-48b1-9090-37861ac02683 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c4211ac-d336-4a42-888b-06e47efa6de6 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:17 devstack sudo[106254]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c4211ac-d336-4a42-888b-06e47efa6de6 1073741824 Nov 01 12:39:17 devstack sudo[106254]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:17 devstack sudo[106252]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:17 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-415e04e2-6c70-4a48-a8a2-6564a14e0399 tempest-VolumeImageDependencyTests-730346209 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-86df19b4-85a4-4f70-ae3b-916d1d270ac7" returned: 0 in 0.464s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:17 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-415e04e2-6c70-4a48-a8a2-6564a14e0399 tempest-VolumeImageDependencyTests-730346209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-86df19b4-85a4-4f70-ae3b-916d1d270ac7 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:17 devstack sudo[106260]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-86df19b4-85a4-4f70-ae3b-916d1d270ac7 Nov 01 12:39:17 devstack sudo[106260]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:17 devstack sudo[106260]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:17 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-415e04e2-6c70-4a48-a8a2-6564a14e0399 tempest-VolumeImageDependencyTests-730346209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-86df19b4-85a4-4f70-ae3b-916d1d270ac7" returned: 0 in 0.331s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:17 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-415e04e2-6c70-4a48-a8a2-6564a14e0399 tempest-VolumeImageDependencyTests-730346209 None] Lock "cinder-quobyte-86df19b4-85a4-4f70-ae3b-916d1d270ac7" released by "delete_volume" :: held 0.866s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:17 devstack sudo[106254]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:17 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e5cd16ea-c490-48b1-9090-37861ac02683 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c4211ac-d336-4a42-888b-06e47efa6de6 1073741824" returned: 0 in 0.564s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:17 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e5cd16ea-c490-48b1-9090-37861ac02683 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c4211ac-d336-4a42-888b-06e47efa6de6 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:17 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-415e04e2-6c70-4a48-a8a2-6564a14e0399 tempest-VolumeImageDependencyTests-730346209 None] Created reservations ['29b3a637-5781-41b9-8527-d881eda32de1', '01a3e72b-e47a-49c4-96b3-c667a5c1facf', '099c3ff7-1246-4acc-a8bc-dcbb4e108db6', '1f1ea554-7a45-4fdf-a46a-68a622b09c75'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:39:17 devstack sudo[106267]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c4211ac-d336-4a42-888b-06e47efa6de6 Nov 01 12:39:17 devstack sudo[106267]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:17 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-415e04e2-6c70-4a48-a8a2-6564a14e0399 tempest-VolumeImageDependencyTests-730346209 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:17 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-415e04e2-6c70-4a48-a8a2-6564a14e0399 tempest-VolumeImageDependencyTests-730346209 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:17 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-415e04e2-6c70-4a48-a8a2-6564a14e0399 tempest-VolumeImageDependencyTests-730346209 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:39:17 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-415e04e2-6c70-4a48-a8a2-6564a14e0399 tempest-VolumeImageDependencyTests-730346209 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:39:17 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-415e04e2-6c70-4a48-a8a2-6564a14e0399 tempest-VolumeImageDependencyTests-730346209 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:17 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-415e04e2-6c70-4a48-a8a2-6564a14e0399 tempest-VolumeImageDependencyTests-730346209 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:17 devstack sudo[106269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:39:17 devstack sudo[106269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:18 devstack sudo[106267]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:18 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e5cd16ea-c490-48b1-9090-37861ac02683 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c4211ac-d336-4a42-888b-06e47efa6de6" returned: 0 in 0.377s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:18 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e5cd16ea-c490-48b1-9090-37861ac02683 tempest-ProjectMemberTests-538781697 None] <== create_volume: return (1008ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:39:18 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e5cd16ea-c490-48b1-9090-37861ac02683 tempest-ProjectMemberTests-538781697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.013s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:18 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e5cd16ea-c490-48b1-9090-37861ac02683 tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9322df1e-19ef-46b4-bec2-6e652fe2722a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8c4211ac-d336-4a42-888b-06e47efa6de6', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:18 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e5cd16ea-c490-48b1-9090-37861ac02683 tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8011d259-832b-4817-a933-a2f4bc4404e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:18 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-e5cd16ea-c490-48b1-9090-37861ac02683 tempest-ProjectMemberTests-538781697 None] Volume volume-8c4211ac-d336-4a42-888b-06e47efa6de6 (8c4211ac-d336-4a42-888b-06e47efa6de6): created successfully Nov 01 12:39:18 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e5cd16ea-c490-48b1-9090-37861ac02683 tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8011d259-832b-4817-a933-a2f4bc4404e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:18 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e5cd16ea-c490-48b1-9090-37861ac02683 tempest-ProjectMemberTests-538781697 None] Flow 'volume_create_manager' (518bdca1-4a17-46d6-8b22-3226ab43ed7a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:39:18 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-e5cd16ea-c490-48b1-9090-37861ac02683 tempest-ProjectMemberTests-538781697 None] Created volume successfully. Nov 01 12:39:18 devstack sudo[106269]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:18 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-415e04e2-6c70-4a48-a8a2-6564a14e0399 tempest-VolumeImageDependencyTests-730346209 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.431s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:18 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-415e04e2-6c70-4a48-a8a2-6564a14e0399 tempest-VolumeImageDependencyTests-730346209 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:39:18 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-415e04e2-6c70-4a48-a8a2-6564a14e0399 tempest-VolumeImageDependencyTests-730346209 None] Deleted volume successfully. Nov 01 12:39:18 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-415e04e2-6c70-4a48-a8a2-6564a14e0399 tempest-VolumeImageDependencyTests-730346209 None] Lock "cinder-86df19b4-85a4-4f70-ae3b-916d1d270ac7-delete_volume" released by "delete_volume" :: held 1.771s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:19 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-99087847-746f-4aba-9bf9-d3bc108471d2 tempest-ProjectMemberTests-538781697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:19 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-99087847-746f-4aba-9bf9-d3bc108471d2 tempest-ProjectMemberTests-538781697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:19 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-99087847-746f-4aba-9bf9-d3bc108471d2 tempest-ProjectMemberTests-538781697 None] Creating offline snapshot 5dacd674-0048-434c-978f-162427255d01 of volume 8c4211ac-d336-4a42-888b-06e47efa6de6 {{(pid=86574) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:39:19 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[25e78162-4de2-4b9d-b099-d9bcdcf5251e]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:19 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-99087847-746f-4aba-9bf9-d3bc108471d2 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c4211ac-d336-4a42-888b-06e47efa6de6 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:19 devstack sudo[106274]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c4211ac-d336-4a42-888b-06e47efa6de6 Nov 01 12:39:19 devstack sudo[106274]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:19 devstack sudo[106274]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:19 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-99087847-746f-4aba-9bf9-d3bc108471d2 tempest-ProjectMemberTests-538781697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c4211ac-d336-4a42-888b-06e47efa6de6" returned: 0 in 0.532s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:19 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-99087847-746f-4aba-9bf9-d3bc108471d2 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c4211ac-d336-4a42-888b-06e47efa6de6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c4211ac-d336-4a42-888b-06e47efa6de6.5dacd674-0048-434c-978f-162427255d01 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:19 devstack sudo[106279]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c4211ac-d336-4a42-888b-06e47efa6de6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c4211ac-d336-4a42-888b-06e47efa6de6.5dacd674-0048-434c-978f-162427255d01 1G Nov 01 12:39:19 devstack sudo[106279]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:20 devstack sudo[106279]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-99087847-746f-4aba-9bf9-d3bc108471d2 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c4211ac-d336-4a42-888b-06e47efa6de6,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c4211ac-d336-4a42-888b-06e47efa6de6.5dacd674-0048-434c-978f-162427255d01 1G" returned: 0 in 0.507s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-99087847-746f-4aba-9bf9-d3bc108471d2 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c4211ac-d336-4a42-888b-06e47efa6de6 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c4211ac-d336-4a42-888b-06e47efa6de6.5dacd674-0048-434c-978f-162427255d01 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:20 devstack sudo[106286]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c4211ac-d336-4a42-888b-06e47efa6de6 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c4211ac-d336-4a42-888b-06e47efa6de6.5dacd674-0048-434c-978f-162427255d01 Nov 01 12:39:20 devstack sudo[106286]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:20 devstack sudo[106286]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-99087847-746f-4aba-9bf9-d3bc108471d2 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-8c4211ac-d336-4a42-888b-06e47efa6de6 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c4211ac-d336-4a42-888b-06e47efa6de6.5dacd674-0048-434c-978f-162427255d01" returned: 0 in 0.437s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:20 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-99087847-746f-4aba-9bf9-d3bc108471d2 tempest-ProjectMemberTests-538781697 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c4211ac-d336-4a42-888b-06e47efa6de6.5dacd674-0048-434c-978f-162427255d01 is being set with open permissions: ugo+rw Nov 01 12:39:20 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-99087847-746f-4aba-9bf9-d3bc108471d2 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c4211ac-d336-4a42-888b-06e47efa6de6.5dacd674-0048-434c-978f-162427255d01 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:20 devstack sudo[106291]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c4211ac-d336-4a42-888b-06e47efa6de6.5dacd674-0048-434c-978f-162427255d01 Nov 01 12:39:20 devstack sudo[106291]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:21 devstack sudo[106291]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-99087847-746f-4aba-9bf9-d3bc108471d2 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c4211ac-d336-4a42-888b-06e47efa6de6.5dacd674-0048-434c-978f-162427255d01" returned: 0 in 0.290s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-99087847-746f-4aba-9bf9-d3bc108471d2 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c4211ac-d336-4a42-888b-06e47efa6de6.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:21 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-e1e54fdd-d082-48e1-a7e1-6a76a82aca55 tempest-CinderUnicodeTest-1450523735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:39:21 devstack sudo[106294]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c4211ac-d336-4a42-888b-06e47efa6de6.info Nov 01 12:39:21 devstack sudo[106294]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:21 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e1e54fdd-d082-48e1-a7e1-6a76a82aca55 tempest-CinderUnicodeTest-1450523735 None] Flow 'volume_create_manager' (9c65f1e6-aaaf-4bf7-8fb3-e16059eca155) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:39:21 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e1e54fdd-d082-48e1-a7e1-6a76a82aca55 tempest-CinderUnicodeTest-1450523735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f237c8bf-17e2-4664-ba8a-fa5c84d3d9e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:21 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e1e54fdd-d082-48e1-a7e1-6a76a82aca55 tempest-CinderUnicodeTest-1450523735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f237c8bf-17e2-4664-ba8a-fa5c84d3d9e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=992b90f4-4af0-497c-b5e8-400a3b27af2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c12c98fd1ab4432bbdccbeb2ccee5e47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:39:21Z,use_quota=True,user_id='6ae0198bb7a4497cb2f073d2c099bcf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:21 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e1e54fdd-d082-48e1-a7e1-6a76a82aca55 tempest-CinderUnicodeTest-1450523735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b23eb7dc-9cbe-441b-8a3e-838f9b7efa46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:21 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e1e54fdd-d082-48e1-a7e1-6a76a82aca55 tempest-CinderUnicodeTest-1450523735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b23eb7dc-9cbe-441b-8a3e-838f9b7efa46) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:21 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e1e54fdd-d082-48e1-a7e1-6a76a82aca55 tempest-CinderUnicodeTest-1450523735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccb7c4d4-0140-4a76-a272-8cc33d5e574b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:21 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e1e54fdd-d082-48e1-a7e1-6a76a82aca55 tempest-CinderUnicodeTest-1450523735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ccb7c4d4-0140-4a76-a272-8cc33d5e574b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '992b90f4-4af0-497c-b5e8-400a3b27af2a', 'volume_name': 'volume-992b90f4-4af0-497c-b5e8-400a3b27af2a', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:21 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e1e54fdd-d082-48e1-a7e1-6a76a82aca55 tempest-CinderUnicodeTest-1450523735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b3ae261-ddf2-49f8-b853-8a13767487ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:21 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e1e54fdd-d082-48e1-a7e1-6a76a82aca55 tempest-CinderUnicodeTest-1450523735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0b3ae261-ddf2-49f8-b853-8a13767487ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:21 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e1e54fdd-d082-48e1-a7e1-6a76a82aca55 tempest-CinderUnicodeTest-1450523735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77e86bf7-3dcb-434a-9d7e-1aae1787807e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:21 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-e1e54fdd-d082-48e1-a7e1-6a76a82aca55 tempest-CinderUnicodeTest-1450523735 None] Volume 992b90f4-4af0-497c-b5e8-400a3b27af2a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-992b90f4-4af0-497c-b5e8-400a3b27af2a', 'volume_size': 1} Nov 01 12:39:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e1e54fdd-d082-48e1-a7e1-6a76a82aca55 tempest-CinderUnicodeTest-1450523735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:21 devstack sudo[106294]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-99087847-746f-4aba-9bf9-d3bc108471d2 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c4211ac-d336-4a42-888b-06e47efa6de6.info" returned: 0 in 0.283s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:21 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-99087847-746f-4aba-9bf9-d3bc108471d2 tempest-ProjectMemberTests-538781697 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c4211ac-d336-4a42-888b-06e47efa6de6.info is being set with open permissions: ugo+rw Nov 01 12:39:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-99087847-746f-4aba-9bf9-d3bc108471d2 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c4211ac-d336-4a42-888b-06e47efa6de6.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:21 devstack sudo[106297]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c4211ac-d336-4a42-888b-06e47efa6de6.info Nov 01 12:39:21 devstack sudo[106297]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:21 devstack sudo[106297]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-99087847-746f-4aba-9bf9-d3bc108471d2 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c4211ac-d336-4a42-888b-06e47efa6de6.info" returned: 0 in 0.261s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-99087847-746f-4aba-9bf9-d3bc108471d2 tempest-ProjectMemberTests-538781697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.427s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e1e54fdd-d082-48e1-a7e1-6a76a82aca55 tempest-CinderUnicodeTest-1450523735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.462s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:21 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e1e54fdd-d082-48e1-a7e1-6a76a82aca55 tempest-CinderUnicodeTest-1450523735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:39:20Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=992b90f4-4af0-497c-b5e8-400a3b27af2a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c12c98fd1ab4432bbdccbeb2ccee5e47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:39:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:39:21Z,use_quota=True,user_id='6ae0198bb7a4497cb2f073d2c099bcf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:39:21 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-e1e54fdd-d082-48e1-a7e1-6a76a82aca55 tempest-CinderUnicodeTest-1450523735 None] Creating volume 992b90f4-4af0-497c-b5e8-400a3b27af2a {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:39:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e1e54fdd-d082-48e1-a7e1-6a76a82aca55 tempest-CinderUnicodeTest-1450523735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e1e54fdd-d082-48e1-a7e1-6a76a82aca55 tempest-CinderUnicodeTest-1450523735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:21 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e1e54fdd-d082-48e1-a7e1-6a76a82aca55 tempest-CinderUnicodeTest-1450523735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:39:21 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e1e54fdd-d082-48e1-a7e1-6a76a82aca55 tempest-CinderUnicodeTest-1450523735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:39:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e1e54fdd-d082-48e1-a7e1-6a76a82aca55 tempest-CinderUnicodeTest-1450523735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:21 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e1e54fdd-d082-48e1-a7e1-6a76a82aca55 tempest-CinderUnicodeTest-1450523735 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:39:21 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-e1e54fdd-d082-48e1-a7e1-6a76a82aca55 tempest-CinderUnicodeTest-1450523735 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:39:21 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e1e54fdd-d082-48e1-a7e1-6a76a82aca55 tempest-CinderUnicodeTest-1450523735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-992b90f4-4af0-497c-b5e8-400a3b27af2a 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:21 devstack sudo[106300]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-992b90f4-4af0-497c-b5e8-400a3b27af2a 1073741824 Nov 01 12:39:21 devstack sudo[106300]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:21 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-99087847-746f-4aba-9bf9-d3bc108471d2 tempest-ProjectMemberTests-538781697 None] Create snapshot completed successfully Nov 01 12:39:22 devstack sudo[106300]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e1e54fdd-d082-48e1-a7e1-6a76a82aca55 tempest-CinderUnicodeTest-1450523735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-992b90f4-4af0-497c-b5e8-400a3b27af2a 1073741824" returned: 0 in 0.505s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e1e54fdd-d082-48e1-a7e1-6a76a82aca55 tempest-CinderUnicodeTest-1450523735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-992b90f4-4af0-497c-b5e8-400a3b27af2a {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:22 devstack sudo[106307]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-992b90f4-4af0-497c-b5e8-400a3b27af2a Nov 01 12:39:22 devstack sudo[106307]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:22 devstack sudo[106307]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e1e54fdd-d082-48e1-a7e1-6a76a82aca55 tempest-CinderUnicodeTest-1450523735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-992b90f4-4af0-497c-b5e8-400a3b27af2a" returned: 0 in 0.329s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:22 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e1e54fdd-d082-48e1-a7e1-6a76a82aca55 tempest-CinderUnicodeTest-1450523735 None] <== create_volume: return (894ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:39:22 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e1e54fdd-d082-48e1-a7e1-6a76a82aca55 tempest-CinderUnicodeTest-1450523735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.898s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:22 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e1e54fdd-d082-48e1-a7e1-6a76a82aca55 tempest-CinderUnicodeTest-1450523735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (77e86bf7-3dcb-434a-9d7e-1aae1787807e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-992b90f4-4af0-497c-b5e8-400a3b27af2a', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:22 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e1e54fdd-d082-48e1-a7e1-6a76a82aca55 tempest-CinderUnicodeTest-1450523735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (634f00fa-7e28-49ed-aed4-1709784e7ee0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:22 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-e1e54fdd-d082-48e1-a7e1-6a76a82aca55 tempest-CinderUnicodeTest-1450523735 None] Volume volume-992b90f4-4af0-497c-b5e8-400a3b27af2a (992b90f4-4af0-497c-b5e8-400a3b27af2a): created successfully Nov 01 12:39:22 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e1e54fdd-d082-48e1-a7e1-6a76a82aca55 tempest-CinderUnicodeTest-1450523735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (634f00fa-7e28-49ed-aed4-1709784e7ee0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:22 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e1e54fdd-d082-48e1-a7e1-6a76a82aca55 tempest-CinderUnicodeTest-1450523735 None] Flow 'volume_create_manager' (9c65f1e6-aaaf-4bf7-8fb3-e16059eca155) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:39:22 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-e1e54fdd-d082-48e1-a7e1-6a76a82aca55 tempest-CinderUnicodeTest-1450523735 None] Created volume successfully. Nov 01 12:39:22 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-2d205c35-fccd-4116-a64f-3132da21d8ee tempest-ProjectReaderTests-532564148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:39:22 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2d205c35-fccd-4116-a64f-3132da21d8ee tempest-ProjectReaderTests-532564148 None] Flow 'volume_create_manager' (5ae21eb7-0233-47be-a786-3769d46e2825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:39:22 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2d205c35-fccd-4116-a64f-3132da21d8ee tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00d0676b-c19a-4527-a1f6-f2fc8bc2aa54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:22 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b8e6ab6a-c42b-404d-8f84-14ff8cf6748b tempest-ProjectMemberTests-538781697 None] Acquiring lock "cinder-5dacd674-0048-434c-978f-162427255d01-delete_snapshot" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:22 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2d205c35-fccd-4116-a64f-3132da21d8ee tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00d0676b-c19a-4527-a1f6-f2fc8bc2aa54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-269622375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc444066-6d85-4bf1-b93f-4525b86f5903,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='129b361527b34b0ab7e69215b88d2dad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:39:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:39:23Z,use_quota=True,user_id='2e13b273b0034c9683a67046323971d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:22 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2d205c35-fccd-4116-a64f-3132da21d8ee tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9247e2d5-f893-4820-aa51-48f3f1af7baa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:22 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2d205c35-fccd-4116-a64f-3132da21d8ee tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9247e2d5-f893-4820-aa51-48f3f1af7baa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:22 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2d205c35-fccd-4116-a64f-3132da21d8ee tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca6683c5-1d57-4976-b542-079cd6143817) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:22 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2d205c35-fccd-4116-a64f-3132da21d8ee tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ca6683c5-1d57-4976-b542-079cd6143817) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc444066-6d85-4bf1-b93f-4525b86f5903', 'volume_name': 'volume-fc444066-6d85-4bf1-b93f-4525b86f5903', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:22 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2d205c35-fccd-4116-a64f-3132da21d8ee tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (427bc8f3-171a-4f99-b898-95c0781d47f7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:22 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2d205c35-fccd-4116-a64f-3132da21d8ee tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (427bc8f3-171a-4f99-b898-95c0781d47f7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2d205c35-fccd-4116-a64f-3132da21d8ee tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d2c2dce-98fb-48e1-b938-c5a3dcb85160) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:23 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-2d205c35-fccd-4116-a64f-3132da21d8ee tempest-ProjectReaderTests-532564148 None] Volume fc444066-6d85-4bf1-b93f-4525b86f5903: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc444066-6d85-4bf1-b93f-4525b86f5903', 'volume_size': 1} Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-2d205c35-fccd-4116-a64f-3132da21d8ee tempest-ProjectReaderTests-532564148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-2d205c35-fccd-4116-a64f-3132da21d8ee tempest-ProjectReaderTests-532564148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-2d205c35-fccd-4116-a64f-3132da21d8ee tempest-ProjectReaderTests-532564148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:39:22Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-269622375',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc444066-6d85-4bf1-b93f-4525b86f5903,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='129b361527b34b0ab7e69215b88d2dad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:39:23Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:39:23Z,use_quota=True,user_id='2e13b273b0034c9683a67046323971d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-2d205c35-fccd-4116-a64f-3132da21d8ee tempest-ProjectReaderTests-532564148 None] Creating volume fc444066-6d85-4bf1-b93f-4525b86f5903 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-2d205c35-fccd-4116-a64f-3132da21d8ee tempest-ProjectReaderTests-532564148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-2d205c35-fccd-4116-a64f-3132da21d8ee tempest-ProjectReaderTests-532564148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-2d205c35-fccd-4116-a64f-3132da21d8ee tempest-ProjectReaderTests-532564148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-2d205c35-fccd-4116-a64f-3132da21d8ee tempest-ProjectReaderTests-532564148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-2d205c35-fccd-4116-a64f-3132da21d8ee tempest-ProjectReaderTests-532564148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-2d205c35-fccd-4116-a64f-3132da21d8ee tempest-ProjectReaderTests-532564148 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:39:23 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-2d205c35-fccd-4116-a64f-3132da21d8ee tempest-ProjectReaderTests-532564148 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2d205c35-fccd-4116-a64f-3132da21d8ee tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fc444066-6d85-4bf1-b93f-4525b86f5903 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b8e6ab6a-c42b-404d-8f84-14ff8cf6748b tempest-ProjectMemberTests-538781697 None] Lock "cinder-5dacd674-0048-434c-978f-162427255d01-delete_snapshot" acquired by "delete_snapshot" :: waited 0.113s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b8e6ab6a-c42b-404d-8f84-14ff8cf6748b tempest-ProjectMemberTests-538781697 None] Acquiring lock "cinder-quobyte-8c4211ac-d336-4a42-888b-06e47efa6de6" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:23 devstack sudo[106310]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fc444066-6d85-4bf1-b93f-4525b86f5903 1073741824 Nov 01 12:39:23 devstack sudo[106310]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b8e6ab6a-c42b-404d-8f84-14ff8cf6748b tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-8c4211ac-d336-4a42-888b-06e47efa6de6" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b8e6ab6a-c42b-404d-8f84-14ff8cf6748b tempest-ProjectMemberTests-538781697 None] Acquiring lock "cinder-quobyte-5dacd674-0048-434c-978f-162427255d01" by "_delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b8e6ab6a-c42b-404d-8f84-14ff8cf6748b tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-5dacd674-0048-434c-978f-162427255d01" acquired by "_delete_snapshot" :: waited 0.028s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-b8e6ab6a-c42b-404d-8f84-14ff8cf6748b tempest-ProjectMemberTests-538781697 None] Deleting offline snapshot 5dacd674-0048-434c-978f-162427255d01 of volume 8c4211ac-d336-4a42-888b-06e47efa6de6 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-b8e6ab6a-c42b-404d-8f84-14ff8cf6748b tempest-ProjectMemberTests-538781697 None] snapshot_file for this snap is: volume-8c4211ac-d336-4a42-888b-06e47efa6de6.5dacd674-0048-434c-978f-162427255d01 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[9966b46f-1d17-46b4-a3f0-b55b9176fe55]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b8e6ab6a-c42b-404d-8f84-14ff8cf6748b tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c4211ac-d336-4a42-888b-06e47efa6de6.5dacd674-0048-434c-978f-162427255d01 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:23 devstack sudo[106312]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c4211ac-d336-4a42-888b-06e47efa6de6.5dacd674-0048-434c-978f-162427255d01 Nov 01 12:39:23 devstack sudo[106312]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:23 devstack sudo[106310]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2d205c35-fccd-4116-a64f-3132da21d8ee tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fc444066-6d85-4bf1-b93f-4525b86f5903 1073741824" returned: 0 in 0.587s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:23 devstack sudo[106312]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2d205c35-fccd-4116-a64f-3132da21d8ee tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fc444066-6d85-4bf1-b93f-4525b86f5903 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b8e6ab6a-c42b-404d-8f84-14ff8cf6748b tempest-ProjectMemberTests-538781697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c4211ac-d336-4a42-888b-06e47efa6de6.5dacd674-0048-434c-978f-162427255d01" returned: 0 in 0.474s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-b8e6ab6a-c42b-404d-8f84-14ff8cf6748b tempest-ProjectMemberTests-538781697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-8c4211ac-d336-4a42-888b-06e47efa6de6(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:39:23 devstack sudo[106321]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fc444066-6d85-4bf1-b93f-4525b86f5903 Nov 01 12:39:23 devstack sudo[106321]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[986df766-44df-408e-a2ed-8a0225d93a87]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b8e6ab6a-c42b-404d-8f84-14ff8cf6748b tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c4211ac-d336-4a42-888b-06e47efa6de6 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-cdfe4b2f-df42-4543-b1a6-b569be94a8a0 tempest-CinderUnicodeTest-1450523735 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-cdfe4b2f-df42-4543-b1a6-b569be94a8a0 tempest-CinderUnicodeTest-1450523735 None] Flow 'volume_create_manager' (f6bc7712-b90d-42fe-a299-5b96b590fa76) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-cdfe4b2f-df42-4543-b1a6-b569be94a8a0 tempest-CinderUnicodeTest-1450523735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22ff68c2-1742-4479-90f1-d1cf02bb05a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-cdfe4b2f-df42-4543-b1a6-b569be94a8a0 tempest-CinderUnicodeTest-1450523735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (22ff68c2-1742-4479-90f1-d1cf02bb05a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:39:23Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1538086265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfb69611-53c5-4ef4-afb8-a448e20ea29e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c12c98fd1ab4432bbdccbeb2ccee5e47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:39:24Z,use_quota=True,user_id='6ae0198bb7a4497cb2f073d2c099bcf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-cdfe4b2f-df42-4543-b1a6-b569be94a8a0 tempest-CinderUnicodeTest-1450523735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f4cccde-b1ac-472e-885d-0592189277fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-cdfe4b2f-df42-4543-b1a6-b569be94a8a0 tempest-CinderUnicodeTest-1450523735 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f4cccde-b1ac-472e-885d-0592189277fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-cdfe4b2f-df42-4543-b1a6-b569be94a8a0 tempest-CinderUnicodeTest-1450523735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a1e01bd-85bb-42bf-a22c-0f8b3e669e93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-cdfe4b2f-df42-4543-b1a6-b569be94a8a0 tempest-CinderUnicodeTest-1450523735 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0a1e01bd-85bb-42bf-a22c-0f8b3e669e93) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'cfb69611-53c5-4ef4-afb8-a448e20ea29e', 'volume_name': 'volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-cdfe4b2f-df42-4543-b1a6-b569be94a8a0 tempest-CinderUnicodeTest-1450523735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f835cc27-9605-4e32-8355-38a7dc634684) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-cdfe4b2f-df42-4543-b1a6-b569be94a8a0 tempest-CinderUnicodeTest-1450523735 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f835cc27-9605-4e32-8355-38a7dc634684) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-cdfe4b2f-df42-4543-b1a6-b569be94a8a0 tempest-CinderUnicodeTest-1450523735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd0f3f41-b19a-42a3-a15f-d562e3afc8b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:23 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-cdfe4b2f-df42-4543-b1a6-b569be94a8a0 tempest-CinderUnicodeTest-1450523735 None] Volume cfb69611-53c5-4ef4-afb8-a448e20ea29e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e', 'volume_size': 1} Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-cdfe4b2f-df42-4543-b1a6-b569be94a8a0 tempest-CinderUnicodeTest-1450523735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:23 devstack sudo[106323]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c4211ac-d336-4a42-888b-06e47efa6de6 Nov 01 12:39:23 devstack sudo[106323]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:23 devstack sudo[106321]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2d205c35-fccd-4116-a64f-3132da21d8ee tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fc444066-6d85-4bf1-b93f-4525b86f5903" returned: 0 in 0.264s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-2d205c35-fccd-4116-a64f-3132da21d8ee tempest-ProjectReaderTests-532564148 None] <== create_volume: return (897ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-2d205c35-fccd-4116-a64f-3132da21d8ee tempest-ProjectReaderTests-532564148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.899s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-cdfe4b2f-df42-4543-b1a6-b569be94a8a0 tempest-CinderUnicodeTest-1450523735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.081s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-cdfe4b2f-df42-4543-b1a6-b569be94a8a0 tempest-CinderUnicodeTest-1450523735 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:39:23Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1538086265',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=cfb69611-53c5-4ef4-afb8-a448e20ea29e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='c12c98fd1ab4432bbdccbeb2ccee5e47',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:39:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:39:24Z,use_quota=True,user_id='6ae0198bb7a4497cb2f073d2c099bcf7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-cdfe4b2f-df42-4543-b1a6-b569be94a8a0 tempest-CinderUnicodeTest-1450523735 None] Creating volume cfb69611-53c5-4ef4-afb8-a448e20ea29e {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-cdfe4b2f-df42-4543-b1a6-b569be94a8a0 tempest-CinderUnicodeTest-1450523735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-cdfe4b2f-df42-4543-b1a6-b569be94a8a0 tempest-CinderUnicodeTest-1450523735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-cdfe4b2f-df42-4543-b1a6-b569be94a8a0 tempest-CinderUnicodeTest-1450523735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-cdfe4b2f-df42-4543-b1a6-b569be94a8a0 tempest-CinderUnicodeTest-1450523735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-cdfe4b2f-df42-4543-b1a6-b569be94a8a0 tempest-CinderUnicodeTest-1450523735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-cdfe4b2f-df42-4543-b1a6-b569be94a8a0 tempest-CinderUnicodeTest-1450523735 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:39:23 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-cdfe4b2f-df42-4543-b1a6-b569be94a8a0 tempest-CinderUnicodeTest-1450523735 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-cdfe4b2f-df42-4543-b1a6-b569be94a8a0 tempest-CinderUnicodeTest-1450523735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2d205c35-fccd-4116-a64f-3132da21d8ee tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7d2c2dce-98fb-48e1-b938-c5a3dcb85160) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc444066-6d85-4bf1-b93f-4525b86f5903', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:23 devstack sudo[106326]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e 1073741824 Nov 01 12:39:23 devstack sudo[106326]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2d205c35-fccd-4116-a64f-3132da21d8ee tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3623c94-990c-4b51-b039-8bc90be5afac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:23 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-2d205c35-fccd-4116-a64f-3132da21d8ee tempest-ProjectReaderTests-532564148 None] Volume volume-fc444066-6d85-4bf1-b93f-4525b86f5903 (fc444066-6d85-4bf1-b93f-4525b86f5903): created successfully Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2d205c35-fccd-4116-a64f-3132da21d8ee tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a3623c94-990c-4b51-b039-8bc90be5afac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:23 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-2d205c35-fccd-4116-a64f-3132da21d8ee tempest-ProjectReaderTests-532564148 None] Flow 'volume_create_manager' (5ae21eb7-0233-47be-a786-3769d46e2825) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:39:23 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-2d205c35-fccd-4116-a64f-3132da21d8ee tempest-ProjectReaderTests-532564148 None] Created volume successfully. Nov 01 12:39:24 devstack sudo[106323]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b8e6ab6a-c42b-404d-8f84-14ff8cf6748b tempest-ProjectMemberTests-538781697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c4211ac-d336-4a42-888b-06e47efa6de6" returned: 0 in 0.421s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b8e6ab6a-c42b-404d-8f84-14ff8cf6748b tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c4211ac-d336-4a42-888b-06e47efa6de6.5dacd674-0048-434c-978f-162427255d01 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:24 devstack sudo[106331]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c4211ac-d336-4a42-888b-06e47efa6de6.5dacd674-0048-434c-978f-162427255d01 Nov 01 12:39:24 devstack sudo[106331]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:24 devstack sudo[106326]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-cdfe4b2f-df42-4543-b1a6-b569be94a8a0 tempest-CinderUnicodeTest-1450523735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e 1073741824" returned: 0 in 0.540s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-cdfe4b2f-df42-4543-b1a6-b569be94a8a0 tempest-CinderUnicodeTest-1450523735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:24 devstack sudo[106331]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b8e6ab6a-c42b-404d-8f84-14ff8cf6748b tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c4211ac-d336-4a42-888b-06e47efa6de6.5dacd674-0048-434c-978f-162427255d01" returned: 0 in 0.389s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b8e6ab6a-c42b-404d-8f84-14ff8cf6748b tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c4211ac-d336-4a42-888b-06e47efa6de6.5dacd674-0048-434c-978f-162427255d01 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:24 devstack sudo[106341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e Nov 01 12:39:24 devstack sudo[106341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:24 devstack sudo[106342]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c4211ac-d336-4a42-888b-06e47efa6de6.5dacd674-0048-434c-978f-162427255d01 Nov 01 12:39:24 devstack sudo[106342]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:24 devstack sudo[106342]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b8e6ab6a-c42b-404d-8f84-14ff8cf6748b tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c4211ac-d336-4a42-888b-06e47efa6de6.5dacd674-0048-434c-978f-162427255d01" returned: 0 in 0.268s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:24 devstack sudo[106341]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-cdfe4b2f-df42-4543-b1a6-b569be94a8a0 tempest-CinderUnicodeTest-1450523735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e" returned: 0 in 0.326s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:24 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-cdfe4b2f-df42-4543-b1a6-b569be94a8a0 tempest-CinderUnicodeTest-1450523735 None] <== create_volume: return (918ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:39:24 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-cdfe4b2f-df42-4543-b1a6-b569be94a8a0 tempest-CinderUnicodeTest-1450523735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.921s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:24 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b8e6ab6a-c42b-404d-8f84-14ff8cf6748b tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-5dacd674-0048-434c-978f-162427255d01" released by "_delete_snapshot" :: held 1.721s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:24 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b8e6ab6a-c42b-404d-8f84-14ff8cf6748b tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-8c4211ac-d336-4a42-888b-06e47efa6de6" released by "delete_snapshot" :: held 1.765s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:24 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-cdfe4b2f-df42-4543-b1a6-b569be94a8a0 tempest-CinderUnicodeTest-1450523735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dd0f3f41-b19a-42a3-a15f-d562e3afc8b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:24 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-cdfe4b2f-df42-4543-b1a6-b569be94a8a0 tempest-CinderUnicodeTest-1450523735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1509943-d0f8-41ce-98ef-437b2303b06d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:24 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-cdfe4b2f-df42-4543-b1a6-b569be94a8a0 tempest-CinderUnicodeTest-1450523735 None] Volume volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e (cfb69611-53c5-4ef4-afb8-a448e20ea29e): created successfully Nov 01 12:39:24 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-cdfe4b2f-df42-4543-b1a6-b569be94a8a0 tempest-CinderUnicodeTest-1450523735 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f1509943-d0f8-41ce-98ef-437b2303b06d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:24 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-cdfe4b2f-df42-4543-b1a6-b569be94a8a0 tempest-CinderUnicodeTest-1450523735 None] Flow 'volume_create_manager' (f6bc7712-b90d-42fe-a299-5b96b590fa76) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:39:24 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-cdfe4b2f-df42-4543-b1a6-b569be94a8a0 tempest-CinderUnicodeTest-1450523735 None] Created volume successfully. Nov 01 12:39:24 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-b8e6ab6a-c42b-404d-8f84-14ff8cf6748b tempest-ProjectMemberTests-538781697 None] Created reservations ['ed25f007-293c-41b4-abe4-a7fbb41829e9', 'a90f26d9-f471-4885-85f9-2a19ebab4686', 'fa5bebc5-6ab9-45fc-8523-86dde068a9fb', 'bc013f79-3e62-4b55-9b7e-4d414b611118'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:39:25 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-b8e6ab6a-c42b-404d-8f84-14ff8cf6748b tempest-ProjectMemberTests-538781697 None] Delete snapshot completed successfully. Nov 01 12:39:25 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b8e6ab6a-c42b-404d-8f84-14ff8cf6748b tempest-ProjectMemberTests-538781697 None] Lock "cinder-5dacd674-0048-434c-978f-162427255d01-delete_snapshot" released by "delete_snapshot" :: held 2.030s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:25 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-c3c9fd4f-5209-4882-a65f-d82cce0cb2a4 tempest-ProjectMemberTests-538781697 None] Acquiring lock "cinder-8c4211ac-d336-4a42-888b-06e47efa6de6-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:25 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-c3c9fd4f-5209-4882-a65f-d82cce0cb2a4 tempest-ProjectMemberTests-538781697 None] Lock "cinder-8c4211ac-d336-4a42-888b-06e47efa6de6-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:25 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-c3c9fd4f-5209-4882-a65f-d82cce0cb2a4 tempest-ProjectMemberTests-538781697 None] Acquiring lock "cinder-quobyte-8c4211ac-d336-4a42-888b-06e47efa6de6" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:25 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-c3c9fd4f-5209-4882-a65f-d82cce0cb2a4 tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-8c4211ac-d336-4a42-888b-06e47efa6de6" acquired by "delete_volume" :: waited 0.025s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-009f0d3e-9ac5-4f47-a71b-a51e135e3ffc tempest-ProjectReaderTests-532564148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-009f0d3e-9ac5-4f47-a71b-a51e135e3ffc tempest-ProjectReaderTests-532564148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:25 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:SELECT=242,cinder:UPDATE=314,cinder:INSERT=98,cinder:DELETE=31 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:39:25 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[a1f6aa5e-913e-40d2-a544-d15c08808a8c]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c3c9fd4f-5209-4882-a65f-d82cce0cb2a4 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c4211ac-d336-4a42-888b-06e47efa6de6 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:25 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-009f0d3e-9ac5-4f47-a71b-a51e135e3ffc tempest-ProjectReaderTests-532564148 None] Creating offline snapshot 92ae9af2-47e6-41ed-8bc2-ee34891479b7 of volume fc444066-6d85-4bf1-b93f-4525b86f5903 {{(pid=86574) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:39:25 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[74f76b28-d4ed-4bcb-a9f1-881f832e8551]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-009f0d3e-9ac5-4f47-a71b-a51e135e3ffc tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fc444066-6d85-4bf1-b93f-4525b86f5903 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:25 devstack sudo[106347]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c4211ac-d336-4a42-888b-06e47efa6de6 Nov 01 12:39:25 devstack sudo[106347]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:25 devstack sudo[106348]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fc444066-6d85-4bf1-b93f-4525b86f5903 Nov 01 12:39:25 devstack sudo[106348]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:25 devstack sudo[106347]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c3c9fd4f-5209-4882-a65f-d82cce0cb2a4 tempest-ProjectMemberTests-538781697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c4211ac-d336-4a42-888b-06e47efa6de6" returned: 0 in 0.387s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c3c9fd4f-5209-4882-a65f-d82cce0cb2a4 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c4211ac-d336-4a42-888b-06e47efa6de6 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:25 devstack sudo[106357]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c4211ac-d336-4a42-888b-06e47efa6de6 Nov 01 12:39:25 devstack sudo[106357]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:25 devstack sudo[106348]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-009f0d3e-9ac5-4f47-a71b-a51e135e3ffc tempest-ProjectReaderTests-532564148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fc444066-6d85-4bf1-b93f-4525b86f5903" returned: 0 in 0.389s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:25 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-009f0d3e-9ac5-4f47-a71b-a51e135e3ffc tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fc444066-6d85-4bf1-b93f-4525b86f5903,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fc444066-6d85-4bf1-b93f-4525b86f5903.92ae9af2-47e6-41ed-8bc2-ee34891479b7 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:25 devstack sudo[106359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fc444066-6d85-4bf1-b93f-4525b86f5903,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fc444066-6d85-4bf1-b93f-4525b86f5903.92ae9af2-47e6-41ed-8bc2-ee34891479b7 1G Nov 01 12:39:25 devstack sudo[106359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:26 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:SELECT=239,cinder:UPDATE=332,cinder:DELETE=27,cinder:INSERT=75 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:39:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-7e4fca6e-8958-4bd1-bfc5-9adebe7ec186 tempest-CinderUnicodeTest-1450523735 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:26 devstack sudo[106357]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c3c9fd4f-5209-4882-a65f-d82cce0cb2a4 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-8c4211ac-d336-4a42-888b-06e47efa6de6" returned: 0 in 0.304s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:26 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-c3c9fd4f-5209-4882-a65f-d82cce0cb2a4 tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-8c4211ac-d336-4a42-888b-06e47efa6de6" released by "delete_volume" :: held 0.775s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:26 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-c3c9fd4f-5209-4882-a65f-d82cce0cb2a4 tempest-ProjectMemberTests-538781697 None] Created reservations ['9ee73586-18c1-4acb-a7fe-fcdeb137ac9d', '275e4c8f-077a-4461-992c-180712bc710b', 'f02a97b0-d682-4aa1-82af-937b2269d95b', 'cc393487-5335-46b4-98cf-872138166c49'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:39:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-c3c9fd4f-5209-4882-a65f-d82cce0cb2a4 tempest-ProjectMemberTests-538781697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-c3c9fd4f-5209-4882-a65f-d82cce0cb2a4 tempest-ProjectMemberTests-538781697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:26 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-c3c9fd4f-5209-4882-a65f-d82cce0cb2a4 tempest-ProjectMemberTests-538781697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:39:26 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-c3c9fd4f-5209-4882-a65f-d82cce0cb2a4 tempest-ProjectMemberTests-538781697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:39:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-c3c9fd4f-5209-4882-a65f-d82cce0cb2a4 tempest-ProjectMemberTests-538781697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c3c9fd4f-5209-4882-a65f-d82cce0cb2a4 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:26 devstack sudo[106365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:39:26 devstack sudo[106365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:26 devstack sudo[106359]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-009f0d3e-9ac5-4f47-a71b-a51e135e3ffc tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fc444066-6d85-4bf1-b93f-4525b86f5903,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fc444066-6d85-4bf1-b93f-4525b86f5903.92ae9af2-47e6-41ed-8bc2-ee34891479b7 1G" returned: 0 in 0.493s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-009f0d3e-9ac5-4f47-a71b-a51e135e3ffc tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc444066-6d85-4bf1-b93f-4525b86f5903 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fc444066-6d85-4bf1-b93f-4525b86f5903.92ae9af2-47e6-41ed-8bc2-ee34891479b7 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:26 devstack sudo[106368]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc444066-6d85-4bf1-b93f-4525b86f5903 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fc444066-6d85-4bf1-b93f-4525b86f5903.92ae9af2-47e6-41ed-8bc2-ee34891479b7 Nov 01 12:39:26 devstack sudo[106368]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:26 devstack sudo[106365]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c3c9fd4f-5209-4882-a65f-d82cce0cb2a4 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.349s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:26 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-c3c9fd4f-5209-4882-a65f-d82cce0cb2a4 tempest-ProjectMemberTests-538781697 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:39:26 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-c3c9fd4f-5209-4882-a65f-d82cce0cb2a4 tempest-ProjectMemberTests-538781697 None] Deleted volume successfully. Nov 01 12:39:26 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-c3c9fd4f-5209-4882-a65f-d82cce0cb2a4 tempest-ProjectMemberTests-538781697 None] Lock "cinder-8c4211ac-d336-4a42-888b-06e47efa6de6-delete_volume" released by "delete_volume" :: held 1.370s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:26 devstack sudo[106368]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-009f0d3e-9ac5-4f47-a71b-a51e135e3ffc tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-fc444066-6d85-4bf1-b93f-4525b86f5903 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fc444066-6d85-4bf1-b93f-4525b86f5903.92ae9af2-47e6-41ed-8bc2-ee34891479b7" returned: 0 in 0.402s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:26 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-009f0d3e-9ac5-4f47-a71b-a51e135e3ffc tempest-ProjectReaderTests-532564148 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fc444066-6d85-4bf1-b93f-4525b86f5903.92ae9af2-47e6-41ed-8bc2-ee34891479b7 is being set with open permissions: ugo+rw Nov 01 12:39:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-009f0d3e-9ac5-4f47-a71b-a51e135e3ffc tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fc444066-6d85-4bf1-b93f-4525b86f5903.92ae9af2-47e6-41ed-8bc2-ee34891479b7 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:26 devstack sudo[106375]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fc444066-6d85-4bf1-b93f-4525b86f5903.92ae9af2-47e6-41ed-8bc2-ee34891479b7 Nov 01 12:39:26 devstack sudo[106375]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:26 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-228207ec-4f10-42b0-b0ad-2a9ba84e5e3d tempest-ProjectMemberTests-538781697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:39:26 devstack sudo[106375]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-228207ec-4f10-42b0-b0ad-2a9ba84e5e3d tempest-ProjectMemberTests-538781697 None] Flow 'volume_create_manager' (735cce14-8c69-4a48-bdfb-db57d6cf32d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:39:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-228207ec-4f10-42b0-b0ad-2a9ba84e5e3d tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98291e42-9001-434c-bc8c-18adb3e47da4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-009f0d3e-9ac5-4f47-a71b-a51e135e3ffc tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fc444066-6d85-4bf1-b93f-4525b86f5903.92ae9af2-47e6-41ed-8bc2-ee34891479b7" returned: 0 in 0.320s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-228207ec-4f10-42b0-b0ad-2a9ba84e5e3d tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (98291e42-9001-434c-bc8c-18adb3e47da4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:39:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1912948902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcf30b97-3e90-4fe8-aa72-af14223b1e11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe0ffaf6cf1d4294aa9f030164447d48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:39:27Z,use_quota=True,user_id='f617cd7e548d4a989b479812bba708f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-228207ec-4f10-42b0-b0ad-2a9ba84e5e3d tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37398b3a-5a6a-4f78-87bc-3d6f427fda52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-228207ec-4f10-42b0-b0ad-2a9ba84e5e3d tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (37398b3a-5a6a-4f78-87bc-3d6f427fda52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-228207ec-4f10-42b0-b0ad-2a9ba84e5e3d tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (586f2072-17ab-4dc1-995b-06a45466cc1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-228207ec-4f10-42b0-b0ad-2a9ba84e5e3d tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (586f2072-17ab-4dc1-995b-06a45466cc1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'dcf30b97-3e90-4fe8-aa72-af14223b1e11', 'volume_name': 'volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-228207ec-4f10-42b0-b0ad-2a9ba84e5e3d tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6574c241-11a0-4140-96a1-0411dee4d25a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-228207ec-4f10-42b0-b0ad-2a9ba84e5e3d tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6574c241-11a0-4140-96a1-0411dee4d25a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-228207ec-4f10-42b0-b0ad-2a9ba84e5e3d tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (472c2ca7-e6d0-4ebd-b64f-ff6e69de4fd5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:27 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-228207ec-4f10-42b0-b0ad-2a9ba84e5e3d tempest-ProjectMemberTests-538781697 None] Volume dcf30b97-3e90-4fe8-aa72-af14223b1e11: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11', 'volume_size': 1} Nov 01 12:39:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-228207ec-4f10-42b0-b0ad-2a9ba84e5e3d tempest-ProjectMemberTests-538781697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-009f0d3e-9ac5-4f47-a71b-a51e135e3ffc tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fc444066-6d85-4bf1-b93f-4525b86f5903.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:27 devstack sudo[106378]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fc444066-6d85-4bf1-b93f-4525b86f5903.info Nov 01 12:39:27 devstack sudo[106378]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:27 devstack sudo[106378]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-009f0d3e-9ac5-4f47-a71b-a51e135e3ffc tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fc444066-6d85-4bf1-b93f-4525b86f5903.info" returned: 0 in 0.272s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:27 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-009f0d3e-9ac5-4f47-a71b-a51e135e3ffc tempest-ProjectReaderTests-532564148 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fc444066-6d85-4bf1-b93f-4525b86f5903.info is being set with open permissions: ugo+rw Nov 01 12:39:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-009f0d3e-9ac5-4f47-a71b-a51e135e3ffc tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fc444066-6d85-4bf1-b93f-4525b86f5903.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:27 devstack sudo[106381]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fc444066-6d85-4bf1-b93f-4525b86f5903.info Nov 01 12:39:27 devstack sudo[106381]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:27 devstack sudo[106381]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-009f0d3e-9ac5-4f47-a71b-a51e135e3ffc tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fc444066-6d85-4bf1-b93f-4525b86f5903.info" returned: 0 in 0.265s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-009f0d3e-9ac5-4f47-a71b-a51e135e3ffc tempest-ProjectReaderTests-532564148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.302s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-7e4fca6e-8958-4bd1-bfc5-9adebe7ec186 tempest-CinderUnicodeTest-1450523735 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 1.608s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:27 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-7e4fca6e-8958-4bd1-bfc5-9adebe7ec186 tempest-CinderUnicodeTest-1450523735 None] Creating offline snapshot 66f40e2d-afb8-40fb-b047-eebf2f0fbefe of volume cfb69611-53c5-4ef4-afb8-a448e20ea29e {{(pid=86574) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:39:27 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-009f0d3e-9ac5-4f47-a71b-a51e135e3ffc tempest-ProjectReaderTests-532564148 None] Create snapshot completed successfully Nov 01 12:39:27 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[e3855172-c2a6-46dc-b4b8-14de89cbf941]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7e4fca6e-8958-4bd1-bfc5-9adebe7ec186 tempest-CinderUnicodeTest-1450523735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:27 devstack sudo[106384]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e Nov 01 12:39:27 devstack sudo[106384]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:28 devstack sudo[106384]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7e4fca6e-8958-4bd1-bfc5-9adebe7ec186 tempest-CinderUnicodeTest-1450523735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e" returned: 0 in 0.383s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7e4fca6e-8958-4bd1-bfc5-9adebe7ec186 tempest-CinderUnicodeTest-1450523735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e.66f40e2d-afb8-40fb-b047-eebf2f0fbefe 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:28 devstack sudo[106389]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e.66f40e2d-afb8-40fb-b047-eebf2f0fbefe 1G Nov 01 12:39:28 devstack sudo[106389]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:28 devstack sudo[106389]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7e4fca6e-8958-4bd1-bfc5-9adebe7ec186 tempest-CinderUnicodeTest-1450523735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e.66f40e2d-afb8-40fb-b047-eebf2f0fbefe 1G" returned: 0 in 0.447s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7e4fca6e-8958-4bd1-bfc5-9adebe7ec186 tempest-CinderUnicodeTest-1450523735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e.66f40e2d-afb8-40fb-b047-eebf2f0fbefe {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:28 devstack sudo[106395]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e.66f40e2d-afb8-40fb-b047-eebf2f0fbefe Nov 01 12:39:28 devstack sudo[106395]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:28 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e82f9d11-6a74-491c-9df0-4975a0d5d16e tempest-ProjectReaderTests-532564148 None] Acquiring lock "cinder-92ae9af2-47e6-41ed-8bc2-ee34891479b7-delete_snapshot" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:28 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e82f9d11-6a74-491c-9df0-4975a0d5d16e tempest-ProjectReaderTests-532564148 None] Lock "cinder-92ae9af2-47e6-41ed-8bc2-ee34891479b7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:28 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e82f9d11-6a74-491c-9df0-4975a0d5d16e tempest-ProjectReaderTests-532564148 None] Acquiring lock "cinder-quobyte-fc444066-6d85-4bf1-b93f-4525b86f5903" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:28 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e82f9d11-6a74-491c-9df0-4975a0d5d16e tempest-ProjectReaderTests-532564148 None] Lock "cinder-quobyte-fc444066-6d85-4bf1-b93f-4525b86f5903" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:28 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e82f9d11-6a74-491c-9df0-4975a0d5d16e tempest-ProjectReaderTests-532564148 None] Acquiring lock "cinder-quobyte-92ae9af2-47e6-41ed-8bc2-ee34891479b7" by "_delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:28 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e82f9d11-6a74-491c-9df0-4975a0d5d16e tempest-ProjectReaderTests-532564148 None] Lock "cinder-quobyte-92ae9af2-47e6-41ed-8bc2-ee34891479b7" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:28 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-e82f9d11-6a74-491c-9df0-4975a0d5d16e tempest-ProjectReaderTests-532564148 None] Deleting offline snapshot 92ae9af2-47e6-41ed-8bc2-ee34891479b7 of volume fc444066-6d85-4bf1-b93f-4525b86f5903 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:39:28 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-e82f9d11-6a74-491c-9df0-4975a0d5d16e tempest-ProjectReaderTests-532564148 None] snapshot_file for this snap is: volume-fc444066-6d85-4bf1-b93f-4525b86f5903.92ae9af2-47e6-41ed-8bc2-ee34891479b7 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:39:28 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[6364f326-bce6-495a-96b5-7200c77a8cdb]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e82f9d11-6a74-491c-9df0-4975a0d5d16e tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fc444066-6d85-4bf1-b93f-4525b86f5903.92ae9af2-47e6-41ed-8bc2-ee34891479b7 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:28 devstack sudo[106398]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fc444066-6d85-4bf1-b93f-4525b86f5903.92ae9af2-47e6-41ed-8bc2-ee34891479b7 Nov 01 12:39:28 devstack sudo[106398]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:28 devstack sudo[106395]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7e4fca6e-8958-4bd1-bfc5-9adebe7ec186 tempest-CinderUnicodeTest-1450523735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e.66f40e2d-afb8-40fb-b047-eebf2f0fbefe" returned: 0 in 0.320s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:28 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-7e4fca6e-8958-4bd1-bfc5-9adebe7ec186 tempest-CinderUnicodeTest-1450523735 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e.66f40e2d-afb8-40fb-b047-eebf2f0fbefe is being set with open permissions: ugo+rw Nov 01 12:39:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7e4fca6e-8958-4bd1-bfc5-9adebe7ec186 tempest-CinderUnicodeTest-1450523735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e.66f40e2d-afb8-40fb-b047-eebf2f0fbefe {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:28 devstack sudo[106403]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e.66f40e2d-afb8-40fb-b047-eebf2f0fbefe Nov 01 12:39:28 devstack sudo[106403]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:29 devstack sudo[106398]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e82f9d11-6a74-491c-9df0-4975a0d5d16e tempest-ProjectReaderTests-532564148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fc444066-6d85-4bf1-b93f-4525b86f5903.92ae9af2-47e6-41ed-8bc2-ee34891479b7" returned: 0 in 0.394s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:29 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-e82f9d11-6a74-491c-9df0-4975a0d5d16e tempest-ProjectReaderTests-532564148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-fc444066-6d85-4bf1-b93f-4525b86f5903(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:39:29 devstack sudo[106403]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7e4fca6e-8958-4bd1-bfc5-9adebe7ec186 tempest-CinderUnicodeTest-1450523735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e.66f40e2d-afb8-40fb-b047-eebf2f0fbefe" returned: 0 in 0.283s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:29 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddf94821-eb54-4fc9-95a1-46d3cf11109d]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e82f9d11-6a74-491c-9df0-4975a0d5d16e tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fc444066-6d85-4bf1-b93f-4525b86f5903 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7e4fca6e-8958-4bd1-bfc5-9adebe7ec186 tempest-CinderUnicodeTest-1450523735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:29 devstack sudo[106410]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e.info Nov 01 12:39:29 devstack sudo[106410]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:29 devstack sudo[106409]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fc444066-6d85-4bf1-b93f-4525b86f5903 Nov 01 12:39:29 devstack sudo[106409]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:29 devstack sudo[106410]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7e4fca6e-8958-4bd1-bfc5-9adebe7ec186 tempest-CinderUnicodeTest-1450523735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e.info" returned: 0 in 0.267s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:29 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-7e4fca6e-8958-4bd1-bfc5-9adebe7ec186 tempest-CinderUnicodeTest-1450523735 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e.info is being set with open permissions: ugo+rw Nov 01 12:39:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7e4fca6e-8958-4bd1-bfc5-9adebe7ec186 tempest-CinderUnicodeTest-1450523735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:29 devstack sudo[106414]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e.info Nov 01 12:39:29 devstack sudo[106414]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:29 devstack sudo[106409]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e82f9d11-6a74-491c-9df0-4975a0d5d16e tempest-ProjectReaderTests-532564148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fc444066-6d85-4bf1-b93f-4525b86f5903" returned: 0 in 0.420s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e82f9d11-6a74-491c-9df0-4975a0d5d16e tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fc444066-6d85-4bf1-b93f-4525b86f5903.92ae9af2-47e6-41ed-8bc2-ee34891479b7 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:29 devstack sudo[106420]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fc444066-6d85-4bf1-b93f-4525b86f5903.92ae9af2-47e6-41ed-8bc2-ee34891479b7 Nov 01 12:39:29 devstack sudo[106420]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:29 devstack sudo[106414]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7e4fca6e-8958-4bd1-bfc5-9adebe7ec186 tempest-CinderUnicodeTest-1450523735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e.info" returned: 0 in 0.273s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-7e4fca6e-8958-4bd1-bfc5-9adebe7ec186 tempest-CinderUnicodeTest-1450523735 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.101s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-228207ec-4f10-42b0-b0ad-2a9ba84e5e3d tempest-ProjectMemberTests-538781697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.686s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:29 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-228207ec-4f10-42b0-b0ad-2a9ba84e5e3d tempest-ProjectMemberTests-538781697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:39:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1912948902',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=dcf30b97-3e90-4fe8-aa72-af14223b1e11,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe0ffaf6cf1d4294aa9f030164447d48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:39:27Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:39:27Z,use_quota=True,user_id='f617cd7e548d4a989b479812bba708f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:39:29 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-228207ec-4f10-42b0-b0ad-2a9ba84e5e3d tempest-ProjectMemberTests-538781697 None] Creating volume dcf30b97-3e90-4fe8-aa72-af14223b1e11 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:39:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-228207ec-4f10-42b0-b0ad-2a9ba84e5e3d tempest-ProjectMemberTests-538781697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-228207ec-4f10-42b0-b0ad-2a9ba84e5e3d tempest-ProjectMemberTests-538781697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:29 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-228207ec-4f10-42b0-b0ad-2a9ba84e5e3d tempest-ProjectMemberTests-538781697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:39:29 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-228207ec-4f10-42b0-b0ad-2a9ba84e5e3d tempest-ProjectMemberTests-538781697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:39:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-228207ec-4f10-42b0-b0ad-2a9ba84e5e3d tempest-ProjectMemberTests-538781697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:29 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-228207ec-4f10-42b0-b0ad-2a9ba84e5e3d tempest-ProjectMemberTests-538781697 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:39:29 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-228207ec-4f10-42b0-b0ad-2a9ba84e5e3d tempest-ProjectMemberTests-538781697 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:39:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-228207ec-4f10-42b0-b0ad-2a9ba84e5e3d tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:29 devstack sudo[106423]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11 1073741824 Nov 01 12:39:29 devstack sudo[106423]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:29 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-7e4fca6e-8958-4bd1-bfc5-9adebe7ec186 tempest-CinderUnicodeTest-1450523735 None] Create snapshot completed successfully Nov 01 12:39:29 devstack sudo[106420]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e82f9d11-6a74-491c-9df0-4975a0d5d16e tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fc444066-6d85-4bf1-b93f-4525b86f5903.92ae9af2-47e6-41ed-8bc2-ee34891479b7" returned: 0 in 0.384s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e82f9d11-6a74-491c-9df0-4975a0d5d16e tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fc444066-6d85-4bf1-b93f-4525b86f5903.92ae9af2-47e6-41ed-8bc2-ee34891479b7 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:29 devstack sudo[106428]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fc444066-6d85-4bf1-b93f-4525b86f5903.92ae9af2-47e6-41ed-8bc2-ee34891479b7 Nov 01 12:39:29 devstack sudo[106428]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:30 devstack sudo[106428]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e82f9d11-6a74-491c-9df0-4975a0d5d16e tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fc444066-6d85-4bf1-b93f-4525b86f5903.92ae9af2-47e6-41ed-8bc2-ee34891479b7" returned: 0 in 0.303s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:30 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e82f9d11-6a74-491c-9df0-4975a0d5d16e tempest-ProjectReaderTests-532564148 None] Lock "cinder-quobyte-92ae9af2-47e6-41ed-8bc2-ee34891479b7" released by "_delete_snapshot" :: held 1.633s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:30 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6706c63c-2501-4c37-9853-7eaf07f86544 tempest-CinderUnicodeTest-1450523735 None] Acquiring lock "cinder-66f40e2d-afb8-40fb-b047-eebf2f0fbefe-delete_snapshot" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:30 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e82f9d11-6a74-491c-9df0-4975a0d5d16e tempest-ProjectReaderTests-532564148 None] Lock "cinder-quobyte-fc444066-6d85-4bf1-b93f-4525b86f5903" released by "delete_snapshot" :: held 1.668s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:30 devstack sudo[106423]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-228207ec-4f10-42b0-b0ad-2a9ba84e5e3d tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11 1073741824" returned: 0 in 0.581s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:30 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6706c63c-2501-4c37-9853-7eaf07f86544 tempest-CinderUnicodeTest-1450523735 None] Lock "cinder-66f40e2d-afb8-40fb-b047-eebf2f0fbefe-delete_snapshot" acquired by "delete_snapshot" :: waited 0.044s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:30 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6706c63c-2501-4c37-9853-7eaf07f86544 tempest-CinderUnicodeTest-1450523735 None] Acquiring lock "cinder-quobyte-cfb69611-53c5-4ef4-afb8-a448e20ea29e" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:30 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6706c63c-2501-4c37-9853-7eaf07f86544 tempest-CinderUnicodeTest-1450523735 None] Lock "cinder-quobyte-cfb69611-53c5-4ef4-afb8-a448e20ea29e" acquired by "delete_snapshot" :: waited 0.048s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:30 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6706c63c-2501-4c37-9853-7eaf07f86544 tempest-CinderUnicodeTest-1450523735 None] Acquiring lock "cinder-quobyte-66f40e2d-afb8-40fb-b047-eebf2f0fbefe" by "_delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-228207ec-4f10-42b0-b0ad-2a9ba84e5e3d tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:30 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6706c63c-2501-4c37-9853-7eaf07f86544 tempest-CinderUnicodeTest-1450523735 None] Lock "cinder-quobyte-66f40e2d-afb8-40fb-b047-eebf2f0fbefe" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:30 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-6706c63c-2501-4c37-9853-7eaf07f86544 tempest-CinderUnicodeTest-1450523735 None] Deleting offline snapshot 66f40e2d-afb8-40fb-b047-eebf2f0fbefe of volume cfb69611-53c5-4ef4-afb8-a448e20ea29e {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:39:30 devstack sudo[106435]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11 Nov 01 12:39:30 devstack sudo[106435]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:30 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-6706c63c-2501-4c37-9853-7eaf07f86544 tempest-CinderUnicodeTest-1450523735 None] snapshot_file for this snap is: volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e.66f40e2d-afb8-40fb-b047-eebf2f0fbefe {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:39:30 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[65bc760b-8092-4398-9c6d-f4174ba3eb1f]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6706c63c-2501-4c37-9853-7eaf07f86544 tempest-CinderUnicodeTest-1450523735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e.66f40e2d-afb8-40fb-b047-eebf2f0fbefe {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:30 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-e82f9d11-6a74-491c-9df0-4975a0d5d16e tempest-ProjectReaderTests-532564148 None] Created reservations ['4d631c11-4ab9-495f-b088-f5aec25ed3b4', '7adb8a60-33fa-4d37-a92f-f7d46e65a703', 'a6350189-fc16-493b-b873-5d7cc17e6723', '356515c5-0955-46e9-9f3e-7466840fb5c5'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:39:30 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-e82f9d11-6a74-491c-9df0-4975a0d5d16e tempest-ProjectReaderTests-532564148 None] Delete snapshot completed successfully. Nov 01 12:39:30 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e82f9d11-6a74-491c-9df0-4975a0d5d16e tempest-ProjectReaderTests-532564148 None] Lock "cinder-92ae9af2-47e6-41ed-8bc2-ee34891479b7-delete_snapshot" released by "delete_snapshot" :: held 1.983s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:30 devstack sudo[106437]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e.66f40e2d-afb8-40fb-b047-eebf2f0fbefe Nov 01 12:39:30 devstack sudo[106437]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:30 devstack sudo[106435]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-228207ec-4f10-42b0-b0ad-2a9ba84e5e3d tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11" returned: 0 in 0.329s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:30 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-228207ec-4f10-42b0-b0ad-2a9ba84e5e3d tempest-ProjectMemberTests-538781697 None] <== create_volume: return (998ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:39:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-228207ec-4f10-42b0-b0ad-2a9ba84e5e3d tempest-ProjectMemberTests-538781697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:30 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-228207ec-4f10-42b0-b0ad-2a9ba84e5e3d tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (472c2ca7-e6d0-4ebd-b64f-ff6e69de4fd5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:30 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-228207ec-4f10-42b0-b0ad-2a9ba84e5e3d tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7895931b-6dc3-4357-8c29-72803aafe4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:30 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-bf6598b6-5345-43bd-a0a1-0cb106d85e0e tempest-ProjectReaderTests-532564148 None] Acquiring lock "cinder-fc444066-6d85-4bf1-b93f-4525b86f5903-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:30 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-228207ec-4f10-42b0-b0ad-2a9ba84e5e3d tempest-ProjectMemberTests-538781697 None] Volume volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11 (dcf30b97-3e90-4fe8-aa72-af14223b1e11): created successfully Nov 01 12:39:30 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-228207ec-4f10-42b0-b0ad-2a9ba84e5e3d tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7895931b-6dc3-4357-8c29-72803aafe4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:30 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-228207ec-4f10-42b0-b0ad-2a9ba84e5e3d tempest-ProjectMemberTests-538781697 None] Flow 'volume_create_manager' (735cce14-8c69-4a48-bdfb-db57d6cf32d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:39:30 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-bf6598b6-5345-43bd-a0a1-0cb106d85e0e tempest-ProjectReaderTests-532564148 None] Lock "cinder-fc444066-6d85-4bf1-b93f-4525b86f5903-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:30 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-228207ec-4f10-42b0-b0ad-2a9ba84e5e3d tempest-ProjectMemberTests-538781697 None] Created volume successfully. Nov 01 12:39:30 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-bf6598b6-5345-43bd-a0a1-0cb106d85e0e tempest-ProjectReaderTests-532564148 None] Acquiring lock "cinder-quobyte-fc444066-6d85-4bf1-b93f-4525b86f5903" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:30 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-bf6598b6-5345-43bd-a0a1-0cb106d85e0e tempest-ProjectReaderTests-532564148 None] Lock "cinder-quobyte-fc444066-6d85-4bf1-b93f-4525b86f5903" acquired by "delete_volume" :: waited 0.014s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:30 devstack sudo[106437]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6706c63c-2501-4c37-9853-7eaf07f86544 tempest-CinderUnicodeTest-1450523735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e.66f40e2d-afb8-40fb-b047-eebf2f0fbefe" returned: 0 in 0.499s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:30 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-6706c63c-2501-4c37-9853-7eaf07f86544 tempest-CinderUnicodeTest-1450523735 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:39:31 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[a92f4e99-b74e-48d0-84d8-d9d29205aeb1]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bf6598b6-5345-43bd-a0a1-0cb106d85e0e tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fc444066-6d85-4bf1-b93f-4525b86f5903 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:31 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0840cd7-e0fd-4ba7-a6fe-d4dbf868ad47]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6706c63c-2501-4c37-9853-7eaf07f86544 tempest-CinderUnicodeTest-1450523735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:31 devstack sudo[106443]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fc444066-6d85-4bf1-b93f-4525b86f5903 Nov 01 12:39:31 devstack sudo[106443]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:31 devstack sudo[106444]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e Nov 01 12:39:31 devstack sudo[106444]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:31 devstack sudo[106443]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bf6598b6-5345-43bd-a0a1-0cb106d85e0e tempest-ProjectReaderTests-532564148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fc444066-6d85-4bf1-b93f-4525b86f5903" returned: 0 in 0.464s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bf6598b6-5345-43bd-a0a1-0cb106d85e0e tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fc444066-6d85-4bf1-b93f-4525b86f5903 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:31 devstack sudo[106453]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fc444066-6d85-4bf1-b93f-4525b86f5903 Nov 01 12:39:31 devstack sudo[106453]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-1c08ef4c-b3f9-4319-8cba-0fb9c17bfcc2 tempest-ProjectMemberTests-538781697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-1c08ef4c-b3f9-4319-8cba-0fb9c17bfcc2 tempest-ProjectMemberTests-538781697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:31 devstack sudo[106444]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6706c63c-2501-4c37-9853-7eaf07f86544 tempest-CinderUnicodeTest-1450523735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e" returned: 0 in 0.534s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6706c63c-2501-4c37-9853-7eaf07f86544 tempest-CinderUnicodeTest-1450523735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e.66f40e2d-afb8-40fb-b047-eebf2f0fbefe {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:31 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-1c08ef4c-b3f9-4319-8cba-0fb9c17bfcc2 tempest-ProjectMemberTests-538781697 None] Creating offline snapshot 9fec2637-12d3-4664-b6a1-2a5e2dc54cf1 of volume dcf30b97-3e90-4fe8-aa72-af14223b1e11 {{(pid=86574) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:39:31 devstack sudo[106455]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e.66f40e2d-afb8-40fb-b047-eebf2f0fbefe Nov 01 12:39:31 devstack sudo[106455]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:31 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[0aaaab5a-cbe5-4686-86c8-746525869447]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1c08ef4c-b3f9-4319-8cba-0fb9c17bfcc2 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:31 devstack sudo[106453]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bf6598b6-5345-43bd-a0a1-0cb106d85e0e tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-fc444066-6d85-4bf1-b93f-4525b86f5903" returned: 0 in 0.266s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:31 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-bf6598b6-5345-43bd-a0a1-0cb106d85e0e tempest-ProjectReaderTests-532564148 None] Lock "cinder-quobyte-fc444066-6d85-4bf1-b93f-4525b86f5903" released by "delete_volume" :: held 0.821s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:31 devstack sudo[106457]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11 Nov 01 12:39:31 devstack sudo[106457]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:31 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-bf6598b6-5345-43bd-a0a1-0cb106d85e0e tempest-ProjectReaderTests-532564148 None] Created reservations ['6083981b-9eb4-49f5-be3f-495397456121', '77cdb89d-c781-482e-b8a4-71f26d6e88bc', 'bc5b4d08-8cb6-4b81-ba47-8f091abb53cf', '61d3253b-c5f5-4414-9ffc-7a5fc4781972'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:39:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-bf6598b6-5345-43bd-a0a1-0cb106d85e0e tempest-ProjectReaderTests-532564148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-bf6598b6-5345-43bd-a0a1-0cb106d85e0e tempest-ProjectReaderTests-532564148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:31 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-bf6598b6-5345-43bd-a0a1-0cb106d85e0e tempest-ProjectReaderTests-532564148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:39:31 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-bf6598b6-5345-43bd-a0a1-0cb106d85e0e tempest-ProjectReaderTests-532564148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:39:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-bf6598b6-5345-43bd-a0a1-0cb106d85e0e tempest-ProjectReaderTests-532564148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bf6598b6-5345-43bd-a0a1-0cb106d85e0e tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:31 devstack sudo[106464]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:39:31 devstack sudo[106464]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:32 devstack sudo[106455]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6706c63c-2501-4c37-9853-7eaf07f86544 tempest-CinderUnicodeTest-1450523735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e.66f40e2d-afb8-40fb-b047-eebf2f0fbefe" returned: 0 in 0.465s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6706c63c-2501-4c37-9853-7eaf07f86544 tempest-CinderUnicodeTest-1450523735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e.66f40e2d-afb8-40fb-b047-eebf2f0fbefe {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:32 devstack sudo[106467]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e.66f40e2d-afb8-40fb-b047-eebf2f0fbefe Nov 01 12:39:32 devstack sudo[106467]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:32 devstack sudo[106457]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1c08ef4c-b3f9-4319-8cba-0fb9c17bfcc2 tempest-ProjectMemberTests-538781697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11" returned: 0 in 0.569s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1c08ef4c-b3f9-4319-8cba-0fb9c17bfcc2 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11.9fec2637-12d3-4664-b6a1-2a5e2dc54cf1 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:32 devstack sudo[106471]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11.9fec2637-12d3-4664-b6a1-2a5e2dc54cf1 1G Nov 01 12:39:32 devstack sudo[106471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:32 devstack sudo[106464]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bf6598b6-5345-43bd-a0a1-0cb106d85e0e tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.363s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:32 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-bf6598b6-5345-43bd-a0a1-0cb106d85e0e tempest-ProjectReaderTests-532564148 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:39:32 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-bf6598b6-5345-43bd-a0a1-0cb106d85e0e tempest-ProjectReaderTests-532564148 None] Deleted volume successfully. Nov 01 12:39:32 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-bf6598b6-5345-43bd-a0a1-0cb106d85e0e tempest-ProjectReaderTests-532564148 None] Lock "cinder-fc444066-6d85-4bf1-b93f-4525b86f5903-delete_volume" released by "delete_volume" :: held 1.466s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:32 devstack sudo[106467]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-6706c63c-2501-4c37-9853-7eaf07f86544 tempest-CinderUnicodeTest-1450523735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e.66f40e2d-afb8-40fb-b047-eebf2f0fbefe" returned: 0 in 0.348s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:32 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6706c63c-2501-4c37-9853-7eaf07f86544 tempest-CinderUnicodeTest-1450523735 None] Lock "cinder-quobyte-66f40e2d-afb8-40fb-b047-eebf2f0fbefe" released by "_delete_snapshot" :: held 2.052s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:32 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6706c63c-2501-4c37-9853-7eaf07f86544 tempest-CinderUnicodeTest-1450523735 None] Lock "cinder-quobyte-cfb69611-53c5-4ef4-afb8-a448e20ea29e" released by "delete_snapshot" :: held 2.111s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:32 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-6706c63c-2501-4c37-9853-7eaf07f86544 tempest-CinderUnicodeTest-1450523735 None] Created reservations ['12b1e07b-cb57-46bb-a849-4062f42d0ca8', '03ec3189-fa63-40a4-813b-7bed223e66ea', '985e70f2-5d80-47ce-953b-118a9f7ceb62', '8ced1fa3-ca7b-45a4-bd99-8cdea54ca207'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:39:32 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-6706c63c-2501-4c37-9853-7eaf07f86544 tempest-CinderUnicodeTest-1450523735 None] Delete snapshot completed successfully. Nov 01 12:39:32 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-6706c63c-2501-4c37-9853-7eaf07f86544 tempest-CinderUnicodeTest-1450523735 None] Lock "cinder-66f40e2d-afb8-40fb-b047-eebf2f0fbefe-delete_snapshot" released by "delete_snapshot" :: held 2.367s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:32 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-040d7bdc-9719-4be1-bec0-7879f72b2522 tempest-ProjectReaderTests-532564148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:39:32 devstack sudo[106471]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-040d7bdc-9719-4be1-bec0-7879f72b2522 tempest-ProjectReaderTests-532564148 None] Flow 'volume_create_manager' (db64dccc-370e-4eb7-a58d-2d3e4653f790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:39:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-040d7bdc-9719-4be1-bec0-7879f72b2522 tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d466ff16-06d8-476a-a21d-183ef5384c85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1c08ef4c-b3f9-4319-8cba-0fb9c17bfcc2 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11.9fec2637-12d3-4664-b6a1-2a5e2dc54cf1 1G" returned: 0 in 0.633s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1c08ef4c-b3f9-4319-8cba-0fb9c17bfcc2 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11.9fec2637-12d3-4664-b6a1-2a5e2dc54cf1 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-040d7bdc-9719-4be1-bec0-7879f72b2522 tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d466ff16-06d8-476a-a21d-183ef5384c85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-498261188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24b3cd0a-0c9a-441a-8c37-8c6fd33eb142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='129b361527b34b0ab7e69215b88d2dad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:39:33Z,use_quota=True,user_id='2e13b273b0034c9683a67046323971d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:32 devstack sudo[106479]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11.9fec2637-12d3-4664-b6a1-2a5e2dc54cf1 Nov 01 12:39:32 devstack sudo[106479]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-040d7bdc-9719-4be1-bec0-7879f72b2522 tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb69c345-3db5-4fa1-a5ed-f0d9c0dcc5d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-040d7bdc-9719-4be1-bec0-7879f72b2522 tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb69c345-3db5-4fa1-a5ed-f0d9c0dcc5d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-040d7bdc-9719-4be1-bec0-7879f72b2522 tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8827365-6016-4feb-b674-b463d2556d38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-040d7bdc-9719-4be1-bec0-7879f72b2522 tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b8827365-6016-4feb-b674-b463d2556d38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '24b3cd0a-0c9a-441a-8c37-8c6fd33eb142', 'volume_name': 'volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-040d7bdc-9719-4be1-bec0-7879f72b2522 tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (796ff0df-3c21-4626-bd8f-6e70ce55c3d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-040d7bdc-9719-4be1-bec0-7879f72b2522 tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (796ff0df-3c21-4626-bd8f-6e70ce55c3d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:32 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-040d7bdc-9719-4be1-bec0-7879f72b2522 tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e69d4cb-604b-4927-8ad3-d43d7ad4dc88) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:32 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-040d7bdc-9719-4be1-bec0-7879f72b2522 tempest-ProjectReaderTests-532564148 None] Volume 24b3cd0a-0c9a-441a-8c37-8c6fd33eb142: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142', 'volume_size': 1} Nov 01 12:39:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-040d7bdc-9719-4be1-bec0-7879f72b2522 tempest-ProjectReaderTests-532564148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:33 devstack sudo[106479]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1c08ef4c-b3f9-4319-8cba-0fb9c17bfcc2 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11.9fec2637-12d3-4664-b6a1-2a5e2dc54cf1" returned: 0 in 0.310s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:33 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-1c08ef4c-b3f9-4319-8cba-0fb9c17bfcc2 tempest-ProjectMemberTests-538781697 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11.9fec2637-12d3-4664-b6a1-2a5e2dc54cf1 is being set with open permissions: ugo+rw Nov 01 12:39:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1c08ef4c-b3f9-4319-8cba-0fb9c17bfcc2 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11.9fec2637-12d3-4664-b6a1-2a5e2dc54cf1 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:33 devstack sudo[106484]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11.9fec2637-12d3-4664-b6a1-2a5e2dc54cf1 Nov 01 12:39:33 devstack sudo[106484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:33 devstack sudo[106484]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1c08ef4c-b3f9-4319-8cba-0fb9c17bfcc2 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11.9fec2637-12d3-4664-b6a1-2a5e2dc54cf1" returned: 0 in 0.258s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1c08ef4c-b3f9-4319-8cba-0fb9c17bfcc2 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:33 devstack sudo[106487]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11.info Nov 01 12:39:33 devstack sudo[106487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:33 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e68fa200-551d-4d68-80d9-ddc732200c5b tempest-CinderUnicodeTest-1450523735 None] Acquiring lock "cinder-cfb69611-53c5-4ef4-afb8-a448e20ea29e-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:33 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e68fa200-551d-4d68-80d9-ddc732200c5b tempest-CinderUnicodeTest-1450523735 None] Lock "cinder-cfb69611-53c5-4ef4-afb8-a448e20ea29e-delete_volume" acquired by "delete_volume" :: waited 0.019s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:33 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e68fa200-551d-4d68-80d9-ddc732200c5b tempest-CinderUnicodeTest-1450523735 None] Acquiring lock "cinder-quobyte-cfb69611-53c5-4ef4-afb8-a448e20ea29e" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:33 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e68fa200-551d-4d68-80d9-ddc732200c5b tempest-CinderUnicodeTest-1450523735 None] Lock "cinder-quobyte-cfb69611-53c5-4ef4-afb8-a448e20ea29e" acquired by "delete_volume" :: waited 0.016s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:33 devstack sudo[106487]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1c08ef4c-b3f9-4319-8cba-0fb9c17bfcc2 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11.info" returned: 0 in 0.316s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:33 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-1c08ef4c-b3f9-4319-8cba-0fb9c17bfcc2 tempest-ProjectMemberTests-538781697 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11.info is being set with open permissions: ugo+rw Nov 01 12:39:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1c08ef4c-b3f9-4319-8cba-0fb9c17bfcc2 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:33 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[77d5369f-a2fd-43ed-b1c0-21b9ae2a33d7]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e68fa200-551d-4d68-80d9-ddc732200c5b tempest-CinderUnicodeTest-1450523735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:33 devstack sudo[106490]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11.info Nov 01 12:39:33 devstack sudo[106490]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:33 devstack sudo[106491]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e Nov 01 12:39:33 devstack sudo[106491]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:33 devstack sudo[106490]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1c08ef4c-b3f9-4319-8cba-0fb9c17bfcc2 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11.info" returned: 0 in 0.259s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-1c08ef4c-b3f9-4319-8cba-0fb9c17bfcc2 tempest-ProjectMemberTests-538781697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.489s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-040d7bdc-9719-4be1-bec0-7879f72b2522 tempest-ProjectReaderTests-532564148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.137s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:34 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-040d7bdc-9719-4be1-bec0-7879f72b2522 tempest-ProjectReaderTests-532564148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:39:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-498261188',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=24b3cd0a-0c9a-441a-8c37-8c6fd33eb142,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='129b361527b34b0ab7e69215b88d2dad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:39:33Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:39:33Z,use_quota=True,user_id='2e13b273b0034c9683a67046323971d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:39:34 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-040d7bdc-9719-4be1-bec0-7879f72b2522 tempest-ProjectReaderTests-532564148 None] Creating volume 24b3cd0a-0c9a-441a-8c37-8c6fd33eb142 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:39:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-040d7bdc-9719-4be1-bec0-7879f72b2522 tempest-ProjectReaderTests-532564148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-040d7bdc-9719-4be1-bec0-7879f72b2522 tempest-ProjectReaderTests-532564148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:34 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-040d7bdc-9719-4be1-bec0-7879f72b2522 tempest-ProjectReaderTests-532564148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:39:34 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-040d7bdc-9719-4be1-bec0-7879f72b2522 tempest-ProjectReaderTests-532564148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:39:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-040d7bdc-9719-4be1-bec0-7879f72b2522 tempest-ProjectReaderTests-532564148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:34 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-040d7bdc-9719-4be1-bec0-7879f72b2522 tempest-ProjectReaderTests-532564148 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:39:34 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-040d7bdc-9719-4be1-bec0-7879f72b2522 tempest-ProjectReaderTests-532564148 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:39:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-040d7bdc-9719-4be1-bec0-7879f72b2522 tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:34 devstack sudo[106495]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142 1073741824 Nov 01 12:39:34 devstack sudo[106495]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:34 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-1c08ef4c-b3f9-4319-8cba-0fb9c17bfcc2 tempest-ProjectMemberTests-538781697 None] Create snapshot completed successfully Nov 01 12:39:34 devstack sudo[106491]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e68fa200-551d-4d68-80d9-ddc732200c5b tempest-CinderUnicodeTest-1450523735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e" returned: 0 in 0.403s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e68fa200-551d-4d68-80d9-ddc732200c5b tempest-CinderUnicodeTest-1450523735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:34 devstack sudo[106500]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e Nov 01 12:39:34 devstack sudo[106500]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:34 devstack sudo[106500]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e68fa200-551d-4d68-80d9-ddc732200c5b tempest-CinderUnicodeTest-1450523735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-cfb69611-53c5-4ef4-afb8-a448e20ea29e" returned: 0 in 0.257s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:34 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e68fa200-551d-4d68-80d9-ddc732200c5b tempest-CinderUnicodeTest-1450523735 None] Lock "cinder-quobyte-cfb69611-53c5-4ef4-afb8-a448e20ea29e" released by "delete_volume" :: held 0.745s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:34 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-e68fa200-551d-4d68-80d9-ddc732200c5b tempest-CinderUnicodeTest-1450523735 None] Created reservations ['646439d0-ac32-441b-b12c-643cbc2c81f3', 'eb6d62b1-0f34-4087-80c3-a96722e16998', '383276bd-a9bf-444f-b8a8-a822a562c564', '3627b799-5f99-418e-8932-5d37d72ce373'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:39:34 devstack sudo[106495]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-040d7bdc-9719-4be1-bec0-7879f72b2522 tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142 1073741824" returned: 0 in 0.500s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e68fa200-551d-4d68-80d9-ddc732200c5b tempest-CinderUnicodeTest-1450523735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e68fa200-551d-4d68-80d9-ddc732200c5b tempest-CinderUnicodeTest-1450523735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:34 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e68fa200-551d-4d68-80d9-ddc732200c5b tempest-CinderUnicodeTest-1450523735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:39:34 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e68fa200-551d-4d68-80d9-ddc732200c5b tempest-CinderUnicodeTest-1450523735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:39:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e68fa200-551d-4d68-80d9-ddc732200c5b tempest-CinderUnicodeTest-1450523735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e68fa200-551d-4d68-80d9-ddc732200c5b tempest-CinderUnicodeTest-1450523735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-040d7bdc-9719-4be1-bec0-7879f72b2522 tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:34 devstack sudo[106507]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:39:34 devstack sudo[106507]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:34 devstack sudo[106508]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142 Nov 01 12:39:34 devstack sudo[106508]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:34 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d3c14cb5-843a-4628-a311-0cd8ed63fb12 tempest-ProjectMemberTests-538781697 None] Acquiring lock "cinder-9fec2637-12d3-4664-b6a1-2a5e2dc54cf1-delete_snapshot" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:34 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d3c14cb5-843a-4628-a311-0cd8ed63fb12 tempest-ProjectMemberTests-538781697 None] Lock "cinder-9fec2637-12d3-4664-b6a1-2a5e2dc54cf1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.031s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:34 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d3c14cb5-843a-4628-a311-0cd8ed63fb12 tempest-ProjectMemberTests-538781697 None] Acquiring lock "cinder-quobyte-dcf30b97-3e90-4fe8-aa72-af14223b1e11" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:34 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d3c14cb5-843a-4628-a311-0cd8ed63fb12 tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-dcf30b97-3e90-4fe8-aa72-af14223b1e11" acquired by "delete_snapshot" :: waited 0.046s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:34 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d3c14cb5-843a-4628-a311-0cd8ed63fb12 tempest-ProjectMemberTests-538781697 None] Acquiring lock "cinder-quobyte-9fec2637-12d3-4664-b6a1-2a5e2dc54cf1" by "_delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:34 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d3c14cb5-843a-4628-a311-0cd8ed63fb12 tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-9fec2637-12d3-4664-b6a1-2a5e2dc54cf1" acquired by "_delete_snapshot" :: waited 0.044s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:34 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-d3c14cb5-843a-4628-a311-0cd8ed63fb12 tempest-ProjectMemberTests-538781697 None] Deleting offline snapshot 9fec2637-12d3-4664-b6a1-2a5e2dc54cf1 of volume dcf30b97-3e90-4fe8-aa72-af14223b1e11 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:39:34 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-d3c14cb5-843a-4628-a311-0cd8ed63fb12 tempest-ProjectMemberTests-538781697 None] snapshot_file for this snap is: volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11.9fec2637-12d3-4664-b6a1-2a5e2dc54cf1 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:39:34 devstack sudo[106507]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:34 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f45f42ab-1d1e-44ac-9d64-fe2f5e5697cf tempest-CinderUnicodeTest-1450523735 None] Acquiring lock "cinder-992b90f4-4af0-497c-b5e8-400a3b27af2a-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:34 devstack sudo[106508]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:34 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[488fa266-0d65-4905-a76a-e7ea3cc6656c]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d3c14cb5-843a-4628-a311-0cd8ed63fb12 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11.9fec2637-12d3-4664-b6a1-2a5e2dc54cf1 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-040d7bdc-9719-4be1-bec0-7879f72b2522 tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142" returned: 0 in 0.399s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e68fa200-551d-4d68-80d9-ddc732200c5b tempest-CinderUnicodeTest-1450523735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.412s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:34 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-040d7bdc-9719-4be1-bec0-7879f72b2522 tempest-ProjectReaderTests-532564148 None] <== create_volume: return (967ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:39:34 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-040d7bdc-9719-4be1-bec0-7879f72b2522 tempest-ProjectReaderTests-532564148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:35 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-e68fa200-551d-4d68-80d9-ddc732200c5b tempest-CinderUnicodeTest-1450523735 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:39:35 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f45f42ab-1d1e-44ac-9d64-fe2f5e5697cf tempest-CinderUnicodeTest-1450523735 None] Lock "cinder-992b90f4-4af0-497c-b5e8-400a3b27af2a-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:35 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-e68fa200-551d-4d68-80d9-ddc732200c5b tempest-CinderUnicodeTest-1450523735 None] Deleted volume successfully. Nov 01 12:39:35 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-040d7bdc-9719-4be1-bec0-7879f72b2522 tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0e69d4cb-604b-4927-8ad3-d43d7ad4dc88) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:35 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-040d7bdc-9719-4be1-bec0-7879f72b2522 tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f0f4fdf-60d6-40eb-bfb8-4bfed1791afd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:35 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-040d7bdc-9719-4be1-bec0-7879f72b2522 tempest-ProjectReaderTests-532564148 None] Volume volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142 (24b3cd0a-0c9a-441a-8c37-8c6fd33eb142): created successfully Nov 01 12:39:35 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-040d7bdc-9719-4be1-bec0-7879f72b2522 tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0f0f4fdf-60d6-40eb-bfb8-4bfed1791afd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:35 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-040d7bdc-9719-4be1-bec0-7879f72b2522 tempest-ProjectReaderTests-532564148 None] Flow 'volume_create_manager' (db64dccc-370e-4eb7-a58d-2d3e4653f790) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:39:35 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e68fa200-551d-4d68-80d9-ddc732200c5b tempest-CinderUnicodeTest-1450523735 None] Lock "cinder-cfb69611-53c5-4ef4-afb8-a448e20ea29e-delete_volume" released by "delete_volume" :: held 1.450s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:35 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-040d7bdc-9719-4be1-bec0-7879f72b2522 tempest-ProjectReaderTests-532564148 None] Created volume successfully. Nov 01 12:39:35 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f45f42ab-1d1e-44ac-9d64-fe2f5e5697cf tempest-CinderUnicodeTest-1450523735 None] Acquiring lock "cinder-quobyte-992b90f4-4af0-497c-b5e8-400a3b27af2a" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:35 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f45f42ab-1d1e-44ac-9d64-fe2f5e5697cf tempest-CinderUnicodeTest-1450523735 None] Lock "cinder-quobyte-992b90f4-4af0-497c-b5e8-400a3b27af2a" acquired by "delete_volume" :: waited 0.022s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:35 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[fd25b8ed-1865-43c7-83bd-04290142cd8f]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f45f42ab-1d1e-44ac-9d64-fe2f5e5697cf tempest-CinderUnicodeTest-1450523735 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-992b90f4-4af0-497c-b5e8-400a3b27af2a {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:35 devstack sudo[106513]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11.9fec2637-12d3-4664-b6a1-2a5e2dc54cf1 Nov 01 12:39:35 devstack sudo[106513]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:35 devstack sudo[106514]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-992b90f4-4af0-497c-b5e8-400a3b27af2a Nov 01 12:39:35 devstack sudo[106514]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:35 devstack sudo[106513]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d3c14cb5-843a-4628-a311-0cd8ed63fb12 tempest-ProjectMemberTests-538781697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11.9fec2637-12d3-4664-b6a1-2a5e2dc54cf1" returned: 0 in 0.470s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:35 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-d3c14cb5-843a-4628-a311-0cd8ed63fb12 tempest-ProjectMemberTests-538781697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:39:35 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[6350cbe4-9815-4b79-aae0-417133d94ced]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d3c14cb5-843a-4628-a311-0cd8ed63fb12 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:35 devstack sudo[106514]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f45f42ab-1d1e-44ac-9d64-fe2f5e5697cf tempest-CinderUnicodeTest-1450523735 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-992b90f4-4af0-497c-b5e8-400a3b27af2a" returned: 0 in 0.451s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f45f42ab-1d1e-44ac-9d64-fe2f5e5697cf tempest-CinderUnicodeTest-1450523735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-992b90f4-4af0-497c-b5e8-400a3b27af2a {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:35 devstack sudo[106522]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11 Nov 01 12:39:35 devstack sudo[106522]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:35 devstack sudo[106524]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-992b90f4-4af0-497c-b5e8-400a3b27af2a Nov 01 12:39:35 devstack sudo[106524]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:35 devstack sudo[106524]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f45f42ab-1d1e-44ac-9d64-fe2f5e5697cf tempest-CinderUnicodeTest-1450523735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-992b90f4-4af0-497c-b5e8-400a3b27af2a" returned: 0 in 0.281s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:35 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f45f42ab-1d1e-44ac-9d64-fe2f5e5697cf tempest-CinderUnicodeTest-1450523735 None] Lock "cinder-quobyte-992b90f4-4af0-497c-b5e8-400a3b27af2a" released by "delete_volume" :: held 0.796s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:35 devstack sudo[106522]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d3c14cb5-843a-4628-a311-0cd8ed63fb12 tempest-ProjectMemberTests-538781697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11" returned: 0 in 0.444s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:35 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d3c14cb5-843a-4628-a311-0cd8ed63fb12 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11.9fec2637-12d3-4664-b6a1-2a5e2dc54cf1 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:35 devstack sudo[106531]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11.9fec2637-12d3-4664-b6a1-2a5e2dc54cf1 Nov 01 12:39:35 devstack sudo[106531]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:36 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-f45f42ab-1d1e-44ac-9d64-fe2f5e5697cf tempest-CinderUnicodeTest-1450523735 None] Created reservations ['2edd29b8-c65f-4cfe-a0e7-ceb34dda2abe', 'dadbffde-f45b-45c8-9758-7d3fb6fd213b', 'c38881d5-c745-467d-9d07-4c2f7ea4fce1', 'a4b21358-1504-4829-9ea5-35efa07e1d58'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:39:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f45f42ab-1d1e-44ac-9d64-fe2f5e5697cf tempest-CinderUnicodeTest-1450523735 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f45f42ab-1d1e-44ac-9d64-fe2f5e5697cf tempest-CinderUnicodeTest-1450523735 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:36 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f45f42ab-1d1e-44ac-9d64-fe2f5e5697cf tempest-CinderUnicodeTest-1450523735 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:39:36 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f45f42ab-1d1e-44ac-9d64-fe2f5e5697cf tempest-CinderUnicodeTest-1450523735 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:39:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f45f42ab-1d1e-44ac-9d64-fe2f5e5697cf tempest-CinderUnicodeTest-1450523735 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f45f42ab-1d1e-44ac-9d64-fe2f5e5697cf tempest-CinderUnicodeTest-1450523735 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:36 devstack sudo[106533]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:39:36 devstack sudo[106533]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8824831d-78d9-417e-abb0-eadcec6e65a1 tempest-ProjectReaderTests-532564148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8824831d-78d9-417e-abb0-eadcec6e65a1 tempest-ProjectReaderTests-532564148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:36 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-8824831d-78d9-417e-abb0-eadcec6e65a1 tempest-ProjectReaderTests-532564148 None] Creating offline snapshot 6829af81-9de1-4772-9b73-2b1b561b963a of volume 24b3cd0a-0c9a-441a-8c37-8c6fd33eb142 {{(pid=86574) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:39:36 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[4adfddc9-4350-4cb9-b783-abcb919b8ae1]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8824831d-78d9-417e-abb0-eadcec6e65a1 tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:36 devstack sudo[106531]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d3c14cb5-843a-4628-a311-0cd8ed63fb12 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11.9fec2637-12d3-4664-b6a1-2a5e2dc54cf1" returned: 0 in 0.547s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d3c14cb5-843a-4628-a311-0cd8ed63fb12 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11.9fec2637-12d3-4664-b6a1-2a5e2dc54cf1 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:36 devstack sudo[106539]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142 Nov 01 12:39:36 devstack sudo[106539]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:36 devstack sudo[106533]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f45f42ab-1d1e-44ac-9d64-fe2f5e5697cf tempest-CinderUnicodeTest-1450523735 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.435s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:36 devstack sudo[106541]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11.9fec2637-12d3-4664-b6a1-2a5e2dc54cf1 Nov 01 12:39:36 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-f45f42ab-1d1e-44ac-9d64-fe2f5e5697cf tempest-CinderUnicodeTest-1450523735 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:39:36 devstack sudo[106541]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:36 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-f45f42ab-1d1e-44ac-9d64-fe2f5e5697cf tempest-CinderUnicodeTest-1450523735 None] Deleted volume successfully. Nov 01 12:39:36 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f45f42ab-1d1e-44ac-9d64-fe2f5e5697cf tempest-CinderUnicodeTest-1450523735 None] Lock "cinder-992b90f4-4af0-497c-b5e8-400a3b27af2a-delete_volume" released by "delete_volume" :: held 1.590s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:36 devstack sudo[106541]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d3c14cb5-843a-4628-a311-0cd8ed63fb12 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11.9fec2637-12d3-4664-b6a1-2a5e2dc54cf1" returned: 0 in 0.357s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:36 devstack sudo[106539]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8824831d-78d9-417e-abb0-eadcec6e65a1 tempest-ProjectReaderTests-532564148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142" returned: 0 in 0.550s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:36 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8824831d-78d9-417e-abb0-eadcec6e65a1 tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142.6829af81-9de1-4772-9b73-2b1b561b963a 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:36 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d3c14cb5-843a-4628-a311-0cd8ed63fb12 tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-9fec2637-12d3-4664-b6a1-2a5e2dc54cf1" released by "_delete_snapshot" :: held 1.989s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:36 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d3c14cb5-843a-4628-a311-0cd8ed63fb12 tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-dcf30b97-3e90-4fe8-aa72-af14223b1e11" released by "delete_snapshot" :: held 2.050s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:36 devstack sudo[106549]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142.6829af81-9de1-4772-9b73-2b1b561b963a 1G Nov 01 12:39:36 devstack sudo[106549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:36 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-d3c14cb5-843a-4628-a311-0cd8ed63fb12 tempest-ProjectMemberTests-538781697 None] Created reservations ['3726aa9c-bc8d-46c7-b7f6-bafebe9cf526', '7f199ff9-2822-4486-b3a2-83ce84a43937', '806ac194-add7-4b54-ae04-a044722c00fa', 'f767960a-9ca8-4f42-92ee-dbff2f0b5cb0'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:39:37 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-d3c14cb5-843a-4628-a311-0cd8ed63fb12 tempest-ProjectMemberTests-538781697 None] Delete snapshot completed successfully. Nov 01 12:39:37 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d3c14cb5-843a-4628-a311-0cd8ed63fb12 tempest-ProjectMemberTests-538781697 None] Lock "cinder-9fec2637-12d3-4664-b6a1-2a5e2dc54cf1-delete_snapshot" released by "delete_snapshot" :: held 2.272s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:37 devstack sudo[106549]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8824831d-78d9-417e-abb0-eadcec6e65a1 tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142.6829af81-9de1-4772-9b73-2b1b561b963a 1G" returned: 0 in 0.561s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8824831d-78d9-417e-abb0-eadcec6e65a1 tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142.6829af81-9de1-4772-9b73-2b1b561b963a {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:37 devstack sudo[106555]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142.6829af81-9de1-4772-9b73-2b1b561b963a Nov 01 12:39:37 devstack sudo[106555]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:37 devstack sudo[106555]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8824831d-78d9-417e-abb0-eadcec6e65a1 tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142.6829af81-9de1-4772-9b73-2b1b561b963a" returned: 0 in 0.354s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:37 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-8824831d-78d9-417e-abb0-eadcec6e65a1 tempest-ProjectReaderTests-532564148 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142.6829af81-9de1-4772-9b73-2b1b561b963a is being set with open permissions: ugo+rw Nov 01 12:39:37 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8824831d-78d9-417e-abb0-eadcec6e65a1 tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142.6829af81-9de1-4772-9b73-2b1b561b963a {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:37 devstack sudo[106560]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142.6829af81-9de1-4772-9b73-2b1b561b963a Nov 01 12:39:37 devstack sudo[106560]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:38 devstack sudo[106560]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8824831d-78d9-417e-abb0-eadcec6e65a1 tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142.6829af81-9de1-4772-9b73-2b1b561b963a" returned: 0 in 0.285s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8824831d-78d9-417e-abb0-eadcec6e65a1 tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:38 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-1aa4f701-ac92-44d8-9e18-bc141401b47c tempest-ProjectMemberTests-538781697 None] Acquiring lock "cinder-dcf30b97-3e90-4fe8-aa72-af14223b1e11-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:38 devstack sudo[106563]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142.info Nov 01 12:39:38 devstack sudo[106563]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:38 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-1aa4f701-ac92-44d8-9e18-bc141401b47c tempest-ProjectMemberTests-538781697 None] Lock "cinder-dcf30b97-3e90-4fe8-aa72-af14223b1e11-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:38 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-1aa4f701-ac92-44d8-9e18-bc141401b47c tempest-ProjectMemberTests-538781697 None] Acquiring lock "cinder-quobyte-dcf30b97-3e90-4fe8-aa72-af14223b1e11" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:38 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-1aa4f701-ac92-44d8-9e18-bc141401b47c tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-dcf30b97-3e90-4fe8-aa72-af14223b1e11" acquired by "delete_volume" :: waited 0.027s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:38 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[c6a5beef-c2cb-4962-9c82-8139f0871490]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1aa4f701-ac92-44d8-9e18-bc141401b47c tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:38 devstack sudo[106563]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8824831d-78d9-417e-abb0-eadcec6e65a1 tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142.info" returned: 0 in 0.363s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:38 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-8824831d-78d9-417e-abb0-eadcec6e65a1 tempest-ProjectReaderTests-532564148 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142.info is being set with open permissions: ugo+rw Nov 01 12:39:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8824831d-78d9-417e-abb0-eadcec6e65a1 tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:38 devstack sudo[106567]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142.info Nov 01 12:39:38 devstack sudo[106567]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:38 devstack sudo[106565]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11 Nov 01 12:39:38 devstack sudo[106565]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:38 devstack sudo[106567]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8824831d-78d9-417e-abb0-eadcec6e65a1 tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142.info" returned: 0 in 0.347s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8824831d-78d9-417e-abb0-eadcec6e65a1 tempest-ProjectReaderTests-532564148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.609s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:38 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-8824831d-78d9-417e-abb0-eadcec6e65a1 tempest-ProjectReaderTests-532564148 None] Create snapshot completed successfully Nov 01 12:39:38 devstack sudo[106565]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1aa4f701-ac92-44d8-9e18-bc141401b47c tempest-ProjectMemberTests-538781697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11" returned: 0 in 0.539s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:38 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1aa4f701-ac92-44d8-9e18-bc141401b47c tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:38 devstack sudo[106575]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11 Nov 01 12:39:38 devstack sudo[106575]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:39 devstack sudo[106575]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1aa4f701-ac92-44d8-9e18-bc141401b47c tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-dcf30b97-3e90-4fe8-aa72-af14223b1e11" returned: 0 in 0.286s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:39 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-1aa4f701-ac92-44d8-9e18-bc141401b47c tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-dcf30b97-3e90-4fe8-aa72-af14223b1e11" released by "delete_volume" :: held 0.943s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:39 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-1aa4f701-ac92-44d8-9e18-bc141401b47c tempest-ProjectMemberTests-538781697 None] Created reservations ['90f1303f-84d0-41fb-9c2f-f1254f0b3160', '6f7dbede-7582-4811-b692-c257eebca835', '7797165d-9ce3-4c40-8ee3-39ba8c70ae8c', '8cff1c4b-055f-46a8-9f96-bd2f4409eb6b'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:39:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-1aa4f701-ac92-44d8-9e18-bc141401b47c tempest-ProjectMemberTests-538781697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-1aa4f701-ac92-44d8-9e18-bc141401b47c tempest-ProjectMemberTests-538781697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-1aa4f701-ac92-44d8-9e18-bc141401b47c tempest-ProjectMemberTests-538781697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:39:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-1aa4f701-ac92-44d8-9e18-bc141401b47c tempest-ProjectMemberTests-538781697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:39:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-1aa4f701-ac92-44d8-9e18-bc141401b47c tempest-ProjectMemberTests-538781697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1aa4f701-ac92-44d8-9e18-bc141401b47c tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:39 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-63291e47-ba73-4adf-b83c-10115b56e755 tempest-ProjectReaderTests-532564148 None] Acquiring lock "cinder-6829af81-9de1-4772-9b73-2b1b561b963a-delete_snapshot" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:39 devstack sudo[106578]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:39:39 devstack sudo[106578]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:39 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-63291e47-ba73-4adf-b83c-10115b56e755 tempest-ProjectReaderTests-532564148 None] Lock "cinder-6829af81-9de1-4772-9b73-2b1b561b963a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.037s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:39 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-63291e47-ba73-4adf-b83c-10115b56e755 tempest-ProjectReaderTests-532564148 None] Acquiring lock "cinder-quobyte-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:39 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-63291e47-ba73-4adf-b83c-10115b56e755 tempest-ProjectReaderTests-532564148 None] Lock "cinder-quobyte-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:39 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-63291e47-ba73-4adf-b83c-10115b56e755 tempest-ProjectReaderTests-532564148 None] Acquiring lock "cinder-quobyte-6829af81-9de1-4772-9b73-2b1b561b963a" by "_delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:39 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-63291e47-ba73-4adf-b83c-10115b56e755 tempest-ProjectReaderTests-532564148 None] Lock "cinder-quobyte-6829af81-9de1-4772-9b73-2b1b561b963a" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-63291e47-ba73-4adf-b83c-10115b56e755 tempest-ProjectReaderTests-532564148 None] Deleting offline snapshot 6829af81-9de1-4772-9b73-2b1b561b963a of volume 24b3cd0a-0c9a-441a-8c37-8c6fd33eb142 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:39:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-63291e47-ba73-4adf-b83c-10115b56e755 tempest-ProjectReaderTests-532564148 None] snapshot_file for this snap is: volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142.6829af81-9de1-4772-9b73-2b1b561b963a {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:39:39 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[a6147526-f5b2-4839-a3c3-a63dec425dcb]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-63291e47-ba73-4adf-b83c-10115b56e755 tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142.6829af81-9de1-4772-9b73-2b1b561b963a {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:39 devstack sudo[106580]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142.6829af81-9de1-4772-9b73-2b1b561b963a Nov 01 12:39:39 devstack sudo[106580]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:39 devstack sudo[106578]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-1aa4f701-ac92-44d8-9e18-bc141401b47c tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.354s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:39 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-1aa4f701-ac92-44d8-9e18-bc141401b47c tempest-ProjectMemberTests-538781697 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:39:39 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-1aa4f701-ac92-44d8-9e18-bc141401b47c tempest-ProjectMemberTests-538781697 None] Deleted volume successfully. Nov 01 12:39:39 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-1aa4f701-ac92-44d8-9e18-bc141401b47c tempest-ProjectMemberTests-538781697 None] Lock "cinder-dcf30b97-3e90-4fe8-aa72-af14223b1e11-delete_volume" released by "delete_volume" :: held 1.641s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:39 devstack cinder-volume[86574]: DEBUG oslo_service.periodic_task [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86574) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:39:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:39:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:39:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:39 devstack sudo[106585]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:39:39 devstack sudo[106585]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:40 devstack sudo[106580]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-63291e47-ba73-4adf-b83c-10115b56e755 tempest-ProjectReaderTests-532564148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142.6829af81-9de1-4772-9b73-2b1b561b963a" returned: 0 in 0.432s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:40 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-63291e47-ba73-4adf-b83c-10115b56e755 tempest-ProjectReaderTests-532564148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:39:40 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[c700df75-93a0-4435-a521-9fd026552267]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-63291e47-ba73-4adf-b83c-10115b56e755 tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:40 devstack sudo[106588]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142 Nov 01 12:39:40 devstack sudo[106588]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:40 devstack sudo[106585]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.311s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:40 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:39:40 devstack cinder-volume[86574]: DEBUG oslo_service.periodic_task [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running periodic task VolumeManager._thread_info {{(pid=86574) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:39:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] thread count: 28 {{(pid=86574) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 12:39:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] thread info: [<_MainThread(MainThread, started 131331184930944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86574) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 12:39:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-9068a020-f9ac-419e-82b4-aae856003503 tempest-ProjectAdminTests-229998792 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.2.1', 'storage_protocol': 'quobyte', 'total_capacity_gb': 1773.9067420959473, 'free_capacity_gb': 1773.9067420959473, 'reserved_percentage': 0, 'QoS_support': False, 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=86574) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4830}} Nov 01 12:39:40 devstack sudo[106588]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-63291e47-ba73-4adf-b83c-10115b56e755 tempest-ProjectReaderTests-532564148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142" returned: 0 in 0.452s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-63291e47-ba73-4adf-b83c-10115b56e755 tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142.6829af81-9de1-4772-9b73-2b1b561b963a {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:40 devstack sudo[106594]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142.6829af81-9de1-4772-9b73-2b1b561b963a Nov 01 12:39:40 devstack sudo[106594]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:41 devstack sudo[106594]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-63291e47-ba73-4adf-b83c-10115b56e755 tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142.6829af81-9de1-4772-9b73-2b1b561b963a" returned: 0 in 0.514s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-63291e47-ba73-4adf-b83c-10115b56e755 tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142.6829af81-9de1-4772-9b73-2b1b561b963a {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:41 devstack sudo[106605]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142.6829af81-9de1-4772-9b73-2b1b561b963a Nov 01 12:39:41 devstack sudo[106605]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:41 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4c78ca1-c558-4f5e-b0a5-84d57049fe8f tempest-ProjectMemberTests-538781697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:39:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d4c78ca1-c558-4f5e-b0a5-84d57049fe8f tempest-ProjectMemberTests-538781697 None] Flow 'volume_create_manager' (b8ee59b2-3e88-4ddc-8da7-5bcf79d4c688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:39:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d4c78ca1-c558-4f5e-b0a5-84d57049fe8f tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aeed96d-6353-4529-8d2b-5a213479c28f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d4c78ca1-c558-4f5e-b0a5-84d57049fe8f tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0aeed96d-6353-4529-8d2b-5a213479c28f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1910945343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fe9a137-ac20-49fe-8d0f-608b6aa13813,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe0ffaf6cf1d4294aa9f030164447d48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:39:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:39:41Z,use_quota=True,user_id='f617cd7e548d4a989b479812bba708f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d4c78ca1-c558-4f5e-b0a5-84d57049fe8f tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da7fbc93-164b-4c9e-9f65-489abe8129ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d4c78ca1-c558-4f5e-b0a5-84d57049fe8f tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (da7fbc93-164b-4c9e-9f65-489abe8129ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d4c78ca1-c558-4f5e-b0a5-84d57049fe8f tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab364b8e-8d7f-4c1a-99c9-8aeabaebe1e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d4c78ca1-c558-4f5e-b0a5-84d57049fe8f tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ab364b8e-8d7f-4c1a-99c9-8aeabaebe1e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fe9a137-ac20-49fe-8d0f-608b6aa13813', 'volume_name': 'volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d4c78ca1-c558-4f5e-b0a5-84d57049fe8f tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02981bce-c8ce-466d-8f64-ea8f8052cce0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d4c78ca1-c558-4f5e-b0a5-84d57049fe8f tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02981bce-c8ce-466d-8f64-ea8f8052cce0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d4c78ca1-c558-4f5e-b0a5-84d57049fe8f tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f498f6e-4f7e-47c2-a345-01a41db312dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:41 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-d4c78ca1-c558-4f5e-b0a5-84d57049fe8f tempest-ProjectMemberTests-538781697 None] Volume 9fe9a137-ac20-49fe-8d0f-608b6aa13813: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813', 'volume_size': 1} Nov 01 12:39:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d4c78ca1-c558-4f5e-b0a5-84d57049fe8f tempest-ProjectMemberTests-538781697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d4c78ca1-c558-4f5e-b0a5-84d57049fe8f tempest-ProjectMemberTests-538781697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:41 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d4c78ca1-c558-4f5e-b0a5-84d57049fe8f tempest-ProjectMemberTests-538781697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:39:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1910945343',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fe9a137-ac20-49fe-8d0f-608b6aa13813,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe0ffaf6cf1d4294aa9f030164447d48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:39:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:39:41Z,use_quota=True,user_id='f617cd7e548d4a989b479812bba708f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:39:41 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-d4c78ca1-c558-4f5e-b0a5-84d57049fe8f tempest-ProjectMemberTests-538781697 None] Creating volume 9fe9a137-ac20-49fe-8d0f-608b6aa13813 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:39:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d4c78ca1-c558-4f5e-b0a5-84d57049fe8f tempest-ProjectMemberTests-538781697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d4c78ca1-c558-4f5e-b0a5-84d57049fe8f tempest-ProjectMemberTests-538781697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:41 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d4c78ca1-c558-4f5e-b0a5-84d57049fe8f tempest-ProjectMemberTests-538781697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:39:41 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d4c78ca1-c558-4f5e-b0a5-84d57049fe8f tempest-ProjectMemberTests-538781697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:39:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d4c78ca1-c558-4f5e-b0a5-84d57049fe8f tempest-ProjectMemberTests-538781697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:41 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d4c78ca1-c558-4f5e-b0a5-84d57049fe8f tempest-ProjectMemberTests-538781697 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:39:41 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-d4c78ca1-c558-4f5e-b0a5-84d57049fe8f tempest-ProjectMemberTests-538781697 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:39:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d4c78ca1-c558-4f5e-b0a5-84d57049fe8f tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:41 devstack sudo[106607]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813 1073741824 Nov 01 12:39:41 devstack sudo[106607]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:41 devstack sudo[106605]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-63291e47-ba73-4adf-b83c-10115b56e755 tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142.6829af81-9de1-4772-9b73-2b1b561b963a" returned: 0 in 0.290s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:41 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-63291e47-ba73-4adf-b83c-10115b56e755 tempest-ProjectReaderTests-532564148 None] Lock "cinder-quobyte-6829af81-9de1-4772-9b73-2b1b561b963a" released by "_delete_snapshot" :: held 1.840s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:41 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-63291e47-ba73-4adf-b83c-10115b56e755 tempest-ProjectReaderTests-532564148 None] Lock "cinder-quobyte-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142" released by "delete_snapshot" :: held 1.870s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:41 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-63291e47-ba73-4adf-b83c-10115b56e755 tempest-ProjectReaderTests-532564148 None] Created reservations ['6e6c588d-f39d-4374-bf52-db1b450e1757', 'ab94e339-177f-4020-af3a-74f199946128', 'd2fb689e-9edc-4136-951a-84c5306ce3ba', '9de0cd34-1cc9-4694-ab77-6e9c7bb51345'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:39:41 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-63291e47-ba73-4adf-b83c-10115b56e755 tempest-ProjectReaderTests-532564148 None] Delete snapshot completed successfully. Nov 01 12:39:41 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-63291e47-ba73-4adf-b83c-10115b56e755 tempest-ProjectReaderTests-532564148 None] Lock "cinder-6829af81-9de1-4772-9b73-2b1b561b963a-delete_snapshot" released by "delete_snapshot" :: held 2.060s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:41 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f59571a3-ac11-448d-ac4a-7b75e66ee8a3 tempest-ProjectReaderTests-532564148 None] Acquiring lock "cinder-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:41 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f59571a3-ac11-448d-ac4a-7b75e66ee8a3 tempest-ProjectReaderTests-532564148 None] Lock "cinder-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:41 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f59571a3-ac11-448d-ac4a-7b75e66ee8a3 tempest-ProjectReaderTests-532564148 None] Acquiring lock "cinder-quobyte-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:41 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f59571a3-ac11-448d-ac4a-7b75e66ee8a3 tempest-ProjectReaderTests-532564148 None] Lock "cinder-quobyte-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142" acquired by "delete_volume" :: waited 0.025s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:41 devstack sudo[106607]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d4c78ca1-c558-4f5e-b0a5-84d57049fe8f tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813 1073741824" returned: 0 in 0.630s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:41 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[f307b6ba-817d-4b17-9556-6760b3665898]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f59571a3-ac11-448d-ac4a-7b75e66ee8a3 tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d4c78ca1-c558-4f5e-b0a5-84d57049fe8f tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:41 devstack sudo[106615]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813 Nov 01 12:39:41 devstack sudo[106615]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:42 devstack sudo[106614]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142 Nov 01 12:39:42 devstack sudo[106614]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:42 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-eca06b60-a354-4deb-bc36-d97e4f1a1834 tempest-ProjectReaderTests-2039302514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:39:42 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-eca06b60-a354-4deb-bc36-d97e4f1a1834 tempest-ProjectReaderTests-2039302514 None] Flow 'volume_create_manager' (9afd11ed-25c0-4613-8845-6ee0d6a38b79) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:39:42 devstack sudo[106615]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:42 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-eca06b60-a354-4deb-bc36-d97e4f1a1834 tempest-ProjectReaderTests-2039302514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72db3845-d689-4c0a-a146-8eede0b9a5d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d4c78ca1-c558-4f5e-b0a5-84d57049fe8f tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813" returned: 0 in 0.358s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:42 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d4c78ca1-c558-4f5e-b0a5-84d57049fe8f tempest-ProjectMemberTests-538781697 None] <== create_volume: return (1066ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:39:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d4c78ca1-c558-4f5e-b0a5-84d57049fe8f tempest-ProjectMemberTests-538781697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:42 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-eca06b60-a354-4deb-bc36-d97e4f1a1834 tempest-ProjectReaderTests-2039302514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72db3845-d689-4c0a-a146-8eede0b9a5d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-262061972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=323fddfd-a698-4cba-899b-068873a7aab8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564088ebc4354b8fbf34e0ac8982116c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:39:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:39:42Z,use_quota=True,user_id='be3943bf34494e5ba60df3e43d8e8528',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:42 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-eca06b60-a354-4deb-bc36-d97e4f1a1834 tempest-ProjectReaderTests-2039302514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac9252f5-0c6b-4140-a293-905fd7f918a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:42 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-eca06b60-a354-4deb-bc36-d97e4f1a1834 tempest-ProjectReaderTests-2039302514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac9252f5-0c6b-4140-a293-905fd7f918a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:42 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-eca06b60-a354-4deb-bc36-d97e4f1a1834 tempest-ProjectReaderTests-2039302514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f42b4db-6128-4aa5-8de2-7807faae0c6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:42 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-eca06b60-a354-4deb-bc36-d97e4f1a1834 tempest-ProjectReaderTests-2039302514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3f42b4db-6128-4aa5-8de2-7807faae0c6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '323fddfd-a698-4cba-899b-068873a7aab8', 'volume_name': 'volume-323fddfd-a698-4cba-899b-068873a7aab8', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:42 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-eca06b60-a354-4deb-bc36-d97e4f1a1834 tempest-ProjectReaderTests-2039302514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd427a86-3e15-4bf5-8c16-9bac937f72b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:42 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-eca06b60-a354-4deb-bc36-d97e4f1a1834 tempest-ProjectReaderTests-2039302514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dd427a86-3e15-4bf5-8c16-9bac937f72b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:42 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-eca06b60-a354-4deb-bc36-d97e4f1a1834 tempest-ProjectReaderTests-2039302514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3fd9ccc-8e09-46fc-8ff1-312c229c2bbc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:42 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-eca06b60-a354-4deb-bc36-d97e4f1a1834 tempest-ProjectReaderTests-2039302514 None] Volume 323fddfd-a698-4cba-899b-068873a7aab8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-323fddfd-a698-4cba-899b-068873a7aab8', 'volume_size': 1} Nov 01 12:39:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-eca06b60-a354-4deb-bc36-d97e4f1a1834 tempest-ProjectReaderTests-2039302514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-eca06b60-a354-4deb-bc36-d97e4f1a1834 tempest-ProjectReaderTests-2039302514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:42 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-eca06b60-a354-4deb-bc36-d97e4f1a1834 tempest-ProjectReaderTests-2039302514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:39:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-262061972',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=323fddfd-a698-4cba-899b-068873a7aab8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564088ebc4354b8fbf34e0ac8982116c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:39:42Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:39:42Z,use_quota=True,user_id='be3943bf34494e5ba60df3e43d8e8528',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:39:42 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-eca06b60-a354-4deb-bc36-d97e4f1a1834 tempest-ProjectReaderTests-2039302514 None] Creating volume 323fddfd-a698-4cba-899b-068873a7aab8 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:39:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-eca06b60-a354-4deb-bc36-d97e4f1a1834 tempest-ProjectReaderTests-2039302514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-eca06b60-a354-4deb-bc36-d97e4f1a1834 tempest-ProjectReaderTests-2039302514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:42 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-eca06b60-a354-4deb-bc36-d97e4f1a1834 tempest-ProjectReaderTests-2039302514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:39:42 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-eca06b60-a354-4deb-bc36-d97e4f1a1834 tempest-ProjectReaderTests-2039302514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:39:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-eca06b60-a354-4deb-bc36-d97e4f1a1834 tempest-ProjectReaderTests-2039302514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:42 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-eca06b60-a354-4deb-bc36-d97e4f1a1834 tempest-ProjectReaderTests-2039302514 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:39:42 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-eca06b60-a354-4deb-bc36-d97e4f1a1834 tempest-ProjectReaderTests-2039302514 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:39:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eca06b60-a354-4deb-bc36-d97e4f1a1834 tempest-ProjectReaderTests-2039302514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-323fddfd-a698-4cba-899b-068873a7aab8 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:42 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d4c78ca1-c558-4f5e-b0a5-84d57049fe8f tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0f498f6e-4f7e-47c2-a345-01a41db312dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:42 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d4c78ca1-c558-4f5e-b0a5-84d57049fe8f tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7ca1a12-2290-4fa0-b6c5-512831b513ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:42 devstack sudo[106622]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-323fddfd-a698-4cba-899b-068873a7aab8 1073741824 Nov 01 12:39:42 devstack sudo[106622]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:42 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-d4c78ca1-c558-4f5e-b0a5-84d57049fe8f tempest-ProjectMemberTests-538781697 None] Volume volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813 (9fe9a137-ac20-49fe-8d0f-608b6aa13813): created successfully Nov 01 12:39:42 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d4c78ca1-c558-4f5e-b0a5-84d57049fe8f tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f7ca1a12-2290-4fa0-b6c5-512831b513ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:42 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d4c78ca1-c558-4f5e-b0a5-84d57049fe8f tempest-ProjectMemberTests-538781697 None] Flow 'volume_create_manager' (b8ee59b2-3e88-4ddc-8da7-5bcf79d4c688) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:39:42 devstack sudo[106614]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:42 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-d4c78ca1-c558-4f5e-b0a5-84d57049fe8f tempest-ProjectMemberTests-538781697 None] Created volume successfully. Nov 01 12:39:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f59571a3-ac11-448d-ac4a-7b75e66ee8a3 tempest-ProjectReaderTests-532564148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142" returned: 0 in 0.581s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f59571a3-ac11-448d-ac4a-7b75e66ee8a3 tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:42 devstack sudo[106625]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142 Nov 01 12:39:42 devstack sudo[106625]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:42 devstack sudo[106625]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f59571a3-ac11-448d-ac4a-7b75e66ee8a3 tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142" returned: 0 in 0.322s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:42 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f59571a3-ac11-448d-ac4a-7b75e66ee8a3 tempest-ProjectReaderTests-532564148 None] Lock "cinder-quobyte-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142" released by "delete_volume" :: held 0.976s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:42 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-f59571a3-ac11-448d-ac4a-7b75e66ee8a3 tempest-ProjectReaderTests-532564148 None] Created reservations ['b8be5a72-75e7-4ebe-83a8-fabd0b09bf41', '05447063-7759-49ea-95cb-a904d0c6c08c', 'a282dad1-3e66-46b3-be9a-0cbcade75171', 'e30245bb-ba18-4a26-bc21-4fbf9980c2e9'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:39:42 devstack sudo[106622]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eca06b60-a354-4deb-bc36-d97e4f1a1834 tempest-ProjectReaderTests-2039302514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-323fddfd-a698-4cba-899b-068873a7aab8 1073741824" returned: 0 in 0.528s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eca06b60-a354-4deb-bc36-d97e4f1a1834 tempest-ProjectReaderTests-2039302514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-323fddfd-a698-4cba-899b-068873a7aab8 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f59571a3-ac11-448d-ac4a-7b75e66ee8a3 tempest-ProjectReaderTests-532564148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f59571a3-ac11-448d-ac4a-7b75e66ee8a3 tempest-ProjectReaderTests-532564148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:42 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f59571a3-ac11-448d-ac4a-7b75e66ee8a3 tempest-ProjectReaderTests-532564148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:39:42 devstack sudo[106632]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-323fddfd-a698-4cba-899b-068873a7aab8 Nov 01 12:39:42 devstack sudo[106632]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:42 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f59571a3-ac11-448d-ac4a-7b75e66ee8a3 tempest-ProjectReaderTests-532564148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:39:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f59571a3-ac11-448d-ac4a-7b75e66ee8a3 tempest-ProjectReaderTests-532564148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f59571a3-ac11-448d-ac4a-7b75e66ee8a3 tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:43 devstack sudo[106634]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:39:43 devstack sudo[106634]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:43 devstack sudo[106632]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eca06b60-a354-4deb-bc36-d97e4f1a1834 tempest-ProjectReaderTests-2039302514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-323fddfd-a698-4cba-899b-068873a7aab8" returned: 0 in 0.274s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:43 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-eca06b60-a354-4deb-bc36-d97e4f1a1834 tempest-ProjectReaderTests-2039302514 None] <== create_volume: return (857ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:39:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-eca06b60-a354-4deb-bc36-d97e4f1a1834 tempest-ProjectReaderTests-2039302514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.860s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:43 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-eca06b60-a354-4deb-bc36-d97e4f1a1834 tempest-ProjectReaderTests-2039302514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a3fd9ccc-8e09-46fc-8ff1-312c229c2bbc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-323fddfd-a698-4cba-899b-068873a7aab8', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:43 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-eca06b60-a354-4deb-bc36-d97e4f1a1834 tempest-ProjectReaderTests-2039302514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a410096-5fe8-4f5c-b5c7-84090039b7b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:43 devstack sudo[106634]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f59571a3-ac11-448d-ac4a-7b75e66ee8a3 tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.290s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:43 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-f59571a3-ac11-448d-ac4a-7b75e66ee8a3 tempest-ProjectReaderTests-532564148 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:39:43 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-eca06b60-a354-4deb-bc36-d97e4f1a1834 tempest-ProjectReaderTests-2039302514 None] Volume volume-323fddfd-a698-4cba-899b-068873a7aab8 (323fddfd-a698-4cba-899b-068873a7aab8): created successfully Nov 01 12:39:43 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-eca06b60-a354-4deb-bc36-d97e4f1a1834 tempest-ProjectReaderTests-2039302514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9a410096-5fe8-4f5c-b5c7-84090039b7b5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:43 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-eca06b60-a354-4deb-bc36-d97e4f1a1834 tempest-ProjectReaderTests-2039302514 None] Flow 'volume_create_manager' (9afd11ed-25c0-4613-8845-6ee0d6a38b79) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:39:43 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-f59571a3-ac11-448d-ac4a-7b75e66ee8a3 tempest-ProjectReaderTests-532564148 None] Deleted volume successfully. Nov 01 12:39:43 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-eca06b60-a354-4deb-bc36-d97e4f1a1834 tempest-ProjectReaderTests-2039302514 None] Created volume successfully. Nov 01 12:39:43 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f59571a3-ac11-448d-ac4a-7b75e66ee8a3 tempest-ProjectReaderTests-532564148 None] Lock "cinder-24b3cd0a-0c9a-441a-8c37-8c6fd33eb142-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-c2f417f5-3729-4089-8f19-78a9b35043ed tempest-ProjectMemberTests-538781697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-c2f417f5-3729-4089-8f19-78a9b35043ed tempest-ProjectMemberTests-538781697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:43 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-c2f417f5-3729-4089-8f19-78a9b35043ed tempest-ProjectMemberTests-538781697 None] Creating offline snapshot c222a06b-0f71-4121-a291-f86c665ac91b of volume 9fe9a137-ac20-49fe-8d0f-608b6aa13813 {{(pid=86574) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:39:43 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[7244d8f5-3436-409e-b243-a71ce6138ea0]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c2f417f5-3729-4089-8f19-78a9b35043ed tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:43 devstack sudo[106638]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813 Nov 01 12:39:43 devstack sudo[106638]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:43 devstack sudo[106638]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c2f417f5-3729-4089-8f19-78a9b35043ed tempest-ProjectMemberTests-538781697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813" returned: 0 in 0.380s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c2f417f5-3729-4089-8f19-78a9b35043ed tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813.c222a06b-0f71-4121-a291-f86c665ac91b 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:43 devstack sudo[106643]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813.c222a06b-0f71-4121-a291-f86c665ac91b 1G Nov 01 12:39:43 devstack sudo[106643]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:44 devstack sudo[106643]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c2f417f5-3729-4089-8f19-78a9b35043ed tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813.c222a06b-0f71-4121-a291-f86c665ac91b 1G" returned: 0 in 0.517s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c2f417f5-3729-4089-8f19-78a9b35043ed tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813.c222a06b-0f71-4121-a291-f86c665ac91b {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:44 devstack sudo[106648]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813.c222a06b-0f71-4121-a291-f86c665ac91b Nov 01 12:39:44 devstack sudo[106648]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:44 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-89f7f8da-ae3e-4b52-80c2-ecab3be10c3e tempest-ProjectReaderTests-532564148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:39:44 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-89f7f8da-ae3e-4b52-80c2-ecab3be10c3e tempest-ProjectReaderTests-532564148 None] Flow 'volume_create_manager' (b1c96dd5-ad34-4174-bc8f-12d08c401caa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:39:44 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-89f7f8da-ae3e-4b52-80c2-ecab3be10c3e tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce9cef08-6ea0-49e6-bbc2-e75468849246) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:44 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-89f7f8da-ae3e-4b52-80c2-ecab3be10c3e tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ce9cef08-6ea0-49e6-bbc2-e75468849246) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:39:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2070486668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b0d915b-de04-4890-b393-bf028102c7a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='129b361527b34b0ab7e69215b88d2dad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:39:44Z,use_quota=True,user_id='2e13b273b0034c9683a67046323971d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:44 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-89f7f8da-ae3e-4b52-80c2-ecab3be10c3e tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f956e901-131c-4ef6-a310-524106e51ece) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:44 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-89f7f8da-ae3e-4b52-80c2-ecab3be10c3e tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f956e901-131c-4ef6-a310-524106e51ece) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:44 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-89f7f8da-ae3e-4b52-80c2-ecab3be10c3e tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeab0308-6bc4-4a68-8be7-2b0c167935b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:44 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-89f7f8da-ae3e-4b52-80c2-ecab3be10c3e tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aeab0308-6bc4-4a68-8be7-2b0c167935b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0b0d915b-de04-4890-b393-bf028102c7a8', 'volume_name': 'volume-0b0d915b-de04-4890-b393-bf028102c7a8', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:44 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-89f7f8da-ae3e-4b52-80c2-ecab3be10c3e tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f99f99e0-112f-42df-bdd5-146dc69bd705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:44 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-89f7f8da-ae3e-4b52-80c2-ecab3be10c3e tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f99f99e0-112f-42df-bdd5-146dc69bd705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:44 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-89f7f8da-ae3e-4b52-80c2-ecab3be10c3e tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c08634f-c0f7-48cf-9b3b-5873c0102aa5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:44 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-89f7f8da-ae3e-4b52-80c2-ecab3be10c3e tempest-ProjectReaderTests-532564148 None] Volume 0b0d915b-de04-4890-b393-bf028102c7a8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0b0d915b-de04-4890-b393-bf028102c7a8', 'volume_size': 1} Nov 01 12:39:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-89f7f8da-ae3e-4b52-80c2-ecab3be10c3e tempest-ProjectReaderTests-532564148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:44 devstack sudo[106648]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c2f417f5-3729-4089-8f19-78a9b35043ed tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813.c222a06b-0f71-4121-a291-f86c665ac91b" returned: 0 in 0.361s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:44 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-c2f417f5-3729-4089-8f19-78a9b35043ed tempest-ProjectMemberTests-538781697 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813.c222a06b-0f71-4121-a291-f86c665ac91b is being set with open permissions: ugo+rw Nov 01 12:39:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c2f417f5-3729-4089-8f19-78a9b35043ed tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813.c222a06b-0f71-4121-a291-f86c665ac91b {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:44 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ea43c9b1-4782-44b8-bb65-c7e6554270a0 tempest-ProjectReaderTests-2039302514 None] Acquiring lock "cinder-323fddfd-a698-4cba-899b-068873a7aab8-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:44 devstack sudo[106687]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813.c222a06b-0f71-4121-a291-f86c665ac91b Nov 01 12:39:44 devstack sudo[106687]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:44 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ea43c9b1-4782-44b8-bb65-c7e6554270a0 tempest-ProjectReaderTests-2039302514 None] Lock "cinder-323fddfd-a698-4cba-899b-068873a7aab8-delete_volume" acquired by "delete_volume" :: waited 0.025s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:44 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ea43c9b1-4782-44b8-bb65-c7e6554270a0 tempest-ProjectReaderTests-2039302514 None] Acquiring lock "cinder-quobyte-323fddfd-a698-4cba-899b-068873a7aab8" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:44 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ea43c9b1-4782-44b8-bb65-c7e6554270a0 tempest-ProjectReaderTests-2039302514 None] Lock "cinder-quobyte-323fddfd-a698-4cba-899b-068873a7aab8" acquired by "delete_volume" :: waited 0.018s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:44 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[d38d8860-22fe-4479-8b43-2a2b4fed5a87]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ea43c9b1-4782-44b8-bb65-c7e6554270a0 tempest-ProjectReaderTests-2039302514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-323fddfd-a698-4cba-899b-068873a7aab8 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:45 devstack sudo[106687]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c2f417f5-3729-4089-8f19-78a9b35043ed tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813.c222a06b-0f71-4121-a291-f86c665ac91b" returned: 0 in 0.304s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:45 devstack sudo[106689]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-323fddfd-a698-4cba-899b-068873a7aab8 Nov 01 12:39:45 devstack sudo[106689]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c2f417f5-3729-4089-8f19-78a9b35043ed tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:45 devstack sudo[106694]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813.info Nov 01 12:39:45 devstack sudo[106694]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:45 devstack sudo[106694]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c2f417f5-3729-4089-8f19-78a9b35043ed tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813.info" returned: 0 in 0.276s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:45 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-c2f417f5-3729-4089-8f19-78a9b35043ed tempest-ProjectMemberTests-538781697 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813.info is being set with open permissions: ugo+rw Nov 01 12:39:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c2f417f5-3729-4089-8f19-78a9b35043ed tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:45 devstack sudo[106700]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813.info Nov 01 12:39:45 devstack sudo[106700]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:45 devstack sudo[106689]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ea43c9b1-4782-44b8-bb65-c7e6554270a0 tempest-ProjectReaderTests-2039302514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-323fddfd-a698-4cba-899b-068873a7aab8" returned: 0 in 0.499s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ea43c9b1-4782-44b8-bb65-c7e6554270a0 tempest-ProjectReaderTests-2039302514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-323fddfd-a698-4cba-899b-068873a7aab8 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:45 devstack sudo[106702]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-323fddfd-a698-4cba-899b-068873a7aab8 Nov 01 12:39:45 devstack sudo[106702]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:45 devstack sudo[106700]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-c2f417f5-3729-4089-8f19-78a9b35043ed tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813.info" returned: 0 in 0.275s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-c2f417f5-3729-4089-8f19-78a9b35043ed tempest-ProjectMemberTests-538781697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.213s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-89f7f8da-ae3e-4b52-80c2-ecab3be10c3e tempest-ProjectReaderTests-532564148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.019s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:45 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-89f7f8da-ae3e-4b52-80c2-ecab3be10c3e tempest-ProjectReaderTests-532564148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:39:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2070486668',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0b0d915b-de04-4890-b393-bf028102c7a8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='129b361527b34b0ab7e69215b88d2dad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:39:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:39:44Z,use_quota=True,user_id='2e13b273b0034c9683a67046323971d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:39:45 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-89f7f8da-ae3e-4b52-80c2-ecab3be10c3e tempest-ProjectReaderTests-532564148 None] Creating volume 0b0d915b-de04-4890-b393-bf028102c7a8 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:39:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-89f7f8da-ae3e-4b52-80c2-ecab3be10c3e tempest-ProjectReaderTests-532564148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-89f7f8da-ae3e-4b52-80c2-ecab3be10c3e tempest-ProjectReaderTests-532564148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:45 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-89f7f8da-ae3e-4b52-80c2-ecab3be10c3e tempest-ProjectReaderTests-532564148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:39:45 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-89f7f8da-ae3e-4b52-80c2-ecab3be10c3e tempest-ProjectReaderTests-532564148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:39:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-89f7f8da-ae3e-4b52-80c2-ecab3be10c3e tempest-ProjectReaderTests-532564148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:45 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-89f7f8da-ae3e-4b52-80c2-ecab3be10c3e tempest-ProjectReaderTests-532564148 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:39:45 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-89f7f8da-ae3e-4b52-80c2-ecab3be10c3e tempest-ProjectReaderTests-532564148 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:39:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-89f7f8da-ae3e-4b52-80c2-ecab3be10c3e tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0b0d915b-de04-4890-b393-bf028102c7a8 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:45 devstack sudo[106702]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ea43c9b1-4782-44b8-bb65-c7e6554270a0 tempest-ProjectReaderTests-2039302514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-323fddfd-a698-4cba-899b-068873a7aab8" returned: 0 in 0.280s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:45 devstack sudo[106706]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0b0d915b-de04-4890-b393-bf028102c7a8 1073741824 Nov 01 12:39:45 devstack sudo[106706]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:45 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ea43c9b1-4782-44b8-bb65-c7e6554270a0 tempest-ProjectReaderTests-2039302514 None] Lock "cinder-quobyte-323fddfd-a698-4cba-899b-068873a7aab8" released by "delete_volume" :: held 0.851s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:45 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-c2f417f5-3729-4089-8f19-78a9b35043ed tempest-ProjectMemberTests-538781697 None] Create snapshot completed successfully Nov 01 12:39:45 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-ea43c9b1-4782-44b8-bb65-c7e6554270a0 tempest-ProjectReaderTests-2039302514 None] Created reservations ['4c589023-81d4-4a7c-a92a-d60cc42380b1', '7c9c666d-2d4c-4b5d-a3ff-0d6fb97c05f1', 'a44aa0d6-ae38-42e5-89ea-fef41fd6bd50', 'b7352bb6-52b7-40ad-a305-ebfe31c8e14c'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:39:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ea43c9b1-4782-44b8-bb65-c7e6554270a0 tempest-ProjectReaderTests-2039302514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ea43c9b1-4782-44b8-bb65-c7e6554270a0 tempest-ProjectReaderTests-2039302514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:45 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ea43c9b1-4782-44b8-bb65-c7e6554270a0 tempest-ProjectReaderTests-2039302514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:39:45 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-ea43c9b1-4782-44b8-bb65-c7e6554270a0 tempest-ProjectReaderTests-2039302514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:39:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-ea43c9b1-4782-44b8-bb65-c7e6554270a0 tempest-ProjectReaderTests-2039302514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ea43c9b1-4782-44b8-bb65-c7e6554270a0 tempest-ProjectReaderTests-2039302514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:45 devstack sudo[106708]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:39:45 devstack sudo[106708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:46 devstack sudo[106708]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ea43c9b1-4782-44b8-bb65-c7e6554270a0 tempest-ProjectReaderTests-2039302514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.313s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:46 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-ea43c9b1-4782-44b8-bb65-c7e6554270a0 tempest-ProjectReaderTests-2039302514 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:39:46 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-ea43c9b1-4782-44b8-bb65-c7e6554270a0 tempest-ProjectReaderTests-2039302514 None] Deleted volume successfully. Nov 01 12:39:46 devstack sudo[106706]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-89f7f8da-ae3e-4b52-80c2-ecab3be10c3e tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0b0d915b-de04-4890-b393-bf028102c7a8 1073741824" returned: 0 in 0.534s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:46 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ea43c9b1-4782-44b8-bb65-c7e6554270a0 tempest-ProjectReaderTests-2039302514 None] Lock "cinder-323fddfd-a698-4cba-899b-068873a7aab8-delete_volume" released by "delete_volume" :: held 1.442s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-89f7f8da-ae3e-4b52-80c2-ecab3be10c3e tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0b0d915b-de04-4890-b393-bf028102c7a8 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:46 devstack sudo[106715]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0b0d915b-de04-4890-b393-bf028102c7a8 Nov 01 12:39:46 devstack sudo[106715]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:46 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-8894e3f7-b69c-4ecd-8ab5-f883eb331013 tempest-ProjectReaderTests-2039302514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:39:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8894e3f7-b69c-4ecd-8ab5-f883eb331013 tempest-ProjectReaderTests-2039302514 None] Flow 'volume_create_manager' (2823b724-3f3c-4e48-ac3d-1e48c9fbbdb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:39:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8894e3f7-b69c-4ecd-8ab5-f883eb331013 tempest-ProjectReaderTests-2039302514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51f075a9-9c2c-4bdd-81af-ff4a72a293ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8894e3f7-b69c-4ecd-8ab5-f883eb331013 tempest-ProjectReaderTests-2039302514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (51f075a9-9c2c-4bdd-81af-ff4a72a293ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:39:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-9415212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f51c2a74-c40d-4700-80a6-b7ba1c32d965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564088ebc4354b8fbf34e0ac8982116c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:39:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:39:46Z,use_quota=True,user_id='be3943bf34494e5ba60df3e43d8e8528',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8894e3f7-b69c-4ecd-8ab5-f883eb331013 tempest-ProjectReaderTests-2039302514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82e39bb5-5319-453c-a52e-0056e7fb2395) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:46 devstack sudo[106715]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8894e3f7-b69c-4ecd-8ab5-f883eb331013 tempest-ProjectReaderTests-2039302514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (82e39bb5-5319-453c-a52e-0056e7fb2395) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8894e3f7-b69c-4ecd-8ab5-f883eb331013 tempest-ProjectReaderTests-2039302514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09cf8019-dc12-45c0-b56a-f927df6cdebe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8894e3f7-b69c-4ecd-8ab5-f883eb331013 tempest-ProjectReaderTests-2039302514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (09cf8019-dc12-45c0-b56a-f927df6cdebe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f51c2a74-c40d-4700-80a6-b7ba1c32d965', 'volume_name': 'volume-f51c2a74-c40d-4700-80a6-b7ba1c32d965', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8894e3f7-b69c-4ecd-8ab5-f883eb331013 tempest-ProjectReaderTests-2039302514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9144025b-247a-4e36-9f53-a81d325a7a96) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8894e3f7-b69c-4ecd-8ab5-f883eb331013 tempest-ProjectReaderTests-2039302514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9144025b-247a-4e36-9f53-a81d325a7a96) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8894e3f7-b69c-4ecd-8ab5-f883eb331013 tempest-ProjectReaderTests-2039302514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a292995e-5c39-4858-8549-65ff649d148a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:46 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-8894e3f7-b69c-4ecd-8ab5-f883eb331013 tempest-ProjectReaderTests-2039302514 None] Volume f51c2a74-c40d-4700-80a6-b7ba1c32d965: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f51c2a74-c40d-4700-80a6-b7ba1c32d965', 'volume_size': 1} Nov 01 12:39:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8894e3f7-b69c-4ecd-8ab5-f883eb331013 tempest-ProjectReaderTests-2039302514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-89f7f8da-ae3e-4b52-80c2-ecab3be10c3e tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0b0d915b-de04-4890-b393-bf028102c7a8" returned: 0 in 0.380s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:46 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-89f7f8da-ae3e-4b52-80c2-ecab3be10c3e tempest-ProjectReaderTests-532564148 None] <== create_volume: return (969ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:39:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-89f7f8da-ae3e-4b52-80c2-ecab3be10c3e tempest-ProjectReaderTests-532564148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.972s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8894e3f7-b69c-4ecd-8ab5-f883eb331013 tempest-ProjectReaderTests-2039302514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:46 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-8894e3f7-b69c-4ecd-8ab5-f883eb331013 tempest-ProjectReaderTests-2039302514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:39:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-9415212',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f51c2a74-c40d-4700-80a6-b7ba1c32d965,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564088ebc4354b8fbf34e0ac8982116c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:39:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:39:46Z,use_quota=True,user_id='be3943bf34494e5ba60df3e43d8e8528',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:39:46 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-8894e3f7-b69c-4ecd-8ab5-f883eb331013 tempest-ProjectReaderTests-2039302514 None] Creating volume f51c2a74-c40d-4700-80a6-b7ba1c32d965 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:39:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8894e3f7-b69c-4ecd-8ab5-f883eb331013 tempest-ProjectReaderTests-2039302514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8894e3f7-b69c-4ecd-8ab5-f883eb331013 tempest-ProjectReaderTests-2039302514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:46 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-8894e3f7-b69c-4ecd-8ab5-f883eb331013 tempest-ProjectReaderTests-2039302514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:39:46 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-8894e3f7-b69c-4ecd-8ab5-f883eb331013 tempest-ProjectReaderTests-2039302514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:39:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8894e3f7-b69c-4ecd-8ab5-f883eb331013 tempest-ProjectReaderTests-2039302514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:46 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-8894e3f7-b69c-4ecd-8ab5-f883eb331013 tempest-ProjectReaderTests-2039302514 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:39:46 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-8894e3f7-b69c-4ecd-8ab5-f883eb331013 tempest-ProjectReaderTests-2039302514 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:39:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8894e3f7-b69c-4ecd-8ab5-f883eb331013 tempest-ProjectReaderTests-2039302514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f51c2a74-c40d-4700-80a6-b7ba1c32d965 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:46 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b42f3fb9-2dba-4346-97d7-b5c0d7da4cdf tempest-ProjectMemberTests-538781697 None] Acquiring lock "cinder-c222a06b-0f71-4121-a291-f86c665ac91b-delete_snapshot" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:46 devstack sudo[106718]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f51c2a74-c40d-4700-80a6-b7ba1c32d965 1073741824 Nov 01 12:39:46 devstack sudo[106718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-89f7f8da-ae3e-4b52-80c2-ecab3be10c3e tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c08634f-c0f7-48cf-9b3b-5873c0102aa5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0b0d915b-de04-4890-b393-bf028102c7a8', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-89f7f8da-ae3e-4b52-80c2-ecab3be10c3e tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6868024-f803-4943-8fdf-7efe25db4704) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:46 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b42f3fb9-2dba-4346-97d7-b5c0d7da4cdf tempest-ProjectMemberTests-538781697 None] Lock "cinder-c222a06b-0f71-4121-a291-f86c665ac91b-delete_snapshot" acquired by "delete_snapshot" :: waited 0.052s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:46 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b42f3fb9-2dba-4346-97d7-b5c0d7da4cdf tempest-ProjectMemberTests-538781697 None] Acquiring lock "cinder-quobyte-9fe9a137-ac20-49fe-8d0f-608b6aa13813" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:46 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-89f7f8da-ae3e-4b52-80c2-ecab3be10c3e tempest-ProjectReaderTests-532564148 None] Volume volume-0b0d915b-de04-4890-b393-bf028102c7a8 (0b0d915b-de04-4890-b393-bf028102c7a8): created successfully Nov 01 12:39:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-89f7f8da-ae3e-4b52-80c2-ecab3be10c3e tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a6868024-f803-4943-8fdf-7efe25db4704) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:46 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-89f7f8da-ae3e-4b52-80c2-ecab3be10c3e tempest-ProjectReaderTests-532564148 None] Flow 'volume_create_manager' (b1c96dd5-ad34-4174-bc8f-12d08c401caa) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:39:46 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b42f3fb9-2dba-4346-97d7-b5c0d7da4cdf tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-9fe9a137-ac20-49fe-8d0f-608b6aa13813" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:46 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b42f3fb9-2dba-4346-97d7-b5c0d7da4cdf tempest-ProjectMemberTests-538781697 None] Acquiring lock "cinder-quobyte-c222a06b-0f71-4121-a291-f86c665ac91b" by "_delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:46 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-89f7f8da-ae3e-4b52-80c2-ecab3be10c3e tempest-ProjectReaderTests-532564148 None] Created volume successfully. Nov 01 12:39:46 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b42f3fb9-2dba-4346-97d7-b5c0d7da4cdf tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-c222a06b-0f71-4121-a291-f86c665ac91b" acquired by "_delete_snapshot" :: waited 0.025s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:46 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-b42f3fb9-2dba-4346-97d7-b5c0d7da4cdf tempest-ProjectMemberTests-538781697 None] Deleting offline snapshot c222a06b-0f71-4121-a291-f86c665ac91b of volume 9fe9a137-ac20-49fe-8d0f-608b6aa13813 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:39:46 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-b42f3fb9-2dba-4346-97d7-b5c0d7da4cdf tempest-ProjectMemberTests-538781697 None] snapshot_file for this snap is: volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813.c222a06b-0f71-4121-a291-f86c665ac91b {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:39:46 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[bfec4910-aafd-4f5f-a59d-74c905629ac8]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:46 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b42f3fb9-2dba-4346-97d7-b5c0d7da4cdf tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813.c222a06b-0f71-4121-a291-f86c665ac91b {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:46 devstack sudo[106720]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813.c222a06b-0f71-4121-a291-f86c665ac91b Nov 01 12:39:46 devstack sudo[106720]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:47 devstack sudo[106718]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8894e3f7-b69c-4ecd-8ab5-f883eb331013 tempest-ProjectReaderTests-2039302514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f51c2a74-c40d-4700-80a6-b7ba1c32d965 1073741824" returned: 0 in 0.558s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8894e3f7-b69c-4ecd-8ab5-f883eb331013 tempest-ProjectReaderTests-2039302514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f51c2a74-c40d-4700-80a6-b7ba1c32d965 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:47 devstack sudo[106720]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b42f3fb9-2dba-4346-97d7-b5c0d7da4cdf tempest-ProjectMemberTests-538781697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813.c222a06b-0f71-4121-a291-f86c665ac91b" returned: 0 in 0.430s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:47 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-b42f3fb9-2dba-4346-97d7-b5c0d7da4cdf tempest-ProjectMemberTests-538781697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:39:47 devstack sudo[106729]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f51c2a74-c40d-4700-80a6-b7ba1c32d965 Nov 01 12:39:47 devstack sudo[106729]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:47 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[3c1eb5d9-a121-47f9-9d7a-bd330b32df42]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b42f3fb9-2dba-4346-97d7-b5c0d7da4cdf tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:47 devstack sudo[106731]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813 Nov 01 12:39:47 devstack sudo[106731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:47 devstack sudo[106729]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8894e3f7-b69c-4ecd-8ab5-f883eb331013 tempest-ProjectReaderTests-2039302514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f51c2a74-c40d-4700-80a6-b7ba1c32d965" returned: 0 in 0.293s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:47 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-8894e3f7-b69c-4ecd-8ab5-f883eb331013 tempest-ProjectReaderTests-2039302514 None] <== create_volume: return (902ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:39:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8894e3f7-b69c-4ecd-8ab5-f883eb331013 tempest-ProjectReaderTests-2039302514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8894e3f7-b69c-4ecd-8ab5-f883eb331013 tempest-ProjectReaderTests-2039302514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a292995e-5c39-4858-8549-65ff649d148a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f51c2a74-c40d-4700-80a6-b7ba1c32d965', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8894e3f7-b69c-4ecd-8ab5-f883eb331013 tempest-ProjectReaderTests-2039302514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61b5dc83-b93c-4740-871d-8caca3b3a73c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:47 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-8894e3f7-b69c-4ecd-8ab5-f883eb331013 tempest-ProjectReaderTests-2039302514 None] Volume volume-f51c2a74-c40d-4700-80a6-b7ba1c32d965 (f51c2a74-c40d-4700-80a6-b7ba1c32d965): created successfully Nov 01 12:39:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8894e3f7-b69c-4ecd-8ab5-f883eb331013 tempest-ProjectReaderTests-2039302514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (61b5dc83-b93c-4740-871d-8caca3b3a73c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:47 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8894e3f7-b69c-4ecd-8ab5-f883eb331013 tempest-ProjectReaderTests-2039302514 None] Flow 'volume_create_manager' (2823b724-3f3c-4e48-ac3d-1e48c9fbbdb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:39:47 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-8894e3f7-b69c-4ecd-8ab5-f883eb331013 tempest-ProjectReaderTests-2039302514 None] Created volume successfully. Nov 01 12:39:47 devstack sudo[106731]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b42f3fb9-2dba-4346-97d7-b5c0d7da4cdf tempest-ProjectMemberTests-538781697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813" returned: 0 in 0.499s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b42f3fb9-2dba-4346-97d7-b5c0d7da4cdf tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813.c222a06b-0f71-4121-a291-f86c665ac91b {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:47 devstack sudo[106737]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813.c222a06b-0f71-4121-a291-f86c665ac91b Nov 01 12:39:47 devstack sudo[106737]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8d4fdfb9-2caf-4fb3-9c1e-5b77daa25f4c tempest-ProjectReaderTests-532564148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8d4fdfb9-2caf-4fb3-9c1e-5b77daa25f4c tempest-ProjectReaderTests-532564148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:47 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-8d4fdfb9-2caf-4fb3-9c1e-5b77daa25f4c tempest-ProjectReaderTests-532564148 None] Creating offline snapshot 7461e71b-3eaf-4f51-a1d8-9ac0f0060ac2 of volume 0b0d915b-de04-4890-b393-bf028102c7a8 {{(pid=86574) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:39:47 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[7e76a643-db8f-4503-86c6-09f9fb2b0b18]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:47 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8d4fdfb9-2caf-4fb3-9c1e-5b77daa25f4c tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0b0d915b-de04-4890-b393-bf028102c7a8 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:48 devstack sudo[106739]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0b0d915b-de04-4890-b393-bf028102c7a8 Nov 01 12:39:48 devstack sudo[106739]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:48 devstack sudo[106737]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b42f3fb9-2dba-4346-97d7-b5c0d7da4cdf tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813.c222a06b-0f71-4121-a291-f86c665ac91b" returned: 0 in 0.414s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b42f3fb9-2dba-4346-97d7-b5c0d7da4cdf tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813.c222a06b-0f71-4121-a291-f86c665ac91b {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:48 devstack sudo[106744]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813.c222a06b-0f71-4121-a291-f86c665ac91b Nov 01 12:39:48 devstack sudo[106744]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:48 devstack sudo[106739]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8d4fdfb9-2caf-4fb3-9c1e-5b77daa25f4c tempest-ProjectReaderTests-532564148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0b0d915b-de04-4890-b393-bf028102c7a8" returned: 0 in 0.434s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8d4fdfb9-2caf-4fb3-9c1e-5b77daa25f4c tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0b0d915b-de04-4890-b393-bf028102c7a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0b0d915b-de04-4890-b393-bf028102c7a8.7461e71b-3eaf-4f51-a1d8-9ac0f0060ac2 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:48 devstack sudo[106750]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0b0d915b-de04-4890-b393-bf028102c7a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0b0d915b-de04-4890-b393-bf028102c7a8.7461e71b-3eaf-4f51-a1d8-9ac0f0060ac2 1G Nov 01 12:39:48 devstack sudo[106750]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:48 devstack sudo[106744]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b42f3fb9-2dba-4346-97d7-b5c0d7da4cdf tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813.c222a06b-0f71-4121-a291-f86c665ac91b" returned: 0 in 0.296s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:48 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b42f3fb9-2dba-4346-97d7-b5c0d7da4cdf tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-c222a06b-0f71-4121-a291-f86c665ac91b" released by "_delete_snapshot" :: held 1.779s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:48 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b42f3fb9-2dba-4346-97d7-b5c0d7da4cdf tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-9fe9a137-ac20-49fe-8d0f-608b6aa13813" released by "delete_snapshot" :: held 1.816s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:48 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-b42f3fb9-2dba-4346-97d7-b5c0d7da4cdf tempest-ProjectMemberTests-538781697 None] Created reservations ['18675ae1-69d4-4dfa-8724-f9be922ae85d', 'b9298451-30fa-405a-afbb-aa8cd035c237', '0d3a3721-1290-47eb-a3cb-fcddca6f1d79', 'c8839765-edc7-4c73-ae2e-a19f70673b5f'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:39:48 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-86893855-886a-4c9b-98ea-22c5e2263307 tempest-ProjectReaderTests-2039302514 None] Acquiring lock "cinder-f51c2a74-c40d-4700-80a6-b7ba1c32d965-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:48 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-b42f3fb9-2dba-4346-97d7-b5c0d7da4cdf tempest-ProjectMemberTests-538781697 None] Delete snapshot completed successfully. Nov 01 12:39:48 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-86893855-886a-4c9b-98ea-22c5e2263307 tempest-ProjectReaderTests-2039302514 None] Lock "cinder-f51c2a74-c40d-4700-80a6-b7ba1c32d965-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:48 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b42f3fb9-2dba-4346-97d7-b5c0d7da4cdf tempest-ProjectMemberTests-538781697 None] Lock "cinder-c222a06b-0f71-4121-a291-f86c665ac91b-delete_snapshot" released by "delete_snapshot" :: held 2.030s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:48 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-86893855-886a-4c9b-98ea-22c5e2263307 tempest-ProjectReaderTests-2039302514 None] Acquiring lock "cinder-quobyte-f51c2a74-c40d-4700-80a6-b7ba1c32d965" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:48 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-86893855-886a-4c9b-98ea-22c5e2263307 tempest-ProjectReaderTests-2039302514 None] Lock "cinder-quobyte-f51c2a74-c40d-4700-80a6-b7ba1c32d965" acquired by "delete_volume" :: waited 0.025s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:48 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[48804da5-7d9b-46d9-a861-d87323b23594]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:48 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-86893855-886a-4c9b-98ea-22c5e2263307 tempest-ProjectReaderTests-2039302514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f51c2a74-c40d-4700-80a6-b7ba1c32d965 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:48 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-13ba1345-3f66-4920-93ec-7d68718708b4 tempest-ProjectMemberTests-538781697 None] Acquiring lock "cinder-9fe9a137-ac20-49fe-8d0f-608b6aa13813-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:48 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-13ba1345-3f66-4920-93ec-7d68718708b4 tempest-ProjectMemberTests-538781697 None] Lock "cinder-9fe9a137-ac20-49fe-8d0f-608b6aa13813-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:48 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-13ba1345-3f66-4920-93ec-7d68718708b4 tempest-ProjectMemberTests-538781697 None] Acquiring lock "cinder-quobyte-9fe9a137-ac20-49fe-8d0f-608b6aa13813" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:48 devstack sudo[106750]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8d4fdfb9-2caf-4fb3-9c1e-5b77daa25f4c tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0b0d915b-de04-4890-b393-bf028102c7a8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0b0d915b-de04-4890-b393-bf028102c7a8.7461e71b-3eaf-4f51-a1d8-9ac0f0060ac2 1G" returned: 0 in 0.609s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8d4fdfb9-2caf-4fb3-9c1e-5b77daa25f4c tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b0d915b-de04-4890-b393-bf028102c7a8 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0b0d915b-de04-4890-b393-bf028102c7a8.7461e71b-3eaf-4f51-a1d8-9ac0f0060ac2 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:49 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-13ba1345-3f66-4920-93ec-7d68718708b4 tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-9fe9a137-ac20-49fe-8d0f-608b6aa13813" acquired by "delete_volume" :: waited 0.033s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:49 devstack sudo[106757]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f51c2a74-c40d-4700-80a6-b7ba1c32d965 Nov 01 12:39:49 devstack sudo[106757]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:49 devstack sudo[106758]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b0d915b-de04-4890-b393-bf028102c7a8 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0b0d915b-de04-4890-b393-bf028102c7a8.7461e71b-3eaf-4f51-a1d8-9ac0f0060ac2 Nov 01 12:39:49 devstack sudo[106758]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:49 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[256f572c-82f3-4a10-a17c-6dc9e66fcaa8]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-13ba1345-3f66-4920-93ec-7d68718708b4 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:49 devstack sudo[106761]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813 Nov 01 12:39:49 devstack sudo[106761]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:49 devstack sudo[106757]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-86893855-886a-4c9b-98ea-22c5e2263307 tempest-ProjectReaderTests-2039302514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f51c2a74-c40d-4700-80a6-b7ba1c32d965" returned: 0 in 0.497s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-86893855-886a-4c9b-98ea-22c5e2263307 tempest-ProjectReaderTests-2039302514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f51c2a74-c40d-4700-80a6-b7ba1c32d965 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:49 devstack sudo[106758]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8d4fdfb9-2caf-4fb3-9c1e-5b77daa25f4c tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-0b0d915b-de04-4890-b393-bf028102c7a8 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0b0d915b-de04-4890-b393-bf028102c7a8.7461e71b-3eaf-4f51-a1d8-9ac0f0060ac2" returned: 0 in 0.381s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:49 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-8d4fdfb9-2caf-4fb3-9c1e-5b77daa25f4c tempest-ProjectReaderTests-532564148 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0b0d915b-de04-4890-b393-bf028102c7a8.7461e71b-3eaf-4f51-a1d8-9ac0f0060ac2 is being set with open permissions: ugo+rw Nov 01 12:39:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8d4fdfb9-2caf-4fb3-9c1e-5b77daa25f4c tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0b0d915b-de04-4890-b393-bf028102c7a8.7461e71b-3eaf-4f51-a1d8-9ac0f0060ac2 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:49 devstack sudo[106770]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f51c2a74-c40d-4700-80a6-b7ba1c32d965 Nov 01 12:39:49 devstack sudo[106770]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:49 devstack sudo[106771]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0b0d915b-de04-4890-b393-bf028102c7a8.7461e71b-3eaf-4f51-a1d8-9ac0f0060ac2 Nov 01 12:39:49 devstack sudo[106771]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:49 devstack sudo[106761]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-13ba1345-3f66-4920-93ec-7d68718708b4 tempest-ProjectMemberTests-538781697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813" returned: 0 in 0.465s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-13ba1345-3f66-4920-93ec-7d68718708b4 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:49 devstack sudo[106777]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813 Nov 01 12:39:49 devstack sudo[106777]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:49 devstack sudo[106770]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-86893855-886a-4c9b-98ea-22c5e2263307 tempest-ProjectReaderTests-2039302514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f51c2a74-c40d-4700-80a6-b7ba1c32d965" returned: 0 in 0.293s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:49 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-86893855-886a-4c9b-98ea-22c5e2263307 tempest-ProjectReaderTests-2039302514 None] Lock "cinder-quobyte-f51c2a74-c40d-4700-80a6-b7ba1c32d965" released by "delete_volume" :: held 0.852s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:49 devstack sudo[106771]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8d4fdfb9-2caf-4fb3-9c1e-5b77daa25f4c tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0b0d915b-de04-4890-b393-bf028102c7a8.7461e71b-3eaf-4f51-a1d8-9ac0f0060ac2" returned: 0 in 0.299s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8d4fdfb9-2caf-4fb3-9c1e-5b77daa25f4c tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0b0d915b-de04-4890-b393-bf028102c7a8.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:49 devstack sudo[106781]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0b0d915b-de04-4890-b393-bf028102c7a8.info Nov 01 12:39:49 devstack sudo[106781]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:49 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-86893855-886a-4c9b-98ea-22c5e2263307 tempest-ProjectReaderTests-2039302514 None] Created reservations ['e8277366-07af-4808-8ecb-4a0b96fe0c23', 'e63277fb-ccd9-43f5-8da3-02aaa289fbcb', '92397f05-76e7-4f32-ab10-78d03b684c70', '6dfe4de7-f465-4e2f-bc23-67ede6b7164b'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:39:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-86893855-886a-4c9b-98ea-22c5e2263307 tempest-ProjectReaderTests-2039302514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-86893855-886a-4c9b-98ea-22c5e2263307 tempest-ProjectReaderTests-2039302514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:49 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-86893855-886a-4c9b-98ea-22c5e2263307 tempest-ProjectReaderTests-2039302514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:39:49 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-86893855-886a-4c9b-98ea-22c5e2263307 tempest-ProjectReaderTests-2039302514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:39:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-86893855-886a-4c9b-98ea-22c5e2263307 tempest-ProjectReaderTests-2039302514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-86893855-886a-4c9b-98ea-22c5e2263307 tempest-ProjectReaderTests-2039302514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:49 devstack sudo[106777]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:49 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-13ba1345-3f66-4920-93ec-7d68718708b4 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fe9a137-ac20-49fe-8d0f-608b6aa13813" returned: 0 in 0.378s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:49 devstack sudo[106784]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:39:49 devstack sudo[106784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:49 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-13ba1345-3f66-4920-93ec-7d68718708b4 tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-9fe9a137-ac20-49fe-8d0f-608b6aa13813" released by "delete_volume" :: held 0.935s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:50 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-13ba1345-3f66-4920-93ec-7d68718708b4 tempest-ProjectMemberTests-538781697 None] Created reservations ['946cb1ad-1b27-4606-860b-0ec0980c746f', '5cc01323-b738-4abf-9e29-6634ca7d857b', '9670421d-1da8-40f7-af8b-6177d1a7d27f', 'a6ce0cd1-f50d-42f8-9bd7-23489aa45a1c'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:39:50 devstack sudo[106781]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8d4fdfb9-2caf-4fb3-9c1e-5b77daa25f4c tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0b0d915b-de04-4890-b393-bf028102c7a8.info" returned: 0 in 0.437s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:50 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-8d4fdfb9-2caf-4fb3-9c1e-5b77daa25f4c tempest-ProjectReaderTests-532564148 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0b0d915b-de04-4890-b393-bf028102c7a8.info is being set with open permissions: ugo+rw Nov 01 12:39:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8d4fdfb9-2caf-4fb3-9c1e-5b77daa25f4c tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0b0d915b-de04-4890-b393-bf028102c7a8.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-13ba1345-3f66-4920-93ec-7d68718708b4 tempest-ProjectMemberTests-538781697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-13ba1345-3f66-4920-93ec-7d68718708b4 tempest-ProjectMemberTests-538781697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:50 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-13ba1345-3f66-4920-93ec-7d68718708b4 tempest-ProjectMemberTests-538781697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:39:50 devstack sudo[106788]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0b0d915b-de04-4890-b393-bf028102c7a8.info Nov 01 12:39:50 devstack sudo[106784]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:50 devstack sudo[106788]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:50 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-13ba1345-3f66-4920-93ec-7d68718708b4 tempest-ProjectMemberTests-538781697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:39:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-13ba1345-3f66-4920-93ec-7d68718708b4 tempest-ProjectMemberTests-538781697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-13ba1345-3f66-4920-93ec-7d68718708b4 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-86893855-886a-4c9b-98ea-22c5e2263307 tempest-ProjectReaderTests-2039302514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.348s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:50 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-86893855-886a-4c9b-98ea-22c5e2263307 tempest-ProjectReaderTests-2039302514 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:39:50 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-86893855-886a-4c9b-98ea-22c5e2263307 tempest-ProjectReaderTests-2039302514 None] Deleted volume successfully. Nov 01 12:39:50 devstack sudo[106790]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:39:50 devstack sudo[106790]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:50 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-86893855-886a-4c9b-98ea-22c5e2263307 tempest-ProjectReaderTests-2039302514 None] Lock "cinder-f51c2a74-c40d-4700-80a6-b7ba1c32d965-delete_volume" released by "delete_volume" :: held 1.532s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:50 devstack sudo[106790]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-13ba1345-3f66-4920-93ec-7d68718708b4 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.361s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:50 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-13ba1345-3f66-4920-93ec-7d68718708b4 tempest-ProjectMemberTests-538781697 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:39:50 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-13ba1345-3f66-4920-93ec-7d68718708b4 tempest-ProjectMemberTests-538781697 None] Deleted volume successfully. Nov 01 12:39:50 devstack sudo[106788]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8d4fdfb9-2caf-4fb3-9c1e-5b77daa25f4c tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0b0d915b-de04-4890-b393-bf028102c7a8.info" returned: 0 in 0.448s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8d4fdfb9-2caf-4fb3-9c1e-5b77daa25f4c tempest-ProjectReaderTests-532564148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.718s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:50 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-13ba1345-3f66-4920-93ec-7d68718708b4 tempest-ProjectMemberTests-538781697 None] Lock "cinder-9fe9a137-ac20-49fe-8d0f-608b6aa13813-delete_volume" released by "delete_volume" :: held 1.700s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:50 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-8d4fdfb9-2caf-4fb3-9c1e-5b77daa25f4c tempest-ProjectReaderTests-532564148 None] Create snapshot completed successfully Nov 01 12:39:50 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-8249fbe2-80de-4c44-b44d-5a114f13d899 tempest-ProjectReaderTests-2039302514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:39:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8249fbe2-80de-4c44-b44d-5a114f13d899 tempest-ProjectReaderTests-2039302514 None] Flow 'volume_create_manager' (ca565820-346a-441c-ade5-d3920040d9a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:39:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8249fbe2-80de-4c44-b44d-5a114f13d899 tempest-ProjectReaderTests-2039302514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f271f2a5-1457-4a38-b982-d8f901ea53e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8249fbe2-80de-4c44-b44d-5a114f13d899 tempest-ProjectReaderTests-2039302514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f271f2a5-1457-4a38-b982-d8f901ea53e0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1502255524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=779f8b75-acad-40e3-96c6-d9845bf742fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564088ebc4354b8fbf34e0ac8982116c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:39:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:39:51Z,use_quota=True,user_id='be3943bf34494e5ba60df3e43d8e8528',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8249fbe2-80de-4c44-b44d-5a114f13d899 tempest-ProjectReaderTests-2039302514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a98b355e-131b-4a29-8f23-44ae0ed9267a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8249fbe2-80de-4c44-b44d-5a114f13d899 tempest-ProjectReaderTests-2039302514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a98b355e-131b-4a29-8f23-44ae0ed9267a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8249fbe2-80de-4c44-b44d-5a114f13d899 tempest-ProjectReaderTests-2039302514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac1714c1-9734-4d0a-84e3-76227fb41741) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8249fbe2-80de-4c44-b44d-5a114f13d899 tempest-ProjectReaderTests-2039302514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ac1714c1-9734-4d0a-84e3-76227fb41741) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '779f8b75-acad-40e3-96c6-d9845bf742fa', 'volume_name': 'volume-779f8b75-acad-40e3-96c6-d9845bf742fa', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8249fbe2-80de-4c44-b44d-5a114f13d899 tempest-ProjectReaderTests-2039302514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5d5904c-13c1-476c-b9ba-f9d568fe2108) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8249fbe2-80de-4c44-b44d-5a114f13d899 tempest-ProjectReaderTests-2039302514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f5d5904c-13c1-476c-b9ba-f9d568fe2108) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:50 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8249fbe2-80de-4c44-b44d-5a114f13d899 tempest-ProjectReaderTests-2039302514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7827745-a1bc-4c89-8498-84f8eb187a46) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:50 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-8249fbe2-80de-4c44-b44d-5a114f13d899 tempest-ProjectReaderTests-2039302514 None] Volume 779f8b75-acad-40e3-96c6-d9845bf742fa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-779f8b75-acad-40e3-96c6-d9845bf742fa', 'volume_size': 1} Nov 01 12:39:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8249fbe2-80de-4c44-b44d-5a114f13d899 tempest-ProjectReaderTests-2039302514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8249fbe2-80de-4c44-b44d-5a114f13d899 tempest-ProjectReaderTests-2039302514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:50 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-8249fbe2-80de-4c44-b44d-5a114f13d899 tempest-ProjectReaderTests-2039302514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:39:50Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1502255524',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=779f8b75-acad-40e3-96c6-d9845bf742fa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564088ebc4354b8fbf34e0ac8982116c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:39:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:39:51Z,use_quota=True,user_id='be3943bf34494e5ba60df3e43d8e8528',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:39:50 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-8249fbe2-80de-4c44-b44d-5a114f13d899 tempest-ProjectReaderTests-2039302514 None] Creating volume 779f8b75-acad-40e3-96c6-d9845bf742fa {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:39:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8249fbe2-80de-4c44-b44d-5a114f13d899 tempest-ProjectReaderTests-2039302514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8249fbe2-80de-4c44-b44d-5a114f13d899 tempest-ProjectReaderTests-2039302514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:50 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-8249fbe2-80de-4c44-b44d-5a114f13d899 tempest-ProjectReaderTests-2039302514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:39:50 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-8249fbe2-80de-4c44-b44d-5a114f13d899 tempest-ProjectReaderTests-2039302514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:39:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8249fbe2-80de-4c44-b44d-5a114f13d899 tempest-ProjectReaderTests-2039302514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:50 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-8249fbe2-80de-4c44-b44d-5a114f13d899 tempest-ProjectReaderTests-2039302514 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:39:50 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-8249fbe2-80de-4c44-b44d-5a114f13d899 tempest-ProjectReaderTests-2039302514 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:39:50 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8249fbe2-80de-4c44-b44d-5a114f13d899 tempest-ProjectReaderTests-2039302514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-779f8b75-acad-40e3-96c6-d9845bf742fa 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:50 devstack sudo[106794]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-779f8b75-acad-40e3-96c6-d9845bf742fa 1073741824 Nov 01 12:39:50 devstack sudo[106794]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:51 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-a2099d0a-5acb-434e-8150-aeea464258ba tempest-ProjectMemberTests-538781697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:39:51 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a2099d0a-5acb-434e-8150-aeea464258ba tempest-ProjectMemberTests-538781697 None] Flow 'volume_create_manager' (e5997579-8568-49bb-a2e1-d1c5dc23aa16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:39:51 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a2099d0a-5acb-434e-8150-aeea464258ba tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7ac4761-2b4c-41ee-b22e-2ce13ace1c29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:51 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a2099d0a-5acb-434e-8150-aeea464258ba tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c7ac4761-2b4c-41ee-b22e-2ce13ace1c29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:39:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1918270320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f08b6523-6890-4911-a692-7b7d49cb2b1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe0ffaf6cf1d4294aa9f030164447d48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:39:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:39:51Z,use_quota=True,user_id='f617cd7e548d4a989b479812bba708f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:51 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a2099d0a-5acb-434e-8150-aeea464258ba tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6ea9a78-3c9e-45d9-91ab-6059a06418f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:51 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a2099d0a-5acb-434e-8150-aeea464258ba tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e6ea9a78-3c9e-45d9-91ab-6059a06418f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:51 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a2099d0a-5acb-434e-8150-aeea464258ba tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6bf064a-e58d-496a-88f0-0a8bc65943e3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:51 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a2099d0a-5acb-434e-8150-aeea464258ba tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c6bf064a-e58d-496a-88f0-0a8bc65943e3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f08b6523-6890-4911-a692-7b7d49cb2b1b', 'volume_name': 'volume-f08b6523-6890-4911-a692-7b7d49cb2b1b', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:51 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a2099d0a-5acb-434e-8150-aeea464258ba tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26f39c82-3d4f-48bb-8f20-55d823ce87d1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:51 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a2099d0a-5acb-434e-8150-aeea464258ba tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (26f39c82-3d4f-48bb-8f20-55d823ce87d1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:51 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a2099d0a-5acb-434e-8150-aeea464258ba tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fdfe4c2-d0c7-402c-97bd-586435cab3d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:51 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-a2099d0a-5acb-434e-8150-aeea464258ba tempest-ProjectMemberTests-538781697 None] Volume f08b6523-6890-4911-a692-7b7d49cb2b1b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f08b6523-6890-4911-a692-7b7d49cb2b1b', 'volume_size': 1} Nov 01 12:39:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a2099d0a-5acb-434e-8150-aeea464258ba tempest-ProjectMemberTests-538781697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:51 devstack sudo[106794]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8249fbe2-80de-4c44-b44d-5a114f13d899 tempest-ProjectReaderTests-2039302514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-779f8b75-acad-40e3-96c6-d9845bf742fa 1073741824" returned: 0 in 0.445s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8249fbe2-80de-4c44-b44d-5a114f13d899 tempest-ProjectReaderTests-2039302514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-779f8b75-acad-40e3-96c6-d9845bf742fa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:51 devstack sudo[106800]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-779f8b75-acad-40e3-96c6-d9845bf742fa Nov 01 12:39:51 devstack sudo[106800]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:51 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-7ad072c3-ea1c-431d-8ea6-350d28cc63be tempest-ProjectReaderTests-532564148 None] Acquiring lock "cinder-7461e71b-3eaf-4f51-a1d8-9ac0f0060ac2-delete_snapshot" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:51 devstack sudo[106800]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8249fbe2-80de-4c44-b44d-5a114f13d899 tempest-ProjectReaderTests-2039302514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-779f8b75-acad-40e3-96c6-d9845bf742fa" returned: 0 in 0.271s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:51 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-8249fbe2-80de-4c44-b44d-5a114f13d899 tempest-ProjectReaderTests-2039302514 None] <== create_volume: return (755ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:39:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8249fbe2-80de-4c44-b44d-5a114f13d899 tempest-ProjectReaderTests-2039302514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.759s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a2099d0a-5acb-434e-8150-aeea464258ba tempest-ProjectMemberTests-538781697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.357s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:51 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a2099d0a-5acb-434e-8150-aeea464258ba tempest-ProjectMemberTests-538781697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:39:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1918270320',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f08b6523-6890-4911-a692-7b7d49cb2b1b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe0ffaf6cf1d4294aa9f030164447d48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:39:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:39:51Z,use_quota=True,user_id='f617cd7e548d4a989b479812bba708f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:39:51 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-a2099d0a-5acb-434e-8150-aeea464258ba tempest-ProjectMemberTests-538781697 None] Creating volume f08b6523-6890-4911-a692-7b7d49cb2b1b {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:39:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a2099d0a-5acb-434e-8150-aeea464258ba tempest-ProjectMemberTests-538781697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a2099d0a-5acb-434e-8150-aeea464258ba tempest-ProjectMemberTests-538781697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:51 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a2099d0a-5acb-434e-8150-aeea464258ba tempest-ProjectMemberTests-538781697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:39:51 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a2099d0a-5acb-434e-8150-aeea464258ba tempest-ProjectMemberTests-538781697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:39:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a2099d0a-5acb-434e-8150-aeea464258ba tempest-ProjectMemberTests-538781697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:51 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a2099d0a-5acb-434e-8150-aeea464258ba tempest-ProjectMemberTests-538781697 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:39:51 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-a2099d0a-5acb-434e-8150-aeea464258ba tempest-ProjectMemberTests-538781697 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:39:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a2099d0a-5acb-434e-8150-aeea464258ba tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f08b6523-6890-4911-a692-7b7d49cb2b1b 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:51 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-7ad072c3-ea1c-431d-8ea6-350d28cc63be tempest-ProjectReaderTests-532564148 None] Lock "cinder-7461e71b-3eaf-4f51-a1d8-9ac0f0060ac2-delete_snapshot" acquired by "delete_snapshot" :: waited 0.071s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:51 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-7ad072c3-ea1c-431d-8ea6-350d28cc63be tempest-ProjectReaderTests-532564148 None] Acquiring lock "cinder-quobyte-0b0d915b-de04-4890-b393-bf028102c7a8" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:51 devstack sudo[106803]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f08b6523-6890-4911-a692-7b7d49cb2b1b 1073741824 Nov 01 12:39:51 devstack sudo[106803]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:51 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8249fbe2-80de-4c44-b44d-5a114f13d899 tempest-ProjectReaderTests-2039302514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f7827745-a1bc-4c89-8498-84f8eb187a46) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-779f8b75-acad-40e3-96c6-d9845bf742fa', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:51 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8249fbe2-80de-4c44-b44d-5a114f13d899 tempest-ProjectReaderTests-2039302514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa4a8367-a60d-4528-9edb-0a93bc8e9268) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:51 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-7ad072c3-ea1c-431d-8ea6-350d28cc63be tempest-ProjectReaderTests-532564148 None] Lock "cinder-quobyte-0b0d915b-de04-4890-b393-bf028102c7a8" acquired by "delete_snapshot" :: waited 0.030s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:51 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-7ad072c3-ea1c-431d-8ea6-350d28cc63be tempest-ProjectReaderTests-532564148 None] Acquiring lock "cinder-quobyte-7461e71b-3eaf-4f51-a1d8-9ac0f0060ac2" by "_delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:51 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-8249fbe2-80de-4c44-b44d-5a114f13d899 tempest-ProjectReaderTests-2039302514 None] Volume volume-779f8b75-acad-40e3-96c6-d9845bf742fa (779f8b75-acad-40e3-96c6-d9845bf742fa): created successfully Nov 01 12:39:51 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8249fbe2-80de-4c44-b44d-5a114f13d899 tempest-ProjectReaderTests-2039302514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fa4a8367-a60d-4528-9edb-0a93bc8e9268) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:51 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-8249fbe2-80de-4c44-b44d-5a114f13d899 tempest-ProjectReaderTests-2039302514 None] Flow 'volume_create_manager' (ca565820-346a-441c-ade5-d3920040d9a5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:39:51 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-7ad072c3-ea1c-431d-8ea6-350d28cc63be tempest-ProjectReaderTests-532564148 None] Lock "cinder-quobyte-7461e71b-3eaf-4f51-a1d8-9ac0f0060ac2" acquired by "_delete_snapshot" :: waited 0.030s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:51 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-7ad072c3-ea1c-431d-8ea6-350d28cc63be tempest-ProjectReaderTests-532564148 None] Deleting offline snapshot 7461e71b-3eaf-4f51-a1d8-9ac0f0060ac2 of volume 0b0d915b-de04-4890-b393-bf028102c7a8 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:39:51 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-7ad072c3-ea1c-431d-8ea6-350d28cc63be tempest-ProjectReaderTests-532564148 None] snapshot_file for this snap is: volume-0b0d915b-de04-4890-b393-bf028102c7a8.7461e71b-3eaf-4f51-a1d8-9ac0f0060ac2 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:39:51 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-8249fbe2-80de-4c44-b44d-5a114f13d899 tempest-ProjectReaderTests-2039302514 None] Created volume successfully. Nov 01 12:39:51 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[3ab96351-4ddf-4225-8001-66ffcfb0e6d8]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7ad072c3-ea1c-431d-8ea6-350d28cc63be tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0b0d915b-de04-4890-b393-bf028102c7a8.7461e71b-3eaf-4f51-a1d8-9ac0f0060ac2 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:51 devstack sudo[106805]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0b0d915b-de04-4890-b393-bf028102c7a8.7461e71b-3eaf-4f51-a1d8-9ac0f0060ac2 Nov 01 12:39:51 devstack sudo[106805]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:52 devstack sudo[106803]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a2099d0a-5acb-434e-8150-aeea464258ba tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f08b6523-6890-4911-a692-7b7d49cb2b1b 1073741824" returned: 0 in 0.547s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:52 devstack sudo[106805]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7ad072c3-ea1c-431d-8ea6-350d28cc63be tempest-ProjectReaderTests-532564148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0b0d915b-de04-4890-b393-bf028102c7a8.7461e71b-3eaf-4f51-a1d8-9ac0f0060ac2" returned: 0 in 0.425s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:52 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-7ad072c3-ea1c-431d-8ea6-350d28cc63be tempest-ProjectReaderTests-532564148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-0b0d915b-de04-4890-b393-bf028102c7a8(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:39:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a2099d0a-5acb-434e-8150-aeea464258ba tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f08b6523-6890-4911-a692-7b7d49cb2b1b {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:52 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[a67a7541-9094-4e6e-bd92-7d8eb1b983cf]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7ad072c3-ea1c-431d-8ea6-350d28cc63be tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0b0d915b-de04-4890-b393-bf028102c7a8 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:52 devstack sudo[106814]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f08b6523-6890-4911-a692-7b7d49cb2b1b Nov 01 12:39:52 devstack sudo[106814]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:52 devstack sudo[106815]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0b0d915b-de04-4890-b393-bf028102c7a8 Nov 01 12:39:52 devstack sudo[106815]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:52 devstack sudo[106814]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-a2099d0a-5acb-434e-8150-aeea464258ba tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f08b6523-6890-4911-a692-7b7d49cb2b1b" returned: 0 in 0.281s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:52 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-a2099d0a-5acb-434e-8150-aeea464258ba tempest-ProjectMemberTests-538781697 None] <== create_volume: return (903ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:39:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-a2099d0a-5acb-434e-8150-aeea464258ba tempest-ProjectMemberTests-538781697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.906s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a2099d0a-5acb-434e-8150-aeea464258ba tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (8fdfe4c2-d0c7-402c-97bd-586435cab3d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f08b6523-6890-4911-a692-7b7d49cb2b1b', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a2099d0a-5acb-434e-8150-aeea464258ba tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fd0e709-7eaa-45b8-8906-673b2040cbd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:52 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-a2099d0a-5acb-434e-8150-aeea464258ba tempest-ProjectMemberTests-538781697 None] Volume volume-f08b6523-6890-4911-a692-7b7d49cb2b1b (f08b6523-6890-4911-a692-7b7d49cb2b1b): created successfully Nov 01 12:39:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a2099d0a-5acb-434e-8150-aeea464258ba tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3fd0e709-7eaa-45b8-8906-673b2040cbd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:52 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-a2099d0a-5acb-434e-8150-aeea464258ba tempest-ProjectMemberTests-538781697 None] Flow 'volume_create_manager' (e5997579-8568-49bb-a2e1-d1c5dc23aa16) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:39:52 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-a2099d0a-5acb-434e-8150-aeea464258ba tempest-ProjectMemberTests-538781697 None] Created volume successfully. Nov 01 12:39:52 devstack sudo[106815]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7ad072c3-ea1c-431d-8ea6-350d28cc63be tempest-ProjectReaderTests-532564148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0b0d915b-de04-4890-b393-bf028102c7a8" returned: 0 in 0.442s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7ad072c3-ea1c-431d-8ea6-350d28cc63be tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0b0d915b-de04-4890-b393-bf028102c7a8.7461e71b-3eaf-4f51-a1d8-9ac0f0060ac2 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:52 devstack sudo[106822]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0b0d915b-de04-4890-b393-bf028102c7a8.7461e71b-3eaf-4f51-a1d8-9ac0f0060ac2 Nov 01 12:39:52 devstack sudo[106822]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:52 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-3fa109cb-ae4b-4812-9866-1779cbf70105 tempest-ProjectReaderTests-2039302514 None] Acquiring lock "cinder-779f8b75-acad-40e3-96c6-d9845bf742fa-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:52 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-3fa109cb-ae4b-4812-9866-1779cbf70105 tempest-ProjectReaderTests-2039302514 None] Lock "cinder-779f8b75-acad-40e3-96c6-d9845bf742fa-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:52 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-3fa109cb-ae4b-4812-9866-1779cbf70105 tempest-ProjectReaderTests-2039302514 None] Acquiring lock "cinder-quobyte-779f8b75-acad-40e3-96c6-d9845bf742fa" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:52 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-3fa109cb-ae4b-4812-9866-1779cbf70105 tempest-ProjectReaderTests-2039302514 None] Lock "cinder-quobyte-779f8b75-acad-40e3-96c6-d9845bf742fa" acquired by "delete_volume" :: waited 0.014s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:52 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c9c740f-a945-42ec-9071-3f14356f114c]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3fa109cb-ae4b-4812-9866-1779cbf70105 tempest-ProjectReaderTests-2039302514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-779f8b75-acad-40e3-96c6-d9845bf742fa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:53 devstack sudo[106822]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7ad072c3-ea1c-431d-8ea6-350d28cc63be tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0b0d915b-de04-4890-b393-bf028102c7a8.7461e71b-3eaf-4f51-a1d8-9ac0f0060ac2" returned: 0 in 0.363s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7ad072c3-ea1c-431d-8ea6-350d28cc63be tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0b0d915b-de04-4890-b393-bf028102c7a8.7461e71b-3eaf-4f51-a1d8-9ac0f0060ac2 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:53 devstack sudo[106828]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0b0d915b-de04-4890-b393-bf028102c7a8.7461e71b-3eaf-4f51-a1d8-9ac0f0060ac2 Nov 01 12:39:53 devstack sudo[106828]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:53 devstack sudo[106827]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-779f8b75-acad-40e3-96c6-d9845bf742fa Nov 01 12:39:53 devstack sudo[106827]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:53 devstack sudo[106828]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7ad072c3-ea1c-431d-8ea6-350d28cc63be tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0b0d915b-de04-4890-b393-bf028102c7a8.7461e71b-3eaf-4f51-a1d8-9ac0f0060ac2" returned: 0 in 0.285s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:53 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-7ad072c3-ea1c-431d-8ea6-350d28cc63be tempest-ProjectReaderTests-532564148 None] Lock "cinder-quobyte-7461e71b-3eaf-4f51-a1d8-9ac0f0060ac2" released by "_delete_snapshot" :: held 1.650s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:53 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-7ad072c3-ea1c-431d-8ea6-350d28cc63be tempest-ProjectReaderTests-532564148 None] Lock "cinder-quobyte-0b0d915b-de04-4890-b393-bf028102c7a8" released by "delete_snapshot" :: held 1.689s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:53 devstack sudo[106827]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3fa109cb-ae4b-4812-9866-1779cbf70105 tempest-ProjectReaderTests-2039302514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-779f8b75-acad-40e3-96c6-d9845bf742fa" returned: 0 in 0.422s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-2dc0a936-11d8-4690-b346-0e9569950884 tempest-ProjectMemberTests-538781697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-2dc0a936-11d8-4690-b346-0e9569950884 tempest-ProjectMemberTests-538781697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3fa109cb-ae4b-4812-9866-1779cbf70105 tempest-ProjectReaderTests-2039302514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-779f8b75-acad-40e3-96c6-d9845bf742fa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:53 devstack sudo[106835]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-779f8b75-acad-40e3-96c6-d9845bf742fa Nov 01 12:39:53 devstack sudo[106835]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:53 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-2dc0a936-11d8-4690-b346-0e9569950884 tempest-ProjectMemberTests-538781697 None] Creating offline snapshot eb69922c-1431-4413-9368-0e39b63cb5a9 of volume f08b6523-6890-4911-a692-7b7d49cb2b1b {{(pid=86574) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:39:53 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[e74e0a16-f97d-4ac6-b49b-45a4ae950a14]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2dc0a936-11d8-4690-b346-0e9569950884 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f08b6523-6890-4911-a692-7b7d49cb2b1b {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:53 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-7ad072c3-ea1c-431d-8ea6-350d28cc63be tempest-ProjectReaderTests-532564148 None] Created reservations ['f732258f-b2b1-4e01-9056-13e59bd93d97', '49a40c90-f7d6-4178-800b-4b66b43d82e3', 'eba9b575-c9d1-4a0c-b895-392c427f265c', 'e352df31-6d96-44a8-8c78-466055b1533a'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:39:53 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-7ad072c3-ea1c-431d-8ea6-350d28cc63be tempest-ProjectReaderTests-532564148 None] Delete snapshot completed successfully. Nov 01 12:39:53 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-7ad072c3-ea1c-431d-8ea6-350d28cc63be tempest-ProjectReaderTests-532564148 None] Lock "cinder-7461e71b-3eaf-4f51-a1d8-9ac0f0060ac2-delete_snapshot" released by "delete_snapshot" :: held 1.898s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:53 devstack sudo[106837]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f08b6523-6890-4911-a692-7b7d49cb2b1b Nov 01 12:39:53 devstack sudo[106837]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:53 devstack sudo[106835]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3fa109cb-ae4b-4812-9866-1779cbf70105 tempest-ProjectReaderTests-2039302514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-779f8b75-acad-40e3-96c6-d9845bf742fa" returned: 0 in 0.254s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:53 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-3fa109cb-ae4b-4812-9866-1779cbf70105 tempest-ProjectReaderTests-2039302514 None] Lock "cinder-quobyte-779f8b75-acad-40e3-96c6-d9845bf742fa" released by "delete_volume" :: held 0.721s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:53 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-3fa109cb-ae4b-4812-9866-1779cbf70105 tempest-ProjectReaderTests-2039302514 None] Created reservations ['7e9681ae-ce30-456e-a77e-5df452a00cd2', 'd5384d91-777e-45f3-b4f4-a844d10511aa', '8363a07d-0e51-4ee2-9f3b-f11d6b0aae1c', 'fda49751-2bff-4d9f-9ec3-9e4870dc09a9'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:39:53 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-eee3f99a-d5fc-40f4-be71-d8cb02cbaa6d tempest-ProjectReaderTests-532564148 None] Acquiring lock "cinder-0b0d915b-de04-4890-b393-bf028102c7a8-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:53 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-eee3f99a-d5fc-40f4-be71-d8cb02cbaa6d tempest-ProjectReaderTests-532564148 None] Lock "cinder-0b0d915b-de04-4890-b393-bf028102c7a8-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:53 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-eee3f99a-d5fc-40f4-be71-d8cb02cbaa6d tempest-ProjectReaderTests-532564148 None] Acquiring lock "cinder-quobyte-0b0d915b-de04-4890-b393-bf028102c7a8" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-3fa109cb-ae4b-4812-9866-1779cbf70105 tempest-ProjectReaderTests-2039302514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-3fa109cb-ae4b-4812-9866-1779cbf70105 tempest-ProjectReaderTests-2039302514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:53 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-3fa109cb-ae4b-4812-9866-1779cbf70105 tempest-ProjectReaderTests-2039302514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:39:53 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-3fa109cb-ae4b-4812-9866-1779cbf70105 tempest-ProjectReaderTests-2039302514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:39:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-3fa109cb-ae4b-4812-9866-1779cbf70105 tempest-ProjectReaderTests-2039302514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3fa109cb-ae4b-4812-9866-1779cbf70105 tempest-ProjectReaderTests-2039302514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:53 devstack sudo[106837]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2dc0a936-11d8-4690-b346-0e9569950884 tempest-ProjectMemberTests-538781697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f08b6523-6890-4911-a692-7b7d49cb2b1b" returned: 0 in 0.428s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2dc0a936-11d8-4690-b346-0e9569950884 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f08b6523-6890-4911-a692-7b7d49cb2b1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f08b6523-6890-4911-a692-7b7d49cb2b1b.eb69922c-1431-4413-9368-0e39b63cb5a9 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:53 devstack sudo[106843]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:39:53 devstack sudo[106843]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:53 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-eee3f99a-d5fc-40f4-be71-d8cb02cbaa6d tempest-ProjectReaderTests-532564148 None] Lock "cinder-quobyte-0b0d915b-de04-4890-b393-bf028102c7a8" acquired by "delete_volume" :: waited 0.083s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:53 devstack sudo[106844]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f08b6523-6890-4911-a692-7b7d49cb2b1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f08b6523-6890-4911-a692-7b7d49cb2b1b.eb69922c-1431-4413-9368-0e39b63cb5a9 1G Nov 01 12:39:53 devstack sudo[106844]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:53 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[2825f8d9-a272-4768-96ac-7d4f4217e6e5]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eee3f99a-d5fc-40f4-be71-d8cb02cbaa6d tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0b0d915b-de04-4890-b393-bf028102c7a8 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:54 devstack sudo[106843]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:54 devstack sudo[106847]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0b0d915b-de04-4890-b393-bf028102c7a8 Nov 01 12:39:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3fa109cb-ae4b-4812-9866-1779cbf70105 tempest-ProjectReaderTests-2039302514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.365s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:54 devstack sudo[106847]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:54 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-3fa109cb-ae4b-4812-9866-1779cbf70105 tempest-ProjectReaderTests-2039302514 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:39:54 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-3fa109cb-ae4b-4812-9866-1779cbf70105 tempest-ProjectReaderTests-2039302514 None] Deleted volume successfully. Nov 01 12:39:54 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-3fa109cb-ae4b-4812-9866-1779cbf70105 tempest-ProjectReaderTests-2039302514 None] Lock "cinder-779f8b75-acad-40e3-96c6-d9845bf742fa-delete_volume" released by "delete_volume" :: held 1.376s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:54 devstack sudo[106844]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2dc0a936-11d8-4690-b346-0e9569950884 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f08b6523-6890-4911-a692-7b7d49cb2b1b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f08b6523-6890-4911-a692-7b7d49cb2b1b.eb69922c-1431-4413-9368-0e39b63cb5a9 1G" returned: 0 in 0.668s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2dc0a936-11d8-4690-b346-0e9569950884 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f08b6523-6890-4911-a692-7b7d49cb2b1b -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f08b6523-6890-4911-a692-7b7d49cb2b1b.eb69922c-1431-4413-9368-0e39b63cb5a9 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:54 devstack sudo[106857]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f08b6523-6890-4911-a692-7b7d49cb2b1b -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f08b6523-6890-4911-a692-7b7d49cb2b1b.eb69922c-1431-4413-9368-0e39b63cb5a9 Nov 01 12:39:54 devstack sudo[106857]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:54 devstack sudo[106847]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eee3f99a-d5fc-40f4-be71-d8cb02cbaa6d tempest-ProjectReaderTests-532564148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0b0d915b-de04-4890-b393-bf028102c7a8" returned: 0 in 0.613s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eee3f99a-d5fc-40f4-be71-d8cb02cbaa6d tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0b0d915b-de04-4890-b393-bf028102c7a8 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:54 devstack sudo[106859]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0b0d915b-de04-4890-b393-bf028102c7a8 Nov 01 12:39:54 devstack sudo[106859]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:54 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-d7b6a618-fad4-4527-9fc8-d4bb22968dd4 tempest-ProjectReaderTests-2039302514 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:39:54 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d7b6a618-fad4-4527-9fc8-d4bb22968dd4 tempest-ProjectReaderTests-2039302514 None] Flow 'volume_create_manager' (dded3064-aea0-4ae1-96f7-140cb7c26dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:39:54 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d7b6a618-fad4-4527-9fc8-d4bb22968dd4 tempest-ProjectReaderTests-2039302514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63b221ce-5fd4-4fcf-8429-0e8edf9286d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:54 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d7b6a618-fad4-4527-9fc8-d4bb22968dd4 tempest-ProjectReaderTests-2039302514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63b221ce-5fd4-4fcf-8429-0e8edf9286d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:39:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1316361966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c97b297-c000-493c-a75d-63714587534d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564088ebc4354b8fbf34e0ac8982116c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:39:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:39:55Z,use_quota=True,user_id='be3943bf34494e5ba60df3e43d8e8528',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:54 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d7b6a618-fad4-4527-9fc8-d4bb22968dd4 tempest-ProjectReaderTests-2039302514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a0106b9-8424-4833-9758-d98bc89e03fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:54 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d7b6a618-fad4-4527-9fc8-d4bb22968dd4 tempest-ProjectReaderTests-2039302514 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9a0106b9-8424-4833-9758-d98bc89e03fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:54 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d7b6a618-fad4-4527-9fc8-d4bb22968dd4 tempest-ProjectReaderTests-2039302514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1bcd4ae-8a5e-453a-ab8c-d27e49bdfe2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:54 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d7b6a618-fad4-4527-9fc8-d4bb22968dd4 tempest-ProjectReaderTests-2039302514 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1bcd4ae-8a5e-453a-ab8c-d27e49bdfe2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0c97b297-c000-493c-a75d-63714587534d', 'volume_name': 'volume-0c97b297-c000-493c-a75d-63714587534d', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:54 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d7b6a618-fad4-4527-9fc8-d4bb22968dd4 tempest-ProjectReaderTests-2039302514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4d09a4c-cfc0-4b73-b0f3-466fa085bca0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:54 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d7b6a618-fad4-4527-9fc8-d4bb22968dd4 tempest-ProjectReaderTests-2039302514 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f4d09a4c-cfc0-4b73-b0f3-466fa085bca0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:54 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d7b6a618-fad4-4527-9fc8-d4bb22968dd4 tempest-ProjectReaderTests-2039302514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae1f0c9d-d7f3-4607-85b3-e05a0ef056e1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:54 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-d7b6a618-fad4-4527-9fc8-d4bb22968dd4 tempest-ProjectReaderTests-2039302514 None] Volume 0c97b297-c000-493c-a75d-63714587534d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0c97b297-c000-493c-a75d-63714587534d', 'volume_size': 1} Nov 01 12:39:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d7b6a618-fad4-4527-9fc8-d4bb22968dd4 tempest-ProjectReaderTests-2039302514 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:54 devstack sudo[106857]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2dc0a936-11d8-4690-b346-0e9569950884 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-f08b6523-6890-4911-a692-7b7d49cb2b1b -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f08b6523-6890-4911-a692-7b7d49cb2b1b.eb69922c-1431-4413-9368-0e39b63cb5a9" returned: 0 in 0.336s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:54 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-2dc0a936-11d8-4690-b346-0e9569950884 tempest-ProjectMemberTests-538781697 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f08b6523-6890-4911-a692-7b7d49cb2b1b.eb69922c-1431-4413-9368-0e39b63cb5a9 is being set with open permissions: ugo+rw Nov 01 12:39:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2dc0a936-11d8-4690-b346-0e9569950884 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f08b6523-6890-4911-a692-7b7d49cb2b1b.eb69922c-1431-4413-9368-0e39b63cb5a9 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:54 devstack sudo[106859]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eee3f99a-d5fc-40f4-be71-d8cb02cbaa6d tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0b0d915b-de04-4890-b393-bf028102c7a8" returned: 0 in 0.326s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:54 devstack sudo[106866]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f08b6523-6890-4911-a692-7b7d49cb2b1b.eb69922c-1431-4413-9368-0e39b63cb5a9 Nov 01 12:39:54 devstack sudo[106866]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:54 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-eee3f99a-d5fc-40f4-be71-d8cb02cbaa6d tempest-ProjectReaderTests-532564148 None] Lock "cinder-quobyte-0b0d915b-de04-4890-b393-bf028102c7a8" released by "delete_volume" :: held 1.040s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:54 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-eee3f99a-d5fc-40f4-be71-d8cb02cbaa6d tempest-ProjectReaderTests-532564148 None] Created reservations ['7eb92f99-933b-4283-ba0b-a4e0577887ff', 'b9c64cea-f1b5-42af-99da-3203c2f64f72', '47927e4d-2f7f-4c29-aeaf-a1f234b0e46e', '599739ae-b2ae-4855-a89c-0b71daf1dd91'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:39:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-eee3f99a-d5fc-40f4-be71-d8cb02cbaa6d tempest-ProjectReaderTests-532564148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-eee3f99a-d5fc-40f4-be71-d8cb02cbaa6d tempest-ProjectReaderTests-532564148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:55 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-eee3f99a-d5fc-40f4-be71-d8cb02cbaa6d tempest-ProjectReaderTests-532564148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:39:55 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-eee3f99a-d5fc-40f4-be71-d8cb02cbaa6d tempest-ProjectReaderTests-532564148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:39:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-eee3f99a-d5fc-40f4-be71-d8cb02cbaa6d tempest-ProjectReaderTests-532564148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eee3f99a-d5fc-40f4-be71-d8cb02cbaa6d tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:55 devstack sudo[106868]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:39:55 devstack sudo[106868]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:55 devstack sudo[106866]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2dc0a936-11d8-4690-b346-0e9569950884 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f08b6523-6890-4911-a692-7b7d49cb2b1b.eb69922c-1431-4413-9368-0e39b63cb5a9" returned: 0 in 0.285s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2dc0a936-11d8-4690-b346-0e9569950884 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f08b6523-6890-4911-a692-7b7d49cb2b1b.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:55 devstack sudo[106871]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f08b6523-6890-4911-a692-7b7d49cb2b1b.info Nov 01 12:39:55 devstack sudo[106871]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:55 devstack sudo[106868]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eee3f99a-d5fc-40f4-be71-d8cb02cbaa6d tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.277s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:55 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-eee3f99a-d5fc-40f4-be71-d8cb02cbaa6d tempest-ProjectReaderTests-532564148 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:39:55 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-eee3f99a-d5fc-40f4-be71-d8cb02cbaa6d tempest-ProjectReaderTests-532564148 None] Deleted volume successfully. Nov 01 12:39:55 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-eee3f99a-d5fc-40f4-be71-d8cb02cbaa6d tempest-ProjectReaderTests-532564148 None] Lock "cinder-0b0d915b-de04-4890-b393-bf028102c7a8-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:55 devstack sudo[106871]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2dc0a936-11d8-4690-b346-0e9569950884 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f08b6523-6890-4911-a692-7b7d49cb2b1b.info" returned: 0 in 0.304s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:55 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-2dc0a936-11d8-4690-b346-0e9569950884 tempest-ProjectMemberTests-538781697 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f08b6523-6890-4911-a692-7b7d49cb2b1b.info is being set with open permissions: ugo+rw Nov 01 12:39:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2dc0a936-11d8-4690-b346-0e9569950884 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f08b6523-6890-4911-a692-7b7d49cb2b1b.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:55 devstack sudo[106875]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f08b6523-6890-4911-a692-7b7d49cb2b1b.info Nov 01 12:39:55 devstack sudo[106875]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:55 devstack sudo[106875]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-2dc0a936-11d8-4690-b346-0e9569950884 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f08b6523-6890-4911-a692-7b7d49cb2b1b.info" returned: 0 in 0.258s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-2dc0a936-11d8-4690-b346-0e9569950884 tempest-ProjectMemberTests-538781697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.404s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d7b6a618-fad4-4527-9fc8-d4bb22968dd4 tempest-ProjectReaderTests-2039302514 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.978s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:55 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d7b6a618-fad4-4527-9fc8-d4bb22968dd4 tempest-ProjectReaderTests-2039302514 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:39:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1316361966',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0c97b297-c000-493c-a75d-63714587534d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='564088ebc4354b8fbf34e0ac8982116c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:39:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:39:55Z,use_quota=True,user_id='be3943bf34494e5ba60df3e43d8e8528',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:39:55 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-d7b6a618-fad4-4527-9fc8-d4bb22968dd4 tempest-ProjectReaderTests-2039302514 None] Creating volume 0c97b297-c000-493c-a75d-63714587534d {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:39:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d7b6a618-fad4-4527-9fc8-d4bb22968dd4 tempest-ProjectReaderTests-2039302514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d7b6a618-fad4-4527-9fc8-d4bb22968dd4 tempest-ProjectReaderTests-2039302514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:55 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d7b6a618-fad4-4527-9fc8-d4bb22968dd4 tempest-ProjectReaderTests-2039302514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:39:55 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d7b6a618-fad4-4527-9fc8-d4bb22968dd4 tempest-ProjectReaderTests-2039302514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:39:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d7b6a618-fad4-4527-9fc8-d4bb22968dd4 tempest-ProjectReaderTests-2039302514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:55 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d7b6a618-fad4-4527-9fc8-d4bb22968dd4 tempest-ProjectReaderTests-2039302514 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:39:55 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-d7b6a618-fad4-4527-9fc8-d4bb22968dd4 tempest-ProjectReaderTests-2039302514 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:39:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d7b6a618-fad4-4527-9fc8-d4bb22968dd4 tempest-ProjectReaderTests-2039302514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0c97b297-c000-493c-a75d-63714587534d 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:55 devstack sudo[106878]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0c97b297-c000-493c-a75d-63714587534d 1073741824 Nov 01 12:39:55 devstack sudo[106878]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:55 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-2dc0a936-11d8-4690-b346-0e9569950884 tempest-ProjectMemberTests-538781697 None] Create snapshot completed successfully Nov 01 12:39:56 devstack sudo[106878]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d7b6a618-fad4-4527-9fc8-d4bb22968dd4 tempest-ProjectReaderTests-2039302514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0c97b297-c000-493c-a75d-63714587534d 1073741824" returned: 0 in 0.470s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d7b6a618-fad4-4527-9fc8-d4bb22968dd4 tempest-ProjectReaderTests-2039302514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0c97b297-c000-493c-a75d-63714587534d {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:56 devstack sudo[106884]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0c97b297-c000-493c-a75d-63714587534d Nov 01 12:39:56 devstack sudo[106884]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:56 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-d8831f6e-96d2-4951-83cf-23162ed25b11 tempest-ProjectReaderTests-532564148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:39:56 devstack sudo[106884]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:56 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d8831f6e-96d2-4951-83cf-23162ed25b11 tempest-ProjectReaderTests-532564148 None] Flow 'volume_create_manager' (696ce21d-b33f-45ba-8f3c-16a538ef2881) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:39:56 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d8831f6e-96d2-4951-83cf-23162ed25b11 tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c39e4336-a95d-4f29-bb89-58abd8d58f81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:56 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-bb6bfcc6-3f94-4c60-bfc9-9badf6740abd tempest-ProjectMemberTests-538781697 None] Acquiring lock "cinder-eb69922c-1431-4413-9368-0e39b63cb5a9-delete_snapshot" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d7b6a618-fad4-4527-9fc8-d4bb22968dd4 tempest-ProjectReaderTests-2039302514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0c97b297-c000-493c-a75d-63714587534d" returned: 0 in 0.289s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:56 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d7b6a618-fad4-4527-9fc8-d4bb22968dd4 tempest-ProjectReaderTests-2039302514 None] <== create_volume: return (809ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:39:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d7b6a618-fad4-4527-9fc8-d4bb22968dd4 tempest-ProjectReaderTests-2039302514 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.813s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:56 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d8831f6e-96d2-4951-83cf-23162ed25b11 tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c39e4336-a95d-4f29-bb89-58abd8d58f81) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:39:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-327948961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fa8c4eb-d029-47cb-963a-b9d5dfd4987e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='129b361527b34b0ab7e69215b88d2dad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:39:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:39:56Z,use_quota=True,user_id='2e13b273b0034c9683a67046323971d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:56 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d8831f6e-96d2-4951-83cf-23162ed25b11 tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (093b7244-3c49-44dc-bfa0-e017d502b292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:56 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d8831f6e-96d2-4951-83cf-23162ed25b11 tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (093b7244-3c49-44dc-bfa0-e017d502b292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:56 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d8831f6e-96d2-4951-83cf-23162ed25b11 tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75538716-679b-4189-a905-d5c4c794c4ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:56 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d8831f6e-96d2-4951-83cf-23162ed25b11 tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (75538716-679b-4189-a905-d5c4c794c4ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fa8c4eb-d029-47cb-963a-b9d5dfd4987e', 'volume_name': 'volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:56 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d8831f6e-96d2-4951-83cf-23162ed25b11 tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3318e794-fc02-43da-8121-1d8a66234b54) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:56 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d8831f6e-96d2-4951-83cf-23162ed25b11 tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3318e794-fc02-43da-8121-1d8a66234b54) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:56 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d8831f6e-96d2-4951-83cf-23162ed25b11 tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeb56913-3385-47e5-aee8-e2a0dfb7d0ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:56 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-d8831f6e-96d2-4951-83cf-23162ed25b11 tempest-ProjectReaderTests-532564148 None] Volume 9fa8c4eb-d029-47cb-963a-b9d5dfd4987e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e', 'volume_size': 1} Nov 01 12:39:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d8831f6e-96d2-4951-83cf-23162ed25b11 tempest-ProjectReaderTests-532564148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d8831f6e-96d2-4951-83cf-23162ed25b11 tempest-ProjectReaderTests-532564148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:56 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d8831f6e-96d2-4951-83cf-23162ed25b11 tempest-ProjectReaderTests-532564148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:39:56Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-327948961',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fa8c4eb-d029-47cb-963a-b9d5dfd4987e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='129b361527b34b0ab7e69215b88d2dad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:39:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:39:56Z,use_quota=True,user_id='2e13b273b0034c9683a67046323971d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:39:56 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-d8831f6e-96d2-4951-83cf-23162ed25b11 tempest-ProjectReaderTests-532564148 None] Creating volume 9fa8c4eb-d029-47cb-963a-b9d5dfd4987e {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:39:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d8831f6e-96d2-4951-83cf-23162ed25b11 tempest-ProjectReaderTests-532564148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d8831f6e-96d2-4951-83cf-23162ed25b11 tempest-ProjectReaderTests-532564148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:56 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d8831f6e-96d2-4951-83cf-23162ed25b11 tempest-ProjectReaderTests-532564148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:39:56 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d8831f6e-96d2-4951-83cf-23162ed25b11 tempest-ProjectReaderTests-532564148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:39:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d8831f6e-96d2-4951-83cf-23162ed25b11 tempest-ProjectReaderTests-532564148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:56 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d8831f6e-96d2-4951-83cf-23162ed25b11 tempest-ProjectReaderTests-532564148 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:39:56 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-d8831f6e-96d2-4951-83cf-23162ed25b11 tempest-ProjectReaderTests-532564148 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:39:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d8831f6e-96d2-4951-83cf-23162ed25b11 tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:56 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-bb6bfcc6-3f94-4c60-bfc9-9badf6740abd tempest-ProjectMemberTests-538781697 None] Lock "cinder-eb69922c-1431-4413-9368-0e39b63cb5a9-delete_snapshot" acquired by "delete_snapshot" :: waited 0.093s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:56 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-bb6bfcc6-3f94-4c60-bfc9-9badf6740abd tempest-ProjectMemberTests-538781697 None] Acquiring lock "cinder-quobyte-f08b6523-6890-4911-a692-7b7d49cb2b1b" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:56 devstack sudo[106887]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e 1073741824 Nov 01 12:39:56 devstack sudo[106887]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:56 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d7b6a618-fad4-4527-9fc8-d4bb22968dd4 tempest-ProjectReaderTests-2039302514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae1f0c9d-d7f3-4607-85b3-e05a0ef056e1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0c97b297-c000-493c-a75d-63714587534d', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:56 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d7b6a618-fad4-4527-9fc8-d4bb22968dd4 tempest-ProjectReaderTests-2039302514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52fca4e7-86b2-49e0-9251-cb1380eef16a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:56 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-bb6bfcc6-3f94-4c60-bfc9-9badf6740abd tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-f08b6523-6890-4911-a692-7b7d49cb2b1b" acquired by "delete_snapshot" :: waited 0.027s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:56 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-bb6bfcc6-3f94-4c60-bfc9-9badf6740abd tempest-ProjectMemberTests-538781697 None] Acquiring lock "cinder-quobyte-eb69922c-1431-4413-9368-0e39b63cb5a9" by "_delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:56 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-d7b6a618-fad4-4527-9fc8-d4bb22968dd4 tempest-ProjectReaderTests-2039302514 None] Volume volume-0c97b297-c000-493c-a75d-63714587534d (0c97b297-c000-493c-a75d-63714587534d): created successfully Nov 01 12:39:56 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d7b6a618-fad4-4527-9fc8-d4bb22968dd4 tempest-ProjectReaderTests-2039302514 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (52fca4e7-86b2-49e0-9251-cb1380eef16a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:56 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d7b6a618-fad4-4527-9fc8-d4bb22968dd4 tempest-ProjectReaderTests-2039302514 None] Flow 'volume_create_manager' (dded3064-aea0-4ae1-96f7-140cb7c26dd8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:39:56 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-bb6bfcc6-3f94-4c60-bfc9-9badf6740abd tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-eb69922c-1431-4413-9368-0e39b63cb5a9" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:56 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-bb6bfcc6-3f94-4c60-bfc9-9badf6740abd tempest-ProjectMemberTests-538781697 None] Deleting offline snapshot eb69922c-1431-4413-9368-0e39b63cb5a9 of volume f08b6523-6890-4911-a692-7b7d49cb2b1b {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:39:56 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-bb6bfcc6-3f94-4c60-bfc9-9badf6740abd tempest-ProjectMemberTests-538781697 None] snapshot_file for this snap is: volume-f08b6523-6890-4911-a692-7b7d49cb2b1b.eb69922c-1431-4413-9368-0e39b63cb5a9 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:39:56 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-d7b6a618-fad4-4527-9fc8-d4bb22968dd4 tempest-ProjectReaderTests-2039302514 None] Created volume successfully. Nov 01 12:39:56 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[b9378da1-524a-4a57-9296-008accb847c5]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bb6bfcc6-3f94-4c60-bfc9-9badf6740abd tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f08b6523-6890-4911-a692-7b7d49cb2b1b.eb69922c-1431-4413-9368-0e39b63cb5a9 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:56 devstack sudo[106889]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f08b6523-6890-4911-a692-7b7d49cb2b1b.eb69922c-1431-4413-9368-0e39b63cb5a9 Nov 01 12:39:56 devstack sudo[106889]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:57 devstack sudo[106887]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d8831f6e-96d2-4951-83cf-23162ed25b11 tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e 1073741824" returned: 0 in 0.442s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d8831f6e-96d2-4951-83cf-23162ed25b11 tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:57 devstack sudo[106897]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e Nov 01 12:39:57 devstack sudo[106897]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:57 devstack sudo[106889]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bb6bfcc6-3f94-4c60-bfc9-9badf6740abd tempest-ProjectMemberTests-538781697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f08b6523-6890-4911-a692-7b7d49cb2b1b.eb69922c-1431-4413-9368-0e39b63cb5a9" returned: 0 in 0.395s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:57 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-bb6bfcc6-3f94-4c60-bfc9-9badf6740abd tempest-ProjectMemberTests-538781697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-f08b6523-6890-4911-a692-7b7d49cb2b1b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:39:57 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[23b3c631-8f5f-42d7-8bec-2a71dc02499b]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bb6bfcc6-3f94-4c60-bfc9-9badf6740abd tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f08b6523-6890-4911-a692-7b7d49cb2b1b {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:57 devstack sudo[106899]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f08b6523-6890-4911-a692-7b7d49cb2b1b Nov 01 12:39:57 devstack sudo[106899]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:57 devstack sudo[106897]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d8831f6e-96d2-4951-83cf-23162ed25b11 tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e" returned: 0 in 0.266s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:57 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d8831f6e-96d2-4951-83cf-23162ed25b11 tempest-ProjectReaderTests-532564148 None] <== create_volume: return (754ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:39:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d8831f6e-96d2-4951-83cf-23162ed25b11 tempest-ProjectReaderTests-532564148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:57 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d8831f6e-96d2-4951-83cf-23162ed25b11 tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aeb56913-3385-47e5-aee8-e2a0dfb7d0ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:57 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d8831f6e-96d2-4951-83cf-23162ed25b11 tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43e568bb-79f5-4cab-8dd1-b8c62f794a92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:39:57 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-d8831f6e-96d2-4951-83cf-23162ed25b11 tempest-ProjectReaderTests-532564148 None] Volume volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e (9fa8c4eb-d029-47cb-963a-b9d5dfd4987e): created successfully Nov 01 12:39:57 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d8831f6e-96d2-4951-83cf-23162ed25b11 tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43e568bb-79f5-4cab-8dd1-b8c62f794a92) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:39:57 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d8831f6e-96d2-4951-83cf-23162ed25b11 tempest-ProjectReaderTests-532564148 None] Flow 'volume_create_manager' (696ce21d-b33f-45ba-8f3c-16a538ef2881) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:39:57 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-d8831f6e-96d2-4951-83cf-23162ed25b11 tempest-ProjectReaderTests-532564148 None] Created volume successfully. Nov 01 12:39:57 devstack sudo[106899]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bb6bfcc6-3f94-4c60-bfc9-9badf6740abd tempest-ProjectMemberTests-538781697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f08b6523-6890-4911-a692-7b7d49cb2b1b" returned: 0 in 0.373s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bb6bfcc6-3f94-4c60-bfc9-9badf6740abd tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f08b6523-6890-4911-a692-7b7d49cb2b1b.eb69922c-1431-4413-9368-0e39b63cb5a9 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:57 devstack sudo[106905]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f08b6523-6890-4911-a692-7b7d49cb2b1b.eb69922c-1431-4413-9368-0e39b63cb5a9 Nov 01 12:39:57 devstack sudo[106905]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:57 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f387fa21-0775-46d7-a8bb-0df5260b109c tempest-ProjectReaderTests-2039302514 None] Acquiring lock "cinder-0c97b297-c000-493c-a75d-63714587534d-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:57 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f387fa21-0775-46d7-a8bb-0df5260b109c tempest-ProjectReaderTests-2039302514 None] Lock "cinder-0c97b297-c000-493c-a75d-63714587534d-delete_volume" acquired by "delete_volume" :: waited 0.030s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:57 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f387fa21-0775-46d7-a8bb-0df5260b109c tempest-ProjectReaderTests-2039302514 None] Acquiring lock "cinder-quobyte-0c97b297-c000-493c-a75d-63714587534d" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:57 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f387fa21-0775-46d7-a8bb-0df5260b109c tempest-ProjectReaderTests-2039302514 None] Lock "cinder-quobyte-0c97b297-c000-493c-a75d-63714587534d" acquired by "delete_volume" :: waited 0.015s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:57 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[d26027ed-db33-44af-a4ea-ac8af9d04364]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f387fa21-0775-46d7-a8bb-0df5260b109c tempest-ProjectReaderTests-2039302514 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0c97b297-c000-493c-a75d-63714587534d {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:57 devstack sudo[106905]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bb6bfcc6-3f94-4c60-bfc9-9badf6740abd tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f08b6523-6890-4911-a692-7b7d49cb2b1b.eb69922c-1431-4413-9368-0e39b63cb5a9" returned: 0 in 0.378s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:57 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bb6bfcc6-3f94-4c60-bfc9-9badf6740abd tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f08b6523-6890-4911-a692-7b7d49cb2b1b.eb69922c-1431-4413-9368-0e39b63cb5a9 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:57 devstack sudo[106912]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f08b6523-6890-4911-a692-7b7d49cb2b1b.eb69922c-1431-4413-9368-0e39b63cb5a9 Nov 01 12:39:57 devstack sudo[106912]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:58 devstack sudo[106911]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0c97b297-c000-493c-a75d-63714587534d Nov 01 12:39:58 devstack sudo[106911]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:58 devstack sudo[106912]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-bb6bfcc6-3f94-4c60-bfc9-9badf6740abd tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f08b6523-6890-4911-a692-7b7d49cb2b1b.eb69922c-1431-4413-9368-0e39b63cb5a9" returned: 0 in 0.269s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:58 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-bb6bfcc6-3f94-4c60-bfc9-9badf6740abd tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-eb69922c-1431-4413-9368-0e39b63cb5a9" released by "_delete_snapshot" :: held 1.535s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:58 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-bb6bfcc6-3f94-4c60-bfc9-9badf6740abd tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-f08b6523-6890-4911-a692-7b7d49cb2b1b" released by "delete_snapshot" :: held 1.571s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:58 devstack sudo[106911]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f387fa21-0775-46d7-a8bb-0df5260b109c tempest-ProjectReaderTests-2039302514 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0c97b297-c000-493c-a75d-63714587534d" returned: 0 in 0.387s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f387fa21-0775-46d7-a8bb-0df5260b109c tempest-ProjectReaderTests-2039302514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0c97b297-c000-493c-a75d-63714587534d {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:58 devstack sudo[106919]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0c97b297-c000-493c-a75d-63714587534d Nov 01 12:39:58 devstack sudo[106919]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:58 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-bb6bfcc6-3f94-4c60-bfc9-9badf6740abd tempest-ProjectMemberTests-538781697 None] Created reservations ['d0729881-eb6f-4f55-a067-76120af8fa79', '519e151c-f5af-4a13-a9b9-3c2e4d71b6e5', '24eb000c-bce9-4d76-98eb-9451e293dd50', '295bb9d8-3e6f-4641-8ce7-1a0e47d454b7'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:39:58 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-bb6bfcc6-3f94-4c60-bfc9-9badf6740abd tempest-ProjectMemberTests-538781697 None] Delete snapshot completed successfully. Nov 01 12:39:58 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-bb6bfcc6-3f94-4c60-bfc9-9badf6740abd tempest-ProjectMemberTests-538781697 None] Lock "cinder-eb69922c-1431-4413-9368-0e39b63cb5a9-delete_snapshot" released by "delete_snapshot" :: held 1.767s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:58 devstack sudo[106919]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f387fa21-0775-46d7-a8bb-0df5260b109c tempest-ProjectReaderTests-2039302514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-0c97b297-c000-493c-a75d-63714587534d" returned: 0 in 0.282s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:58 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f387fa21-0775-46d7-a8bb-0df5260b109c tempest-ProjectReaderTests-2039302514 None] Lock "cinder-quobyte-0c97b297-c000-493c-a75d-63714587534d" released by "delete_volume" :: held 0.709s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:58 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-f387fa21-0775-46d7-a8bb-0df5260b109c tempest-ProjectReaderTests-2039302514 None] Created reservations ['cadb3e05-b5ef-408c-b8e2-6cb8fdf3a6ec', '69fb810d-0395-49ce-b019-56a0a67d47dc', '2792260d-23ad-42bb-a55b-90c6dde5b90b', '6f9fa041-867a-4293-b142-1e9a004c32ab'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:39:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f387fa21-0775-46d7-a8bb-0df5260b109c tempest-ProjectReaderTests-2039302514 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f387fa21-0775-46d7-a8bb-0df5260b109c tempest-ProjectReaderTests-2039302514 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:58 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f387fa21-0775-46d7-a8bb-0df5260b109c tempest-ProjectReaderTests-2039302514 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:39:58 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-f387fa21-0775-46d7-a8bb-0df5260b109c tempest-ProjectReaderTests-2039302514 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:39:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-f387fa21-0775-46d7-a8bb-0df5260b109c tempest-ProjectReaderTests-2039302514 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f387fa21-0775-46d7-a8bb-0df5260b109c tempest-ProjectReaderTests-2039302514 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:58 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-cbbe0c77-7a4b-4b5f-89f4-85db8614ba5d tempest-ProjectMemberTests-538781697 None] Acquiring lock "cinder-f08b6523-6890-4911-a692-7b7d49cb2b1b-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:58 devstack sudo[106923]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:39:58 devstack sudo[106923]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:58 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-cbbe0c77-7a4b-4b5f-89f4-85db8614ba5d tempest-ProjectMemberTests-538781697 None] Lock "cinder-f08b6523-6890-4911-a692-7b7d49cb2b1b-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e46ed9e9-b798-4667-a9f2-9dfce5cc15c5 tempest-ProjectReaderTests-532564148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e46ed9e9-b798-4667-a9f2-9dfce5cc15c5 tempest-ProjectReaderTests-532564148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:58 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-cbbe0c77-7a4b-4b5f-89f4-85db8614ba5d tempest-ProjectMemberTests-538781697 None] Acquiring lock "cinder-quobyte-f08b6523-6890-4911-a692-7b7d49cb2b1b" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:39:58 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-e46ed9e9-b798-4667-a9f2-9dfce5cc15c5 tempest-ProjectReaderTests-532564148 None] Creating offline snapshot 59a96eec-0fb4-47b6-a8c7-68e37fd28314 of volume 9fa8c4eb-d029-47cb-963a-b9d5dfd4987e {{(pid=86574) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:39:58 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-cbbe0c77-7a4b-4b5f-89f4-85db8614ba5d tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-f08b6523-6890-4911-a692-7b7d49cb2b1b" acquired by "delete_volume" :: waited 0.027s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:39:58 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[ae268aef-f2e6-4d3a-b216-5a53c18533e8]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e46ed9e9-b798-4667-a9f2-9dfce5cc15c5 tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:58 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa48d6f-bb62-4942-82fe-12babf8ddb89]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:39:58 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-cbbe0c77-7a4b-4b5f-89f4-85db8614ba5d tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f08b6523-6890-4911-a692-7b7d49cb2b1b {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:59 devstack sudo[106923]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-f387fa21-0775-46d7-a8bb-0df5260b109c tempest-ProjectReaderTests-2039302514 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.336s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:59 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-f387fa21-0775-46d7-a8bb-0df5260b109c tempest-ProjectReaderTests-2039302514 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:39:59 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-f387fa21-0775-46d7-a8bb-0df5260b109c tempest-ProjectReaderTests-2039302514 None] Deleted volume successfully. Nov 01 12:39:59 devstack sudo[106925]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e Nov 01 12:39:59 devstack sudo[106925]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:59 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-f387fa21-0775-46d7-a8bb-0df5260b109c tempest-ProjectReaderTests-2039302514 None] Lock "cinder-0c97b297-c000-493c-a75d-63714587534d-delete_volume" released by "delete_volume" :: held 1.279s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:59 devstack sudo[106926]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f08b6523-6890-4911-a692-7b7d49cb2b1b Nov 01 12:39:59 devstack sudo[106926]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:59 devstack sudo[106925]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e46ed9e9-b798-4667-a9f2-9dfce5cc15c5 tempest-ProjectReaderTests-532564148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e" returned: 0 in 0.430s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e46ed9e9-b798-4667-a9f2-9dfce5cc15c5 tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e.59a96eec-0fb4-47b6-a8c7-68e37fd28314 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:59 devstack sudo[106926]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-cbbe0c77-7a4b-4b5f-89f4-85db8614ba5d tempest-ProjectMemberTests-538781697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f08b6523-6890-4911-a692-7b7d49cb2b1b" returned: 0 in 0.432s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-cbbe0c77-7a4b-4b5f-89f4-85db8614ba5d tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f08b6523-6890-4911-a692-7b7d49cb2b1b {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:59 devstack sudo[106936]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e.59a96eec-0fb4-47b6-a8c7-68e37fd28314 1G Nov 01 12:39:59 devstack sudo[106936]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:59 devstack sudo[106937]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f08b6523-6890-4911-a692-7b7d49cb2b1b Nov 01 12:39:59 devstack sudo[106937]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:59 devstack sudo[106937]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-cbbe0c77-7a4b-4b5f-89f4-85db8614ba5d tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-f08b6523-6890-4911-a692-7b7d49cb2b1b" returned: 0 in 0.276s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:59 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-cbbe0c77-7a4b-4b5f-89f4-85db8614ba5d tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-f08b6523-6890-4911-a692-7b7d49cb2b1b" released by "delete_volume" :: held 0.795s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:39:59 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-cbbe0c77-7a4b-4b5f-89f4-85db8614ba5d tempest-ProjectMemberTests-538781697 None] Created reservations ['ab1bcb5c-e4d5-4bae-9734-f95f888804f7', '3ac15a75-7fb8-4d47-8069-9256723b7ee0', 'aaae2b18-9d03-40c2-bc92-238c1667ec3c', '29fdb339-b438-4a60-9907-a9ce61dc1686'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:39:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-cbbe0c77-7a4b-4b5f-89f4-85db8614ba5d tempest-ProjectMemberTests-538781697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:39:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-cbbe0c77-7a4b-4b5f-89f4-85db8614ba5d tempest-ProjectMemberTests-538781697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:39:59 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-cbbe0c77-7a4b-4b5f-89f4-85db8614ba5d tempest-ProjectMemberTests-538781697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:39:59 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-cbbe0c77-7a4b-4b5f-89f4-85db8614ba5d tempest-ProjectMemberTests-538781697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:39:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-cbbe0c77-7a4b-4b5f-89f4-85db8614ba5d tempest-ProjectMemberTests-538781697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:39:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-cbbe0c77-7a4b-4b5f-89f4-85db8614ba5d tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:59 devstack sudo[106944]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:39:59 devstack sudo[106944]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:39:59 devstack sudo[106936]: pam_unix(sudo:session): session closed for user root Nov 01 12:39:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e46ed9e9-b798-4667-a9f2-9dfce5cc15c5 tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e.59a96eec-0fb4-47b6-a8c7-68e37fd28314 1G" returned: 0 in 0.545s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:39:59 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e46ed9e9-b798-4667-a9f2-9dfce5cc15c5 tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e.59a96eec-0fb4-47b6-a8c7-68e37fd28314 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:39:59 devstack sudo[106946]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e.59a96eec-0fb4-47b6-a8c7-68e37fd28314 Nov 01 12:39:59 devstack sudo[106946]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:00 devstack sudo[106944]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-cbbe0c77-7a4b-4b5f-89f4-85db8614ba5d tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.389s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:00 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-cbbe0c77-7a4b-4b5f-89f4-85db8614ba5d tempest-ProjectMemberTests-538781697 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:40:00 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-cbbe0c77-7a4b-4b5f-89f4-85db8614ba5d tempest-ProjectMemberTests-538781697 None] Deleted volume successfully. Nov 01 12:40:00 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-cbbe0c77-7a4b-4b5f-89f4-85db8614ba5d tempest-ProjectMemberTests-538781697 None] Lock "cinder-f08b6523-6890-4911-a692-7b7d49cb2b1b-delete_volume" released by "delete_volume" :: held 1.501s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:00 devstack sudo[106946]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e46ed9e9-b798-4667-a9f2-9dfce5cc15c5 tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e.59a96eec-0fb4-47b6-a8c7-68e37fd28314" returned: 0 in 0.453s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:00 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-e46ed9e9-b798-4667-a9f2-9dfce5cc15c5 tempest-ProjectReaderTests-532564148 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e.59a96eec-0fb4-47b6-a8c7-68e37fd28314 is being set with open permissions: ugo+rw Nov 01 12:40:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e46ed9e9-b798-4667-a9f2-9dfce5cc15c5 tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e.59a96eec-0fb4-47b6-a8c7-68e37fd28314 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:00 devstack sudo[106956]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e.59a96eec-0fb4-47b6-a8c7-68e37fd28314 Nov 01 12:40:00 devstack sudo[106956]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:00 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-4369beda-188e-433e-9d0a-2164c7b4bcab tempest-ProjectMemberTests-538781697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:40:00 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4369beda-188e-433e-9d0a-2164c7b4bcab tempest-ProjectMemberTests-538781697 None] Flow 'volume_create_manager' (93d37ef8-0737-4780-ad78-4c9565d4424f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:00 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4369beda-188e-433e-9d0a-2164c7b4bcab tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (063dfbd2-d1a3-4270-aac2-ee08fe75f083) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:00 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4369beda-188e-433e-9d0a-2164c7b4bcab tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (063dfbd2-d1a3-4270-aac2-ee08fe75f083) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1343872719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe0ffaf6cf1d4294aa9f030164447d48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:00Z,use_quota=True,user_id='f617cd7e548d4a989b479812bba708f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:00 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4369beda-188e-433e-9d0a-2164c7b4bcab tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4626fafc-f8b5-41c1-ad4d-1d9797a3bd94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:00 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4369beda-188e-433e-9d0a-2164c7b4bcab tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4626fafc-f8b5-41c1-ad4d-1d9797a3bd94) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:00 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4369beda-188e-433e-9d0a-2164c7b4bcab tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (749dc04d-9ffe-4a60-b737-fce275ad3e09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:00 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4369beda-188e-433e-9d0a-2164c7b4bcab tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (749dc04d-9ffe-4a60-b737-fce275ad3e09) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5', 'volume_name': 'volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:00 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4369beda-188e-433e-9d0a-2164c7b4bcab tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de05730b-11b1-438e-bbf2-1f758a551eea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:00 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4369beda-188e-433e-9d0a-2164c7b4bcab tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (de05730b-11b1-438e-bbf2-1f758a551eea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:00 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4369beda-188e-433e-9d0a-2164c7b4bcab tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08af87d7-4504-4bd0-bd53-4c559558b9c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:00 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-4369beda-188e-433e-9d0a-2164c7b4bcab tempest-ProjectMemberTests-538781697 None] Volume 5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5', 'volume_size': 1} Nov 01 12:40:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4369beda-188e-433e-9d0a-2164c7b4bcab tempest-ProjectMemberTests-538781697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:00 devstack sudo[106956]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e46ed9e9-b798-4667-a9f2-9dfce5cc15c5 tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e.59a96eec-0fb4-47b6-a8c7-68e37fd28314" returned: 0 in 0.270s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e46ed9e9-b798-4667-a9f2-9dfce5cc15c5 tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:00 devstack sudo[106959]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e.info Nov 01 12:40:00 devstack sudo[106959]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:00 devstack sudo[106959]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e46ed9e9-b798-4667-a9f2-9dfce5cc15c5 tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e.info" returned: 0 in 0.260s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:00 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-e46ed9e9-b798-4667-a9f2-9dfce5cc15c5 tempest-ProjectReaderTests-532564148 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e.info is being set with open permissions: ugo+rw Nov 01 12:40:00 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e46ed9e9-b798-4667-a9f2-9dfce5cc15c5 tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:00 devstack sudo[106962]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e.info Nov 01 12:40:00 devstack sudo[106962]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:01 devstack sudo[106962]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e46ed9e9-b798-4667-a9f2-9dfce5cc15c5 tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e.info" returned: 0 in 0.246s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e46ed9e9-b798-4667-a9f2-9dfce5cc15c5 tempest-ProjectReaderTests-532564148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.331s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4369beda-188e-433e-9d0a-2164c7b4bcab tempest-ProjectMemberTests-538781697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.610s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:01 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-4369beda-188e-433e-9d0a-2164c7b4bcab tempest-ProjectMemberTests-538781697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-1343872719',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe0ffaf6cf1d4294aa9f030164447d48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:00Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:00Z,use_quota=True,user_id='f617cd7e548d4a989b479812bba708f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:40:01 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-4369beda-188e-433e-9d0a-2164c7b4bcab tempest-ProjectMemberTests-538781697 None] Creating volume 5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:40:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4369beda-188e-433e-9d0a-2164c7b4bcab tempest-ProjectMemberTests-538781697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4369beda-188e-433e-9d0a-2164c7b4bcab tempest-ProjectMemberTests-538781697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:01 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-4369beda-188e-433e-9d0a-2164c7b4bcab tempest-ProjectMemberTests-538781697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:01 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-4369beda-188e-433e-9d0a-2164c7b4bcab tempest-ProjectMemberTests-538781697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4369beda-188e-433e-9d0a-2164c7b4bcab tempest-ProjectMemberTests-538781697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:01 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-4369beda-188e-433e-9d0a-2164c7b4bcab tempest-ProjectMemberTests-538781697 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:40:01 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-4369beda-188e-433e-9d0a-2164c7b4bcab tempest-ProjectMemberTests-538781697 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:40:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4369beda-188e-433e-9d0a-2164c7b4bcab tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:01 devstack sudo[106965]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5 1073741824 Nov 01 12:40:01 devstack sudo[106965]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:01 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-e46ed9e9-b798-4667-a9f2-9dfce5cc15c5 tempest-ProjectReaderTests-532564148 None] Create snapshot completed successfully Nov 01 12:40:01 devstack sudo[106965]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4369beda-188e-433e-9d0a-2164c7b4bcab tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5 1073741824" returned: 0 in 0.449s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4369beda-188e-433e-9d0a-2164c7b4bcab tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:01 devstack sudo[106973]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5 Nov 01 12:40:01 devstack sudo[106973]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:01 devstack sudo[106973]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-4369beda-188e-433e-9d0a-2164c7b4bcab tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5" returned: 0 in 0.245s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:01 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-4369beda-188e-433e-9d0a-2164c7b4bcab tempest-ProjectMemberTests-538781697 None] <== create_volume: return (728ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:40:01 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-4369beda-188e-433e-9d0a-2164c7b4bcab tempest-ProjectMemberTests-538781697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:01 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4369beda-188e-433e-9d0a-2164c7b4bcab tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (08af87d7-4504-4bd0-bd53-4c559558b9c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:01 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4369beda-188e-433e-9d0a-2164c7b4bcab tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91a13b73-cbea-4ecc-9e0c-814d72918e6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:01 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-4369beda-188e-433e-9d0a-2164c7b4bcab tempest-ProjectMemberTests-538781697 None] Volume volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5 (5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5): created successfully Nov 01 12:40:01 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4369beda-188e-433e-9d0a-2164c7b4bcab tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (91a13b73-cbea-4ecc-9e0c-814d72918e6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:01 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-4369beda-188e-433e-9d0a-2164c7b4bcab tempest-ProjectMemberTests-538781697 None] Flow 'volume_create_manager' (93d37ef8-0737-4780-ad78-4c9565d4424f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:01 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-4369beda-188e-433e-9d0a-2164c7b4bcab tempest-ProjectMemberTests-538781697 None] Created volume successfully. Nov 01 12:40:02 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-71bc01b4-167a-403c-84df-b53cd3a44677 tempest-ProjectReaderTests-532564148 None] Acquiring lock "cinder-59a96eec-0fb4-47b6-a8c7-68e37fd28314-delete_snapshot" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:02 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-71bc01b4-167a-403c-84df-b53cd3a44677 tempest-ProjectReaderTests-532564148 None] Lock "cinder-59a96eec-0fb4-47b6-a8c7-68e37fd28314-delete_snapshot" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:02 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-71bc01b4-167a-403c-84df-b53cd3a44677 tempest-ProjectReaderTests-532564148 None] Acquiring lock "cinder-quobyte-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:02 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-71bc01b4-167a-403c-84df-b53cd3a44677 tempest-ProjectReaderTests-532564148 None] Lock "cinder-quobyte-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e" acquired by "delete_snapshot" :: waited 0.012s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:02 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-71bc01b4-167a-403c-84df-b53cd3a44677 tempest-ProjectReaderTests-532564148 None] Acquiring lock "cinder-quobyte-59a96eec-0fb4-47b6-a8c7-68e37fd28314" by "_delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:02 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-71bc01b4-167a-403c-84df-b53cd3a44677 tempest-ProjectReaderTests-532564148 None] Lock "cinder-quobyte-59a96eec-0fb4-47b6-a8c7-68e37fd28314" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:02 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-71bc01b4-167a-403c-84df-b53cd3a44677 tempest-ProjectReaderTests-532564148 None] Deleting offline snapshot 59a96eec-0fb4-47b6-a8c7-68e37fd28314 of volume 9fa8c4eb-d029-47cb-963a-b9d5dfd4987e {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:40:02 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-71bc01b4-167a-403c-84df-b53cd3a44677 tempest-ProjectReaderTests-532564148 None] snapshot_file for this snap is: volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e.59a96eec-0fb4-47b6-a8c7-68e37fd28314 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:40:02 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf9964ac-90a0-4c1e-b25b-a9d33f70a530]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-71bc01b4-167a-403c-84df-b53cd3a44677 tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e.59a96eec-0fb4-47b6-a8c7-68e37fd28314 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:02 devstack sudo[106976]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e.59a96eec-0fb4-47b6-a8c7-68e37fd28314 Nov 01 12:40:02 devstack sudo[106976]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:02 devstack sudo[106976]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-71bc01b4-167a-403c-84df-b53cd3a44677 tempest-ProjectReaderTests-532564148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e.59a96eec-0fb4-47b6-a8c7-68e37fd28314" returned: 0 in 0.362s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:02 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-71bc01b4-167a-403c-84df-b53cd3a44677 tempest-ProjectReaderTests-532564148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:40:02 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[1163dbe0-269e-47c9-aa1a-148866ba1f65]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-71bc01b4-167a-403c-84df-b53cd3a44677 tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:02 devstack sudo[106981]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e Nov 01 12:40:02 devstack sudo[106981]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-eb86b33a-240b-48ff-813e-d8979ebe834a tempest-ProjectMemberTests-538781697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-eb86b33a-240b-48ff-813e-d8979ebe834a tempest-ProjectMemberTests-538781697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:02 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-eb86b33a-240b-48ff-813e-d8979ebe834a tempest-ProjectMemberTests-538781697 None] Creating offline snapshot e49b4abf-6ad3-464b-9bf3-6c28df6d06de of volume 5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5 {{(pid=86574) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:40:02 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[c13cd424-06f3-491f-8861-4da4f4c1200c]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eb86b33a-240b-48ff-813e-d8979ebe834a tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:02 devstack sudo[106983]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5 Nov 01 12:40:02 devstack sudo[106983]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:02 devstack sudo[106981]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-71bc01b4-167a-403c-84df-b53cd3a44677 tempest-ProjectReaderTests-532564148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e" returned: 0 in 0.410s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:02 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-71bc01b4-167a-403c-84df-b53cd3a44677 tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e.59a96eec-0fb4-47b6-a8c7-68e37fd28314 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:02 devstack sudo[106988]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e.59a96eec-0fb4-47b6-a8c7-68e37fd28314 Nov 01 12:40:02 devstack sudo[106988]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:03 devstack sudo[106983]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eb86b33a-240b-48ff-813e-d8979ebe834a tempest-ProjectMemberTests-538781697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5" returned: 0 in 0.387s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eb86b33a-240b-48ff-813e-d8979ebe834a tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5.e49b4abf-6ad3-464b-9bf3-6c28df6d06de 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:03 devstack sudo[106996]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5.e49b4abf-6ad3-464b-9bf3-6c28df6d06de 1G Nov 01 12:40:03 devstack sudo[106996]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:03 devstack sudo[106988]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-71bc01b4-167a-403c-84df-b53cd3a44677 tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e.59a96eec-0fb4-47b6-a8c7-68e37fd28314" returned: 0 in 0.349s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-71bc01b4-167a-403c-84df-b53cd3a44677 tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e.59a96eec-0fb4-47b6-a8c7-68e37fd28314 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:03 devstack sudo[106998]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e.59a96eec-0fb4-47b6-a8c7-68e37fd28314 Nov 01 12:40:03 devstack sudo[106998]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:03 devstack sudo[106998]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-71bc01b4-167a-403c-84df-b53cd3a44677 tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e.59a96eec-0fb4-47b6-a8c7-68e37fd28314" returned: 0 in 0.279s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:03 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-71bc01b4-167a-403c-84df-b53cd3a44677 tempest-ProjectReaderTests-532564148 None] Lock "cinder-quobyte-59a96eec-0fb4-47b6-a8c7-68e37fd28314" released by "_delete_snapshot" :: held 1.511s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:03 devstack sudo[106996]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eb86b33a-240b-48ff-813e-d8979ebe834a tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5.e49b4abf-6ad3-464b-9bf3-6c28df6d06de 1G" returned: 0 in 0.419s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eb86b33a-240b-48ff-813e-d8979ebe834a tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5.e49b4abf-6ad3-464b-9bf3-6c28df6d06de {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:03 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-71bc01b4-167a-403c-84df-b53cd3a44677 tempest-ProjectReaderTests-532564148 None] Lock "cinder-quobyte-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e" released by "delete_snapshot" :: held 1.544s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:03 devstack sudo[107004]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5.e49b4abf-6ad3-464b-9bf3-6c28df6d06de Nov 01 12:40:03 devstack sudo[107004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:03 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-71bc01b4-167a-403c-84df-b53cd3a44677 tempest-ProjectReaderTests-532564148 None] Created reservations ['97e1439e-09d3-4d91-be77-0975ef926649', 'c252459f-6d62-4414-ae48-73811543e184', '626c679d-b16b-48ad-b178-7900dadbb2ce', '24d10775-7865-4357-b67f-aa1e207449f6'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:40:03 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-71bc01b4-167a-403c-84df-b53cd3a44677 tempest-ProjectReaderTests-532564148 None] Delete snapshot completed successfully. Nov 01 12:40:03 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-71bc01b4-167a-403c-84df-b53cd3a44677 tempest-ProjectReaderTests-532564148 None] Lock "cinder-59a96eec-0fb4-47b6-a8c7-68e37fd28314-delete_snapshot" released by "delete_snapshot" :: held 1.674s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:03 devstack sudo[107004]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eb86b33a-240b-48ff-813e-d8979ebe834a tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5.e49b4abf-6ad3-464b-9bf3-6c28df6d06de" returned: 0 in 0.308s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:03 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-eb86b33a-240b-48ff-813e-d8979ebe834a tempest-ProjectMemberTests-538781697 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5.e49b4abf-6ad3-464b-9bf3-6c28df6d06de is being set with open permissions: ugo+rw Nov 01 12:40:03 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eb86b33a-240b-48ff-813e-d8979ebe834a tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5.e49b4abf-6ad3-464b-9bf3-6c28df6d06de {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:03 devstack sudo[107009]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5.e49b4abf-6ad3-464b-9bf3-6c28df6d06de Nov 01 12:40:03 devstack sudo[107009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:04 devstack sudo[107009]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eb86b33a-240b-48ff-813e-d8979ebe834a tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5.e49b4abf-6ad3-464b-9bf3-6c28df6d06de" returned: 0 in 0.248s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eb86b33a-240b-48ff-813e-d8979ebe834a tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:04 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e6f4625d-1129-4eff-af73-f88c5f7a9424 tempest-ProjectReaderTests-532564148 None] Acquiring lock "cinder-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:04 devstack sudo[107013]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5.info Nov 01 12:40:04 devstack sudo[107013]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:04 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e6f4625d-1129-4eff-af73-f88c5f7a9424 tempest-ProjectReaderTests-532564148 None] Lock "cinder-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:04 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e6f4625d-1129-4eff-af73-f88c5f7a9424 tempest-ProjectReaderTests-532564148 None] Acquiring lock "cinder-quobyte-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:04 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e6f4625d-1129-4eff-af73-f88c5f7a9424 tempest-ProjectReaderTests-532564148 None] Lock "cinder-quobyte-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e" acquired by "delete_volume" :: waited 0.017s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:04 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[5c0fed2a-7715-4e81-94d5-325bd6203a04]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e6f4625d-1129-4eff-af73-f88c5f7a9424 tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:04 devstack sudo[107015]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e Nov 01 12:40:04 devstack sudo[107015]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:04 devstack sudo[107013]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eb86b33a-240b-48ff-813e-d8979ebe834a tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5.info" returned: 0 in 0.281s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:04 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-eb86b33a-240b-48ff-813e-d8979ebe834a tempest-ProjectMemberTests-538781697 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5.info is being set with open permissions: ugo+rw Nov 01 12:40:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eb86b33a-240b-48ff-813e-d8979ebe834a tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:04 devstack sudo[107018]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5.info Nov 01 12:40:04 devstack sudo[107018]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:04 devstack sudo[107015]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e6f4625d-1129-4eff-af73-f88c5f7a9424 tempest-ProjectReaderTests-532564148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e" returned: 0 in 0.386s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e6f4625d-1129-4eff-af73-f88c5f7a9424 tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:04 devstack sudo[107018]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-eb86b33a-240b-48ff-813e-d8979ebe834a tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5.info" returned: 0 in 0.252s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-eb86b33a-240b-48ff-813e-d8979ebe834a tempest-ProjectMemberTests-538781697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.974s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:04 devstack sudo[107024]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e Nov 01 12:40:04 devstack sudo[107024]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:04 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-eb86b33a-240b-48ff-813e-d8979ebe834a tempest-ProjectMemberTests-538781697 None] Create snapshot completed successfully Nov 01 12:40:04 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ba55d163-5834-43f5-8190-3b55360d36f1 tempest-ProjectMemberTests-538781697 None] Acquiring lock "cinder-e49b4abf-6ad3-464b-9bf3-6c28df6d06de-delete_snapshot" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:04 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ba55d163-5834-43f5-8190-3b55360d36f1 tempest-ProjectMemberTests-538781697 None] Lock "cinder-e49b4abf-6ad3-464b-9bf3-6c28df6d06de-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:04 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ba55d163-5834-43f5-8190-3b55360d36f1 tempest-ProjectMemberTests-538781697 None] Acquiring lock "cinder-quobyte-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:04 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ba55d163-5834-43f5-8190-3b55360d36f1 tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5" acquired by "delete_snapshot" :: waited 0.020s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:04 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ba55d163-5834-43f5-8190-3b55360d36f1 tempest-ProjectMemberTests-538781697 None] Acquiring lock "cinder-quobyte-e49b4abf-6ad3-464b-9bf3-6c28df6d06de" by "_delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:04 devstack sudo[107024]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:04 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e6f4625d-1129-4eff-af73-f88c5f7a9424 tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e" returned: 0 in 0.278s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:04 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ba55d163-5834-43f5-8190-3b55360d36f1 tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-e49b4abf-6ad3-464b-9bf3-6c28df6d06de" acquired by "_delete_snapshot" :: waited 0.029s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:04 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-ba55d163-5834-43f5-8190-3b55360d36f1 tempest-ProjectMemberTests-538781697 None] Deleting offline snapshot e49b4abf-6ad3-464b-9bf3-6c28df6d06de of volume 5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:40:05 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-ba55d163-5834-43f5-8190-3b55360d36f1 tempest-ProjectMemberTests-538781697 None] snapshot_file for this snap is: volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5.e49b4abf-6ad3-464b-9bf3-6c28df6d06de {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:40:05 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e6f4625d-1129-4eff-af73-f88c5f7a9424 tempest-ProjectReaderTests-532564148 None] Lock "cinder-quobyte-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e" released by "delete_volume" :: held 0.745s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:05 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[f4b809f0-931c-48d4-a477-964f0ffca21f]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ba55d163-5834-43f5-8190-3b55360d36f1 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5.e49b4abf-6ad3-464b-9bf3-6c28df6d06de {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:05 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-e6f4625d-1129-4eff-af73-f88c5f7a9424 tempest-ProjectReaderTests-532564148 None] Created reservations ['1d387d21-5d2f-46f0-8b58-82ceb0684d04', '85cc4476-2542-42c8-b9dd-a6622ed528b7', '68cebcde-56bb-42ef-bcad-5b15b82387e7', 'b794a11d-8ffa-4c3a-bbc4-fd64eb4a97b2'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:40:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e6f4625d-1129-4eff-af73-f88c5f7a9424 tempest-ProjectReaderTests-532564148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e6f4625d-1129-4eff-af73-f88c5f7a9424 tempest-ProjectReaderTests-532564148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:05 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e6f4625d-1129-4eff-af73-f88c5f7a9424 tempest-ProjectReaderTests-532564148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:05 devstack sudo[107027]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5.e49b4abf-6ad3-464b-9bf3-6c28df6d06de Nov 01 12:40:05 devstack sudo[107027]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:05 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e6f4625d-1129-4eff-af73-f88c5f7a9424 tempest-ProjectReaderTests-532564148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e6f4625d-1129-4eff-af73-f88c5f7a9424 tempest-ProjectReaderTests-532564148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e6f4625d-1129-4eff-af73-f88c5f7a9424 tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:05 devstack sudo[107029]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:40:05 devstack sudo[107029]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:05 devstack sudo[107029]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e6f4625d-1129-4eff-af73-f88c5f7a9424 tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.252s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:05 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-e6f4625d-1129-4eff-af73-f88c5f7a9424 tempest-ProjectReaderTests-532564148 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:40:05 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-e6f4625d-1129-4eff-af73-f88c5f7a9424 tempest-ProjectReaderTests-532564148 None] Deleted volume successfully. Nov 01 12:40:05 devstack sudo[107027]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ba55d163-5834-43f5-8190-3b55360d36f1 tempest-ProjectMemberTests-538781697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5.e49b4abf-6ad3-464b-9bf3-6c28df6d06de" returned: 0 in 0.413s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:05 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-ba55d163-5834-43f5-8190-3b55360d36f1 tempest-ProjectMemberTests-538781697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:40:05 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e6f4625d-1129-4eff-af73-f88c5f7a9424 tempest-ProjectReaderTests-532564148 None] Lock "cinder-9fa8c4eb-d029-47cb-963a-b9d5dfd4987e-delete_volume" released by "delete_volume" :: held 1.253s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:05 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[7db4673e-7d54-430f-a327-4e49fd8a40b9]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ba55d163-5834-43f5-8190-3b55360d36f1 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:05 devstack sudo[107035]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5 Nov 01 12:40:05 devstack sudo[107035]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:05 devstack sudo[107035]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ba55d163-5834-43f5-8190-3b55360d36f1 tempest-ProjectMemberTests-538781697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5" returned: 0 in 0.374s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ba55d163-5834-43f5-8190-3b55360d36f1 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5.e49b4abf-6ad3-464b-9bf3-6c28df6d06de {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:05 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-e4389fd6-b8ce-480d-9695-a7c01182fd24 tempest-ProjectReaderTests-532564148 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:40:05 devstack sudo[107040]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5.e49b4abf-6ad3-464b-9bf3-6c28df6d06de Nov 01 12:40:05 devstack sudo[107040]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:05 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e4389fd6-b8ce-480d-9695-a7c01182fd24 tempest-ProjectReaderTests-532564148 None] Flow 'volume_create_manager' (a72864a2-dcce-462e-9ca4-5ce5ef56abe0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:05 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e4389fd6-b8ce-480d-9695-a7c01182fd24 tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63ce470c-6a72-4f1d-867c-af98cc9d4c87) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:05 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e4389fd6-b8ce-480d-9695-a7c01182fd24 tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63ce470c-6a72-4f1d-867c-af98cc9d4c87) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-359711747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba5e9539-fefd-4f9c-abef-88c242f05b05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='129b361527b34b0ab7e69215b88d2dad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:06Z,use_quota=True,user_id='2e13b273b0034c9683a67046323971d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:05 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e4389fd6-b8ce-480d-9695-a7c01182fd24 tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0d37ee8-d408-4ef8-82a7-b13cfd13ae93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:05 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e4389fd6-b8ce-480d-9695-a7c01182fd24 tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a0d37ee8-d408-4ef8-82a7-b13cfd13ae93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:05 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e4389fd6-b8ce-480d-9695-a7c01182fd24 tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b2d75bc-2db1-4aa6-940e-0e3d74d411df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:05 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e4389fd6-b8ce-480d-9695-a7c01182fd24 tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0b2d75bc-2db1-4aa6-940e-0e3d74d411df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ba5e9539-fefd-4f9c-abef-88c242f05b05', 'volume_name': 'volume-ba5e9539-fefd-4f9c-abef-88c242f05b05', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:05 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e4389fd6-b8ce-480d-9695-a7c01182fd24 tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2d970ca-5083-4bc3-8ccf-7f290d21ea4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:05 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e4389fd6-b8ce-480d-9695-a7c01182fd24 tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d2d970ca-5083-4bc3-8ccf-7f290d21ea4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:05 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e4389fd6-b8ce-480d-9695-a7c01182fd24 tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1a340b1-9769-4576-9dd4-9ac8734e8057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:05 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-e4389fd6-b8ce-480d-9695-a7c01182fd24 tempest-ProjectReaderTests-532564148 None] Volume ba5e9539-fefd-4f9c-abef-88c242f05b05: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ba5e9539-fefd-4f9c-abef-88c242f05b05', 'volume_size': 1} Nov 01 12:40:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e4389fd6-b8ce-480d-9695-a7c01182fd24 tempest-ProjectReaderTests-532564148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e4389fd6-b8ce-480d-9695-a7c01182fd24 tempest-ProjectReaderTests-532564148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:05 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e4389fd6-b8ce-480d-9695-a7c01182fd24 tempest-ProjectReaderTests-532564148 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-359711747',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ba5e9539-fefd-4f9c-abef-88c242f05b05,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='129b361527b34b0ab7e69215b88d2dad',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:06Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:06Z,use_quota=True,user_id='2e13b273b0034c9683a67046323971d4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:40:05 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-e4389fd6-b8ce-480d-9695-a7c01182fd24 tempest-ProjectReaderTests-532564148 None] Creating volume ba5e9539-fefd-4f9c-abef-88c242f05b05 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:40:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e4389fd6-b8ce-480d-9695-a7c01182fd24 tempest-ProjectReaderTests-532564148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e4389fd6-b8ce-480d-9695-a7c01182fd24 tempest-ProjectReaderTests-532564148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:05 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e4389fd6-b8ce-480d-9695-a7c01182fd24 tempest-ProjectReaderTests-532564148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:05 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e4389fd6-b8ce-480d-9695-a7c01182fd24 tempest-ProjectReaderTests-532564148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e4389fd6-b8ce-480d-9695-a7c01182fd24 tempest-ProjectReaderTests-532564148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:05 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e4389fd6-b8ce-480d-9695-a7c01182fd24 tempest-ProjectReaderTests-532564148 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:40:05 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-e4389fd6-b8ce-480d-9695-a7c01182fd24 tempest-ProjectReaderTests-532564148 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:40:05 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e4389fd6-b8ce-480d-9695-a7c01182fd24 tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ba5e9539-fefd-4f9c-abef-88c242f05b05 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:05 devstack sudo[107042]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ba5e9539-fefd-4f9c-abef-88c242f05b05 1073741824 Nov 01 12:40:05 devstack sudo[107042]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:06 devstack sudo[107040]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ba55d163-5834-43f5-8190-3b55360d36f1 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5.e49b4abf-6ad3-464b-9bf3-6c28df6d06de" returned: 0 in 0.332s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ba55d163-5834-43f5-8190-3b55360d36f1 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5.e49b4abf-6ad3-464b-9bf3-6c28df6d06de {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:06 devstack sudo[107049]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5.e49b4abf-6ad3-464b-9bf3-6c28df6d06de Nov 01 12:40:06 devstack sudo[107049]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:06 devstack sudo[107042]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e4389fd6-b8ce-480d-9695-a7c01182fd24 tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ba5e9539-fefd-4f9c-abef-88c242f05b05 1073741824" returned: 0 in 0.454s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e4389fd6-b8ce-480d-9695-a7c01182fd24 tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ba5e9539-fefd-4f9c-abef-88c242f05b05 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:06 devstack sudo[107049]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-ba55d163-5834-43f5-8190-3b55360d36f1 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5.e49b4abf-6ad3-464b-9bf3-6c28df6d06de" returned: 0 in 0.284s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:06 devstack sudo[107055]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ba5e9539-fefd-4f9c-abef-88c242f05b05 Nov 01 12:40:06 devstack sudo[107055]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:06 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ba55d163-5834-43f5-8190-3b55360d36f1 tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-e49b4abf-6ad3-464b-9bf3-6c28df6d06de" released by "_delete_snapshot" :: held 1.520s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:06 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ba55d163-5834-43f5-8190-3b55360d36f1 tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5" released by "delete_snapshot" :: held 1.556s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:06 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-ba55d163-5834-43f5-8190-3b55360d36f1 tempest-ProjectMemberTests-538781697 None] Created reservations ['cd2b1c66-5952-4892-a65c-d6e7797c0eb8', 'bde21f00-ab59-4c47-91c9-f93d40b8385a', 'ff70d285-88b2-4b57-97a0-b795aebb4395', '01de1d9d-5128-46b3-aec1-404ecdc5fe09'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:40:06 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-ba55d163-5834-43f5-8190-3b55360d36f1 tempest-ProjectMemberTests-538781697 None] Delete snapshot completed successfully. Nov 01 12:40:06 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-ba55d163-5834-43f5-8190-3b55360d36f1 tempest-ProjectMemberTests-538781697 None] Lock "cinder-e49b4abf-6ad3-464b-9bf3-6c28df6d06de-delete_snapshot" released by "delete_snapshot" :: held 1.702s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:06 devstack sudo[107055]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e4389fd6-b8ce-480d-9695-a7c01182fd24 tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ba5e9539-fefd-4f9c-abef-88c242f05b05" returned: 0 in 0.247s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:06 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e4389fd6-b8ce-480d-9695-a7c01182fd24 tempest-ProjectReaderTests-532564148 None] <== create_volume: return (749ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:40:06 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e4389fd6-b8ce-480d-9695-a7c01182fd24 tempest-ProjectReaderTests-532564148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.752s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:06 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e4389fd6-b8ce-480d-9695-a7c01182fd24 tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1a340b1-9769-4576-9dd4-9ac8734e8057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ba5e9539-fefd-4f9c-abef-88c242f05b05', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:06 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e4389fd6-b8ce-480d-9695-a7c01182fd24 tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cba6507e-6011-4c72-9cc5-45562d64cdc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:06 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-e4389fd6-b8ce-480d-9695-a7c01182fd24 tempest-ProjectReaderTests-532564148 None] Volume volume-ba5e9539-fefd-4f9c-abef-88c242f05b05 (ba5e9539-fefd-4f9c-abef-88c242f05b05): created successfully Nov 01 12:40:06 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e4389fd6-b8ce-480d-9695-a7c01182fd24 tempest-ProjectReaderTests-532564148 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cba6507e-6011-4c72-9cc5-45562d64cdc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:06 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-e4389fd6-b8ce-480d-9695-a7c01182fd24 tempest-ProjectReaderTests-532564148 None] Flow 'volume_create_manager' (a72864a2-dcce-462e-9ca4-5ce5ef56abe0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:06 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-e4389fd6-b8ce-480d-9695-a7c01182fd24 tempest-ProjectReaderTests-532564148 None] Created volume successfully. Nov 01 12:40:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b6c6c057-8e08-4f50-8819-db00d3400bed tempest-ProjectReaderTests-532564148 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b6c6c057-8e08-4f50-8819-db00d3400bed tempest-ProjectReaderTests-532564148 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:07 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-b6c6c057-8e08-4f50-8819-db00d3400bed tempest-ProjectReaderTests-532564148 None] Creating offline snapshot 3d702f77-c55b-4a5a-94f5-956fce451eef of volume ba5e9539-fefd-4f9c-abef-88c242f05b05 {{(pid=86574) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:40:07 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed74f3fd-f999-41d6-857a-396492022fd6]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b6c6c057-8e08-4f50-8819-db00d3400bed tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ba5e9539-fefd-4f9c-abef-88c242f05b05 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:07 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-576317dc-0dac-46c4-90bf-b19f29ce2711 tempest-ProjectMemberTests-538781697 None] Acquiring lock "cinder-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:07 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-576317dc-0dac-46c4-90bf-b19f29ce2711 tempest-ProjectMemberTests-538781697 None] Lock "cinder-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:07 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-576317dc-0dac-46c4-90bf-b19f29ce2711 tempest-ProjectMemberTests-538781697 None] Acquiring lock "cinder-quobyte-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:07 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-576317dc-0dac-46c4-90bf-b19f29ce2711 tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5" acquired by "delete_volume" :: waited 0.019s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:07 devstack sudo[107058]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ba5e9539-fefd-4f9c-abef-88c242f05b05 Nov 01 12:40:07 devstack sudo[107058]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:07 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[900d4385-ca57-4e5c-a953-7106f982070f]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-576317dc-0dac-46c4-90bf-b19f29ce2711 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:07 devstack sudo[107060]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5 Nov 01 12:40:07 devstack sudo[107060]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:07 devstack sudo[107058]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b6c6c057-8e08-4f50-8819-db00d3400bed tempest-ProjectReaderTests-532564148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ba5e9539-fefd-4f9c-abef-88c242f05b05" returned: 0 in 0.396s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b6c6c057-8e08-4f50-8819-db00d3400bed tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ba5e9539-fefd-4f9c-abef-88c242f05b05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ba5e9539-fefd-4f9c-abef-88c242f05b05.3d702f77-c55b-4a5a-94f5-956fce451eef 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:07 devstack sudo[107065]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ba5e9539-fefd-4f9c-abef-88c242f05b05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ba5e9539-fefd-4f9c-abef-88c242f05b05.3d702f77-c55b-4a5a-94f5-956fce451eef 1G Nov 01 12:40:07 devstack sudo[107065]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:07 devstack sudo[107060]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-576317dc-0dac-46c4-90bf-b19f29ce2711 tempest-ProjectMemberTests-538781697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5" returned: 0 in 0.376s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-576317dc-0dac-46c4-90bf-b19f29ce2711 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:07 devstack sudo[107070]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5 Nov 01 12:40:07 devstack sudo[107070]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:07 devstack sudo[107070]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-576317dc-0dac-46c4-90bf-b19f29ce2711 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5" returned: 0 in 0.238s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:07 devstack sudo[107065]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b6c6c057-8e08-4f50-8819-db00d3400bed tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ba5e9539-fefd-4f9c-abef-88c242f05b05,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ba5e9539-fefd-4f9c-abef-88c242f05b05.3d702f77-c55b-4a5a-94f5-956fce451eef 1G" returned: 0 in 0.393s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b6c6c057-8e08-4f50-8819-db00d3400bed tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba5e9539-fefd-4f9c-abef-88c242f05b05 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ba5e9539-fefd-4f9c-abef-88c242f05b05.3d702f77-c55b-4a5a-94f5-956fce451eef {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:07 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-576317dc-0dac-46c4-90bf-b19f29ce2711 tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5" released by "delete_volume" :: held 0.686s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:07 devstack sudo[107076]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba5e9539-fefd-4f9c-abef-88c242f05b05 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ba5e9539-fefd-4f9c-abef-88c242f05b05.3d702f77-c55b-4a5a-94f5-956fce451eef Nov 01 12:40:07 devstack sudo[107076]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:07 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-576317dc-0dac-46c4-90bf-b19f29ce2711 tempest-ProjectMemberTests-538781697 None] Created reservations ['8bd02c7e-0cb8-43c4-a203-3e3209abb12d', 'b7265230-5185-43da-b4dd-d88e2b7d45a7', 'fa34c019-98a7-40c0-aef1-c69dbe6a5f15', 'b486eef1-77ed-4aeb-b01a-a6001072325c'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:40:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-576317dc-0dac-46c4-90bf-b19f29ce2711 tempest-ProjectMemberTests-538781697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-576317dc-0dac-46c4-90bf-b19f29ce2711 tempest-ProjectMemberTests-538781697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:07 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-576317dc-0dac-46c4-90bf-b19f29ce2711 tempest-ProjectMemberTests-538781697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:07 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-576317dc-0dac-46c4-90bf-b19f29ce2711 tempest-ProjectMemberTests-538781697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-576317dc-0dac-46c4-90bf-b19f29ce2711 tempest-ProjectMemberTests-538781697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:07 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-576317dc-0dac-46c4-90bf-b19f29ce2711 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:07 devstack sudo[107078]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:40:07 devstack sudo[107078]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:08 devstack sudo[107076]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b6c6c057-8e08-4f50-8819-db00d3400bed tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ba5e9539-fefd-4f9c-abef-88c242f05b05 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ba5e9539-fefd-4f9c-abef-88c242f05b05.3d702f77-c55b-4a5a-94f5-956fce451eef" returned: 0 in 0.294s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:08 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-b6c6c057-8e08-4f50-8819-db00d3400bed tempest-ProjectReaderTests-532564148 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ba5e9539-fefd-4f9c-abef-88c242f05b05.3d702f77-c55b-4a5a-94f5-956fce451eef is being set with open permissions: ugo+rw Nov 01 12:40:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b6c6c057-8e08-4f50-8819-db00d3400bed tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ba5e9539-fefd-4f9c-abef-88c242f05b05.3d702f77-c55b-4a5a-94f5-956fce451eef {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:08 devstack sudo[107083]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ba5e9539-fefd-4f9c-abef-88c242f05b05.3d702f77-c55b-4a5a-94f5-956fce451eef Nov 01 12:40:08 devstack sudo[107083]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:08 devstack sudo[107078]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-576317dc-0dac-46c4-90bf-b19f29ce2711 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.268s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:08 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-576317dc-0dac-46c4-90bf-b19f29ce2711 tempest-ProjectMemberTests-538781697 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:40:08 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-576317dc-0dac-46c4-90bf-b19f29ce2711 tempest-ProjectMemberTests-538781697 None] Deleted volume successfully. Nov 01 12:40:08 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-576317dc-0dac-46c4-90bf-b19f29ce2711 tempest-ProjectMemberTests-538781697 None] Lock "cinder-5580e5fd-7be3-4e34-ab68-fc4f2dfc00b5-delete_volume" released by "delete_volume" :: held 1.169s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:08 devstack sudo[107083]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b6c6c057-8e08-4f50-8819-db00d3400bed tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ba5e9539-fefd-4f9c-abef-88c242f05b05.3d702f77-c55b-4a5a-94f5-956fce451eef" returned: 0 in 0.253s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b6c6c057-8e08-4f50-8819-db00d3400bed tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ba5e9539-fefd-4f9c-abef-88c242f05b05.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:08 devstack sudo[107087]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ba5e9539-fefd-4f9c-abef-88c242f05b05.info Nov 01 12:40:08 devstack sudo[107087]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:08 devstack sudo[107087]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b6c6c057-8e08-4f50-8819-db00d3400bed tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ba5e9539-fefd-4f9c-abef-88c242f05b05.info" returned: 0 in 0.281s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:08 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-b6c6c057-8e08-4f50-8819-db00d3400bed tempest-ProjectReaderTests-532564148 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ba5e9539-fefd-4f9c-abef-88c242f05b05.info is being set with open permissions: ugo+rw Nov 01 12:40:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b6c6c057-8e08-4f50-8819-db00d3400bed tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ba5e9539-fefd-4f9c-abef-88c242f05b05.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:08 devstack sudo[107091]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ba5e9539-fefd-4f9c-abef-88c242f05b05.info Nov 01 12:40:08 devstack sudo[107091]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:08 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-7cab482e-a07b-4c64-9189-66220eb27973 tempest-ProjectMemberTests-538781697 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:40:08 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-7cab482e-a07b-4c64-9189-66220eb27973 tempest-ProjectMemberTests-538781697 None] Flow 'volume_create_manager' (806544f6-addb-4ab2-bb00-2535fc654bb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:08 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-7cab482e-a07b-4c64-9189-66220eb27973 tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cdf1752-b374-4f73-b6b3-e7091392d123) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:08 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-7cab482e-a07b-4c64-9189-66220eb27973 tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (7cdf1752-b374-4f73-b6b3-e7091392d123) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-297690421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed86272c-16ac-49de-bc53-6f04872449f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe0ffaf6cf1d4294aa9f030164447d48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:09Z,use_quota=True,user_id='f617cd7e548d4a989b479812bba708f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:08 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-7cab482e-a07b-4c64-9189-66220eb27973 tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff4cf59b-be49-4d4d-8c62-3a01f87a1001) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:08 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-7cab482e-a07b-4c64-9189-66220eb27973 tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ff4cf59b-be49-4d4d-8c62-3a01f87a1001) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:08 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-7cab482e-a07b-4c64-9189-66220eb27973 tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76c804e6-8152-4a22-9f5f-3bd510d2a002) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:08 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-7cab482e-a07b-4c64-9189-66220eb27973 tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (76c804e6-8152-4a22-9f5f-3bd510d2a002) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ed86272c-16ac-49de-bc53-6f04872449f4', 'volume_name': 'volume-ed86272c-16ac-49de-bc53-6f04872449f4', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:08 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-7cab482e-a07b-4c64-9189-66220eb27973 tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbc25091-8d04-46be-9171-4c0b637d01a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:08 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-7cab482e-a07b-4c64-9189-66220eb27973 tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbc25091-8d04-46be-9171-4c0b637d01a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:08 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-7cab482e-a07b-4c64-9189-66220eb27973 tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9773954-cc6f-47f8-b071-91948c706e5a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:08 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-7cab482e-a07b-4c64-9189-66220eb27973 tempest-ProjectMemberTests-538781697 None] Volume ed86272c-16ac-49de-bc53-6f04872449f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ed86272c-16ac-49de-bc53-6f04872449f4', 'volume_size': 1} Nov 01 12:40:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-7cab482e-a07b-4c64-9189-66220eb27973 tempest-ProjectMemberTests-538781697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:08 devstack sudo[107091]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b6c6c057-8e08-4f50-8819-db00d3400bed tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ba5e9539-fefd-4f9c-abef-88c242f05b05.info" returned: 0 in 0.234s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-b6c6c057-8e08-4f50-8819-db00d3400bed tempest-ProjectReaderTests-532564148 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.928s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-7cab482e-a07b-4c64-9189-66220eb27973 tempest-ProjectMemberTests-538781697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.137s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:08 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-7cab482e-a07b-4c64-9189-66220eb27973 tempest-ProjectMemberTests-538781697 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-297690421',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ed86272c-16ac-49de-bc53-6f04872449f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fe0ffaf6cf1d4294aa9f030164447d48',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:09Z,use_quota=True,user_id='f617cd7e548d4a989b479812bba708f0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:40:08 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-7cab482e-a07b-4c64-9189-66220eb27973 tempest-ProjectMemberTests-538781697 None] Creating volume ed86272c-16ac-49de-bc53-6f04872449f4 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:40:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-7cab482e-a07b-4c64-9189-66220eb27973 tempest-ProjectMemberTests-538781697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-7cab482e-a07b-4c64-9189-66220eb27973 tempest-ProjectMemberTests-538781697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:08 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-7cab482e-a07b-4c64-9189-66220eb27973 tempest-ProjectMemberTests-538781697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:08 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-7cab482e-a07b-4c64-9189-66220eb27973 tempest-ProjectMemberTests-538781697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-7cab482e-a07b-4c64-9189-66220eb27973 tempest-ProjectMemberTests-538781697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.005s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:08 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-7cab482e-a07b-4c64-9189-66220eb27973 tempest-ProjectMemberTests-538781697 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:40:08 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-7cab482e-a07b-4c64-9189-66220eb27973 tempest-ProjectMemberTests-538781697 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:40:08 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7cab482e-a07b-4c64-9189-66220eb27973 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed86272c-16ac-49de-bc53-6f04872449f4 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:08 devstack sudo[107094]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed86272c-16ac-49de-bc53-6f04872449f4 1073741824 Nov 01 12:40:08 devstack sudo[107094]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:08 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-b6c6c057-8e08-4f50-8819-db00d3400bed tempest-ProjectReaderTests-532564148 None] Create snapshot completed successfully Nov 01 12:40:09 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b7e999e3-3920-4ff5-9813-fb89df5458e0 tempest-ProjectReaderTests-532564148 None] Acquiring lock "cinder-3d702f77-c55b-4a5a-94f5-956fce451eef-delete_snapshot" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:09 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b7e999e3-3920-4ff5-9813-fb89df5458e0 tempest-ProjectReaderTests-532564148 None] Lock "cinder-3d702f77-c55b-4a5a-94f5-956fce451eef-delete_snapshot" acquired by "delete_snapshot" :: waited 0.028s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:09 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b7e999e3-3920-4ff5-9813-fb89df5458e0 tempest-ProjectReaderTests-532564148 None] Acquiring lock "cinder-quobyte-ba5e9539-fefd-4f9c-abef-88c242f05b05" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:09 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b7e999e3-3920-4ff5-9813-fb89df5458e0 tempest-ProjectReaderTests-532564148 None] Lock "cinder-quobyte-ba5e9539-fefd-4f9c-abef-88c242f05b05" acquired by "delete_snapshot" :: waited 0.017s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:09 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b7e999e3-3920-4ff5-9813-fb89df5458e0 tempest-ProjectReaderTests-532564148 None] Acquiring lock "cinder-quobyte-3d702f77-c55b-4a5a-94f5-956fce451eef" by "_delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:09 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b7e999e3-3920-4ff5-9813-fb89df5458e0 tempest-ProjectReaderTests-532564148 None] Lock "cinder-quobyte-3d702f77-c55b-4a5a-94f5-956fce451eef" acquired by "_delete_snapshot" :: waited 0.016s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:09 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-b7e999e3-3920-4ff5-9813-fb89df5458e0 tempest-ProjectReaderTests-532564148 None] Deleting offline snapshot 3d702f77-c55b-4a5a-94f5-956fce451eef of volume ba5e9539-fefd-4f9c-abef-88c242f05b05 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:40:09 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-b7e999e3-3920-4ff5-9813-fb89df5458e0 tempest-ProjectReaderTests-532564148 None] snapshot_file for this snap is: volume-ba5e9539-fefd-4f9c-abef-88c242f05b05.3d702f77-c55b-4a5a-94f5-956fce451eef {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:40:09 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[36332886-92ec-4dfb-be1d-2992c5d6afda]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b7e999e3-3920-4ff5-9813-fb89df5458e0 tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ba5e9539-fefd-4f9c-abef-88c242f05b05.3d702f77-c55b-4a5a-94f5-956fce451eef {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:09 devstack sudo[107099]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ba5e9539-fefd-4f9c-abef-88c242f05b05.3d702f77-c55b-4a5a-94f5-956fce451eef Nov 01 12:40:09 devstack sudo[107099]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:09 devstack sudo[107094]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7cab482e-a07b-4c64-9189-66220eb27973 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed86272c-16ac-49de-bc53-6f04872449f4 1073741824" returned: 0 in 0.431s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7cab482e-a07b-4c64-9189-66220eb27973 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed86272c-16ac-49de-bc53-6f04872449f4 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:09 devstack sudo[107102]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed86272c-16ac-49de-bc53-6f04872449f4 Nov 01 12:40:09 devstack sudo[107102]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:09 devstack sudo[107099]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b7e999e3-3920-4ff5-9813-fb89df5458e0 tempest-ProjectReaderTests-532564148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ba5e9539-fefd-4f9c-abef-88c242f05b05.3d702f77-c55b-4a5a-94f5-956fce451eef" returned: 0 in 0.406s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:09 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-b7e999e3-3920-4ff5-9813-fb89df5458e0 tempest-ProjectReaderTests-532564148 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ba5e9539-fefd-4f9c-abef-88c242f05b05(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:40:09 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[9d82edc6-9862-4bc3-a5e3-66f152dc26b8]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:09 devstack sudo[107102]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b7e999e3-3920-4ff5-9813-fb89df5458e0 tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ba5e9539-fefd-4f9c-abef-88c242f05b05 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-7cab482e-a07b-4c64-9189-66220eb27973 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed86272c-16ac-49de-bc53-6f04872449f4" returned: 0 in 0.267s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:09 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-7cab482e-a07b-4c64-9189-66220eb27973 tempest-ProjectMemberTests-538781697 None] <== create_volume: return (745ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:40:09 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-7cab482e-a07b-4c64-9189-66220eb27973 tempest-ProjectMemberTests-538781697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.748s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:09 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-7cab482e-a07b-4c64-9189-66220eb27973 tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e9773954-cc6f-47f8-b071-91948c706e5a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ed86272c-16ac-49de-bc53-6f04872449f4', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:09 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-7cab482e-a07b-4c64-9189-66220eb27973 tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcacf798-36b6-4399-9658-16611f6dc372) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:09 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-7cab482e-a07b-4c64-9189-66220eb27973 tempest-ProjectMemberTests-538781697 None] Volume volume-ed86272c-16ac-49de-bc53-6f04872449f4 (ed86272c-16ac-49de-bc53-6f04872449f4): created successfully Nov 01 12:40:09 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-7cab482e-a07b-4c64-9189-66220eb27973 tempest-ProjectMemberTests-538781697 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (bcacf798-36b6-4399-9658-16611f6dc372) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:09 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-7cab482e-a07b-4c64-9189-66220eb27973 tempest-ProjectMemberTests-538781697 None] Flow 'volume_create_manager' (806544f6-addb-4ab2-bb00-2535fc654bb5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:09 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-7cab482e-a07b-4c64-9189-66220eb27973 tempest-ProjectMemberTests-538781697 None] Created volume successfully. Nov 01 12:40:09 devstack sudo[107108]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ba5e9539-fefd-4f9c-abef-88c242f05b05 Nov 01 12:40:09 devstack sudo[107108]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:10 devstack sudo[107108]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b7e999e3-3920-4ff5-9813-fb89df5458e0 tempest-ProjectReaderTests-532564148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ba5e9539-fefd-4f9c-abef-88c242f05b05" returned: 0 in 0.351s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b7e999e3-3920-4ff5-9813-fb89df5458e0 tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ba5e9539-fefd-4f9c-abef-88c242f05b05.3d702f77-c55b-4a5a-94f5-956fce451eef {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:10 devstack sudo[107113]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ba5e9539-fefd-4f9c-abef-88c242f05b05.3d702f77-c55b-4a5a-94f5-956fce451eef Nov 01 12:40:10 devstack sudo[107113]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:10 devstack sudo[107113]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b7e999e3-3920-4ff5-9813-fb89df5458e0 tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ba5e9539-fefd-4f9c-abef-88c242f05b05.3d702f77-c55b-4a5a-94f5-956fce451eef" returned: 0 in 0.326s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b7e999e3-3920-4ff5-9813-fb89df5458e0 tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ba5e9539-fefd-4f9c-abef-88c242f05b05.3d702f77-c55b-4a5a-94f5-956fce451eef {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:10 devstack sudo[107118]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ba5e9539-fefd-4f9c-abef-88c242f05b05.3d702f77-c55b-4a5a-94f5-956fce451eef Nov 01 12:40:10 devstack sudo[107118]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:10 devstack sudo[107118]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-b7e999e3-3920-4ff5-9813-fb89df5458e0 tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ba5e9539-fefd-4f9c-abef-88c242f05b05.3d702f77-c55b-4a5a-94f5-956fce451eef" returned: 0 in 0.241s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:10 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b7e999e3-3920-4ff5-9813-fb89df5458e0 tempest-ProjectReaderTests-532564148 None] Lock "cinder-quobyte-3d702f77-c55b-4a5a-94f5-956fce451eef" released by "_delete_snapshot" :: held 1.431s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:10 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b7e999e3-3920-4ff5-9813-fb89df5458e0 tempest-ProjectReaderTests-532564148 None] Lock "cinder-quobyte-ba5e9539-fefd-4f9c-abef-88c242f05b05" released by "delete_snapshot" :: held 1.456s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:10 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-b7e999e3-3920-4ff5-9813-fb89df5458e0 tempest-ProjectReaderTests-532564148 None] Created reservations ['708dcb23-7054-497f-b6d9-0683dc97d2ad', '85acf18f-e850-4102-b1ce-67f46cf30866', '098f06ee-2e63-4d11-928e-a226e5bcd42d', '3ff51b68-7bf2-42e3-946e-f0e997a376cb'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:40:10 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-b7e999e3-3920-4ff5-9813-fb89df5458e0 tempest-ProjectReaderTests-532564148 None] Delete snapshot completed successfully. Nov 01 12:40:10 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-b7e999e3-3920-4ff5-9813-fb89df5458e0 tempest-ProjectReaderTests-532564148 None] Lock "cinder-3d702f77-c55b-4a5a-94f5-956fce451eef-delete_snapshot" released by "delete_snapshot" :: held 1.602s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-627f41f7-28ba-42dc-b8e6-346e318796c7 tempest-ProjectMemberTests-538781697 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-627f41f7-28ba-42dc-b8e6-346e318796c7 tempest-ProjectMemberTests-538781697 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:10 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-627f41f7-28ba-42dc-b8e6-346e318796c7 tempest-ProjectMemberTests-538781697 None] Creating offline snapshot 93d8b607-a709-437d-ace3-65c215fab2ec of volume ed86272c-16ac-49de-bc53-6f04872449f4 {{(pid=86574) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:40:10 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[99924de1-3620-4ad3-bf0c-5105553fe8ea]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:10 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-627f41f7-28ba-42dc-b8e6-346e318796c7 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed86272c-16ac-49de-bc53-6f04872449f4 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:11 devstack sudo[107121]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed86272c-16ac-49de-bc53-6f04872449f4 Nov 01 12:40:11 devstack sudo[107121]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:11 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-8f308fda-bc5f-49f8-a3fa-2b8401ababeb tempest-ProjectReaderTests-532564148 None] Acquiring lock "cinder-ba5e9539-fefd-4f9c-abef-88c242f05b05-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:11 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-8f308fda-bc5f-49f8-a3fa-2b8401ababeb tempest-ProjectReaderTests-532564148 None] Lock "cinder-ba5e9539-fefd-4f9c-abef-88c242f05b05-delete_volume" acquired by "delete_volume" :: waited 0.034s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:11 devstack sudo[107121]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-627f41f7-28ba-42dc-b8e6-346e318796c7 tempest-ProjectMemberTests-538781697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed86272c-16ac-49de-bc53-6f04872449f4" returned: 0 in 0.393s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-627f41f7-28ba-42dc-b8e6-346e318796c7 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed86272c-16ac-49de-bc53-6f04872449f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed86272c-16ac-49de-bc53-6f04872449f4.93d8b607-a709-437d-ace3-65c215fab2ec 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:11 devstack sudo[107126]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed86272c-16ac-49de-bc53-6f04872449f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed86272c-16ac-49de-bc53-6f04872449f4.93d8b607-a709-437d-ace3-65c215fab2ec 1G Nov 01 12:40:11 devstack sudo[107126]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:11 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-8f308fda-bc5f-49f8-a3fa-2b8401ababeb tempest-ProjectReaderTests-532564148 None] Acquiring lock "cinder-quobyte-ba5e9539-fefd-4f9c-abef-88c242f05b05" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:11 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-8f308fda-bc5f-49f8-a3fa-2b8401ababeb tempest-ProjectReaderTests-532564148 None] Lock "cinder-quobyte-ba5e9539-fefd-4f9c-abef-88c242f05b05" acquired by "delete_volume" :: waited 0.015s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:11 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b2b08bd-b082-40f3-8889-b43427cf26ac]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8f308fda-bc5f-49f8-a3fa-2b8401ababeb tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ba5e9539-fefd-4f9c-abef-88c242f05b05 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:11 devstack sudo[107128]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ba5e9539-fefd-4f9c-abef-88c242f05b05 Nov 01 12:40:11 devstack sudo[107128]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:11 devstack sudo[107126]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-627f41f7-28ba-42dc-b8e6-346e318796c7 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed86272c-16ac-49de-bc53-6f04872449f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed86272c-16ac-49de-bc53-6f04872449f4.93d8b607-a709-437d-ace3-65c215fab2ec 1G" returned: 0 in 0.405s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-627f41f7-28ba-42dc-b8e6-346e318796c7 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed86272c-16ac-49de-bc53-6f04872449f4 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed86272c-16ac-49de-bc53-6f04872449f4.93d8b607-a709-437d-ace3-65c215fab2ec {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:11 devstack sudo[107133]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed86272c-16ac-49de-bc53-6f04872449f4 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed86272c-16ac-49de-bc53-6f04872449f4.93d8b607-a709-437d-ace3-65c215fab2ec Nov 01 12:40:11 devstack sudo[107133]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:11 devstack sudo[107128]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8f308fda-bc5f-49f8-a3fa-2b8401ababeb tempest-ProjectReaderTests-532564148 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ba5e9539-fefd-4f9c-abef-88c242f05b05" returned: 0 in 0.380s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:11 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8f308fda-bc5f-49f8-a3fa-2b8401ababeb tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ba5e9539-fefd-4f9c-abef-88c242f05b05 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:11 devstack sudo[107138]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ba5e9539-fefd-4f9c-abef-88c242f05b05 Nov 01 12:40:11 devstack sudo[107138]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:12 devstack sudo[107133]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-627f41f7-28ba-42dc-b8e6-346e318796c7 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-ed86272c-16ac-49de-bc53-6f04872449f4 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed86272c-16ac-49de-bc53-6f04872449f4.93d8b607-a709-437d-ace3-65c215fab2ec" returned: 0 in 0.282s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:12 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-627f41f7-28ba-42dc-b8e6-346e318796c7 tempest-ProjectMemberTests-538781697 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed86272c-16ac-49de-bc53-6f04872449f4.93d8b607-a709-437d-ace3-65c215fab2ec is being set with open permissions: ugo+rw Nov 01 12:40:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-627f41f7-28ba-42dc-b8e6-346e318796c7 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed86272c-16ac-49de-bc53-6f04872449f4.93d8b607-a709-437d-ace3-65c215fab2ec {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:12 devstack sudo[107143]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed86272c-16ac-49de-bc53-6f04872449f4.93d8b607-a709-437d-ace3-65c215fab2ec Nov 01 12:40:12 devstack sudo[107143]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:12 devstack sudo[107138]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8f308fda-bc5f-49f8-a3fa-2b8401ababeb tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ba5e9539-fefd-4f9c-abef-88c242f05b05" returned: 0 in 0.275s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:12 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-8f308fda-bc5f-49f8-a3fa-2b8401ababeb tempest-ProjectReaderTests-532564148 None] Lock "cinder-quobyte-ba5e9539-fefd-4f9c-abef-88c242f05b05" released by "delete_volume" :: held 0.723s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:12 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-8f308fda-bc5f-49f8-a3fa-2b8401ababeb tempest-ProjectReaderTests-532564148 None] Created reservations ['41babbca-2052-4298-aa22-93ce56f8ce7f', '78d00f2e-8655-480a-856b-0c85146843a4', '32b65798-2559-4b2c-8263-13f708dfcf0e', 'de0d4bfd-760b-4213-9879-d4d6ed1ef43e'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:40:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8f308fda-bc5f-49f8-a3fa-2b8401ababeb tempest-ProjectReaderTests-532564148 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8f308fda-bc5f-49f8-a3fa-2b8401ababeb tempest-ProjectReaderTests-532564148 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:12 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-8f308fda-bc5f-49f8-a3fa-2b8401ababeb tempest-ProjectReaderTests-532564148 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:12 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-8f308fda-bc5f-49f8-a3fa-2b8401ababeb tempest-ProjectReaderTests-532564148 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8f308fda-bc5f-49f8-a3fa-2b8401ababeb tempest-ProjectReaderTests-532564148 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8f308fda-bc5f-49f8-a3fa-2b8401ababeb tempest-ProjectReaderTests-532564148 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:12 devstack sudo[107147]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:40:12 devstack sudo[107147]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:12 devstack sudo[107143]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-627f41f7-28ba-42dc-b8e6-346e318796c7 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed86272c-16ac-49de-bc53-6f04872449f4.93d8b607-a709-437d-ace3-65c215fab2ec" returned: 0 in 0.262s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-627f41f7-28ba-42dc-b8e6-346e318796c7 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed86272c-16ac-49de-bc53-6f04872449f4.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:12 devstack sudo[107149]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed86272c-16ac-49de-bc53-6f04872449f4.info Nov 01 12:40:12 devstack sudo[107149]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:12 devstack sudo[107147]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8f308fda-bc5f-49f8-a3fa-2b8401ababeb tempest-ProjectReaderTests-532564148 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.267s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:12 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-8f308fda-bc5f-49f8-a3fa-2b8401ababeb tempest-ProjectReaderTests-532564148 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:40:12 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-8f308fda-bc5f-49f8-a3fa-2b8401ababeb tempest-ProjectReaderTests-532564148 None] Deleted volume successfully. Nov 01 12:40:12 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-8f308fda-bc5f-49f8-a3fa-2b8401ababeb tempest-ProjectReaderTests-532564148 None] Lock "cinder-ba5e9539-fefd-4f9c-abef-88c242f05b05-delete_volume" released by "delete_volume" :: held 1.226s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:12 devstack sudo[107149]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-627f41f7-28ba-42dc-b8e6-346e318796c7 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed86272c-16ac-49de-bc53-6f04872449f4.info" returned: 0 in 0.277s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:12 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-627f41f7-28ba-42dc-b8e6-346e318796c7 tempest-ProjectMemberTests-538781697 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed86272c-16ac-49de-bc53-6f04872449f4.info is being set with open permissions: ugo+rw Nov 01 12:40:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-627f41f7-28ba-42dc-b8e6-346e318796c7 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed86272c-16ac-49de-bc53-6f04872449f4.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:12 devstack sudo[107153]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed86272c-16ac-49de-bc53-6f04872449f4.info Nov 01 12:40:12 devstack sudo[107153]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:12 devstack sudo[107153]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-627f41f7-28ba-42dc-b8e6-346e318796c7 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed86272c-16ac-49de-bc53-6f04872449f4.info" returned: 0 in 0.244s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:12 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-627f41f7-28ba-42dc-b8e6-346e318796c7 tempest-ProjectMemberTests-538781697 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.955s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:12 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-627f41f7-28ba-42dc-b8e6-346e318796c7 tempest-ProjectMemberTests-538781697 None] Create snapshot completed successfully Nov 01 12:40:13 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-58bfd3ea-4bd1-4fb1-aa5b-4184acadb122 tempest-ProjectMemberTests-538781697 None] Acquiring lock "cinder-93d8b607-a709-437d-ace3-65c215fab2ec-delete_snapshot" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:13 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-58bfd3ea-4bd1-4fb1-aa5b-4184acadb122 tempest-ProjectMemberTests-538781697 None] Lock "cinder-93d8b607-a709-437d-ace3-65c215fab2ec-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:13 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-58bfd3ea-4bd1-4fb1-aa5b-4184acadb122 tempest-ProjectMemberTests-538781697 None] Acquiring lock "cinder-quobyte-ed86272c-16ac-49de-bc53-6f04872449f4" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:13 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-58bfd3ea-4bd1-4fb1-aa5b-4184acadb122 tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-ed86272c-16ac-49de-bc53-6f04872449f4" acquired by "delete_snapshot" :: waited 0.015s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:13 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-58bfd3ea-4bd1-4fb1-aa5b-4184acadb122 tempest-ProjectMemberTests-538781697 None] Acquiring lock "cinder-quobyte-93d8b607-a709-437d-ace3-65c215fab2ec" by "_delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:13 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-58bfd3ea-4bd1-4fb1-aa5b-4184acadb122 tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-93d8b607-a709-437d-ace3-65c215fab2ec" acquired by "_delete_snapshot" :: waited 0.017s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:13 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-58bfd3ea-4bd1-4fb1-aa5b-4184acadb122 tempest-ProjectMemberTests-538781697 None] Deleting offline snapshot 93d8b607-a709-437d-ace3-65c215fab2ec of volume ed86272c-16ac-49de-bc53-6f04872449f4 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:40:13 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-58bfd3ea-4bd1-4fb1-aa5b-4184acadb122 tempest-ProjectMemberTests-538781697 None] snapshot_file for this snap is: volume-ed86272c-16ac-49de-bc53-6f04872449f4.93d8b607-a709-437d-ace3-65c215fab2ec {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:40:13 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[0d168ad4-14bd-4b8b-96db-82a5cf78f272]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-58bfd3ea-4bd1-4fb1-aa5b-4184acadb122 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed86272c-16ac-49de-bc53-6f04872449f4.93d8b607-a709-437d-ace3-65c215fab2ec {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:13 devstack sudo[107156]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed86272c-16ac-49de-bc53-6f04872449f4.93d8b607-a709-437d-ace3-65c215fab2ec Nov 01 12:40:13 devstack sudo[107156]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:13 devstack sudo[107156]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-58bfd3ea-4bd1-4fb1-aa5b-4184acadb122 tempest-ProjectMemberTests-538781697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed86272c-16ac-49de-bc53-6f04872449f4.93d8b607-a709-437d-ace3-65c215fab2ec" returned: 0 in 0.414s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:13 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-58bfd3ea-4bd1-4fb1-aa5b-4184acadb122 tempest-ProjectMemberTests-538781697 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-ed86272c-16ac-49de-bc53-6f04872449f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:40:13 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[13459961-d5f4-4878-b33c-845fa38d653c]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:13 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-58bfd3ea-4bd1-4fb1-aa5b-4184acadb122 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed86272c-16ac-49de-bc53-6f04872449f4 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:13 devstack sudo[107162]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed86272c-16ac-49de-bc53-6f04872449f4 Nov 01 12:40:13 devstack sudo[107162]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:14 devstack sudo[107162]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:14 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-58bfd3ea-4bd1-4fb1-aa5b-4184acadb122 tempest-ProjectMemberTests-538781697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed86272c-16ac-49de-bc53-6f04872449f4" returned: 0 in 0.406s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:14 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-58bfd3ea-4bd1-4fb1-aa5b-4184acadb122 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed86272c-16ac-49de-bc53-6f04872449f4.93d8b607-a709-437d-ace3-65c215fab2ec {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:14 devstack sudo[107167]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed86272c-16ac-49de-bc53-6f04872449f4.93d8b607-a709-437d-ace3-65c215fab2ec Nov 01 12:40:14 devstack sudo[107167]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:14 devstack sudo[107167]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:14 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-58bfd3ea-4bd1-4fb1-aa5b-4184acadb122 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed86272c-16ac-49de-bc53-6f04872449f4.93d8b607-a709-437d-ace3-65c215fab2ec" returned: 0 in 0.342s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:14 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-58bfd3ea-4bd1-4fb1-aa5b-4184acadb122 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed86272c-16ac-49de-bc53-6f04872449f4.93d8b607-a709-437d-ace3-65c215fab2ec {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:14 devstack sudo[107173]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed86272c-16ac-49de-bc53-6f04872449f4.93d8b607-a709-437d-ace3-65c215fab2ec Nov 01 12:40:14 devstack sudo[107173]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:14 devstack sudo[107173]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:14 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-58bfd3ea-4bd1-4fb1-aa5b-4184acadb122 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed86272c-16ac-49de-bc53-6f04872449f4.93d8b607-a709-437d-ace3-65c215fab2ec" returned: 0 in 0.268s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:14 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-58bfd3ea-4bd1-4fb1-aa5b-4184acadb122 tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-93d8b607-a709-437d-ace3-65c215fab2ec" released by "_delete_snapshot" :: held 1.562s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:14 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-58bfd3ea-4bd1-4fb1-aa5b-4184acadb122 tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-ed86272c-16ac-49de-bc53-6f04872449f4" released by "delete_snapshot" :: held 1.587s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:14 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-58bfd3ea-4bd1-4fb1-aa5b-4184acadb122 tempest-ProjectMemberTests-538781697 None] Created reservations ['27ada3a1-d09d-428f-a2d6-60855f55d360', '7f5f9a65-fb8f-4433-a0e2-600f960265d2', 'd8db0cb8-52d8-4ac3-9ff5-2807384acc72', '7408a273-880a-4caf-afee-ee320c624272'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:40:14 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-58bfd3ea-4bd1-4fb1-aa5b-4184acadb122 tempest-ProjectMemberTests-538781697 None] Delete snapshot completed successfully. Nov 01 12:40:14 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-58bfd3ea-4bd1-4fb1-aa5b-4184acadb122 tempest-ProjectMemberTests-538781697 None] Lock "cinder-93d8b607-a709-437d-ace3-65c215fab2ec-delete_snapshot" released by "delete_snapshot" :: held 1.731s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:15 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-8c39e311-8357-4d37-9629-0d84ce9193e9 tempest-ProjectMemberTests-538781697 None] Acquiring lock "cinder-ed86272c-16ac-49de-bc53-6f04872449f4-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:15 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-8c39e311-8357-4d37-9629-0d84ce9193e9 tempest-ProjectMemberTests-538781697 None] Lock "cinder-ed86272c-16ac-49de-bc53-6f04872449f4-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:15 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-8c39e311-8357-4d37-9629-0d84ce9193e9 tempest-ProjectMemberTests-538781697 None] Acquiring lock "cinder-quobyte-ed86272c-16ac-49de-bc53-6f04872449f4" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:15 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-8c39e311-8357-4d37-9629-0d84ce9193e9 tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-ed86272c-16ac-49de-bc53-6f04872449f4" acquired by "delete_volume" :: waited 0.019s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:15 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[35b42f4d-6f8d-4f1e-8684-1aa32e26821c]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8c39e311-8357-4d37-9629-0d84ce9193e9 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed86272c-16ac-49de-bc53-6f04872449f4 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:15 devstack sudo[107176]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed86272c-16ac-49de-bc53-6f04872449f4 Nov 01 12:40:15 devstack sudo[107176]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:15 devstack sudo[107176]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8c39e311-8357-4d37-9629-0d84ce9193e9 tempest-ProjectMemberTests-538781697 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed86272c-16ac-49de-bc53-6f04872449f4" returned: 0 in 0.383s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:15 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8c39e311-8357-4d37-9629-0d84ce9193e9 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed86272c-16ac-49de-bc53-6f04872449f4 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:15 devstack sudo[107181]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed86272c-16ac-49de-bc53-6f04872449f4 Nov 01 12:40:15 devstack sudo[107181]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:16 devstack sudo[107181]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:16 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8c39e311-8357-4d37-9629-0d84ce9193e9 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-ed86272c-16ac-49de-bc53-6f04872449f4" returned: 0 in 0.260s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:16 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-8c39e311-8357-4d37-9629-0d84ce9193e9 tempest-ProjectMemberTests-538781697 None] Lock "cinder-quobyte-ed86272c-16ac-49de-bc53-6f04872449f4" released by "delete_volume" :: held 0.719s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:16 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-8c39e311-8357-4d37-9629-0d84ce9193e9 tempest-ProjectMemberTests-538781697 None] Created reservations ['0b3383e6-705b-431d-808f-8b07391e8b45', '8240110a-0a38-4b31-bd8c-06df20064308', '5e34d01e-07da-4c7b-bbac-da487657ce62', '81142183-a739-4530-878e-79cc45ef6207'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:40:16 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8c39e311-8357-4d37-9629-0d84ce9193e9 tempest-ProjectMemberTests-538781697 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:16 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8c39e311-8357-4d37-9629-0d84ce9193e9 tempest-ProjectMemberTests-538781697 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:16 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-8c39e311-8357-4d37-9629-0d84ce9193e9 tempest-ProjectMemberTests-538781697 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:16 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-8c39e311-8357-4d37-9629-0d84ce9193e9 tempest-ProjectMemberTests-538781697 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:16 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8c39e311-8357-4d37-9629-0d84ce9193e9 tempest-ProjectMemberTests-538781697 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:16 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8c39e311-8357-4d37-9629-0d84ce9193e9 tempest-ProjectMemberTests-538781697 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:16 devstack sudo[107184]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:40:16 devstack sudo[107184]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:16 devstack sudo[107184]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:16 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8c39e311-8357-4d37-9629-0d84ce9193e9 tempest-ProjectMemberTests-538781697 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.281s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:16 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-8c39e311-8357-4d37-9629-0d84ce9193e9 tempest-ProjectMemberTests-538781697 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:40:16 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-8c39e311-8357-4d37-9629-0d84ce9193e9 tempest-ProjectMemberTests-538781697 None] Deleted volume successfully. Nov 01 12:40:16 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-8c39e311-8357-4d37-9629-0d84ce9193e9 tempest-ProjectMemberTests-538781697 None] Lock "cinder-ed86272c-16ac-49de-bc53-6f04872449f4-delete_volume" released by "delete_volume" :: held 1.216s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:26 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:SELECT=180,cinder:INSERT=68,cinder:UPDATE=242,cinder:DELETE=25 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:40:26 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:SELECT=197,cinder:INSERT=68,cinder:UPDATE=260,cinder:DELETE=16 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:40:26 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-46dfd5ea-7bca-4508-b12b-8a16d24cadf4 tempest-ProjectReaderTests-1311473623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:40:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-46dfd5ea-7bca-4508-b12b-8a16d24cadf4 tempest-ProjectReaderTests-1311473623 None] Flow 'volume_create_manager' (1aece4d7-5a9a-41ac-b167-122edf5161f6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-46dfd5ea-7bca-4508-b12b-8a16d24cadf4 tempest-ProjectReaderTests-1311473623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e91cdfa-063f-4d32-81bf-73b78a26316b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-46dfd5ea-7bca-4508-b12b-8a16d24cadf4 tempest-ProjectReaderTests-1311473623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e91cdfa-063f-4d32-81bf-73b78a26316b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2074051199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15110985-eee0-465e-a43d-8dda4fc2c289,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31d77c039a7849d8b52a85779a7d3b86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:26Z,use_quota=True,user_id='15b8984bf1b64e6caf3a68207f50476b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-46dfd5ea-7bca-4508-b12b-8a16d24cadf4 tempest-ProjectReaderTests-1311473623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8570e62-5a86-4e98-af65-7fe4ca96bb1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-46dfd5ea-7bca-4508-b12b-8a16d24cadf4 tempest-ProjectReaderTests-1311473623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f8570e62-5a86-4e98-af65-7fe4ca96bb1a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-46dfd5ea-7bca-4508-b12b-8a16d24cadf4 tempest-ProjectReaderTests-1311473623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44f4ab50-0098-46bd-8dd5-377cdfb689e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-46dfd5ea-7bca-4508-b12b-8a16d24cadf4 tempest-ProjectReaderTests-1311473623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (44f4ab50-0098-46bd-8dd5-377cdfb689e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '15110985-eee0-465e-a43d-8dda4fc2c289', 'volume_name': 'volume-15110985-eee0-465e-a43d-8dda4fc2c289', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-46dfd5ea-7bca-4508-b12b-8a16d24cadf4 tempest-ProjectReaderTests-1311473623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f24e245-8cdb-41df-827a-e1d6426b440b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-46dfd5ea-7bca-4508-b12b-8a16d24cadf4 tempest-ProjectReaderTests-1311473623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0f24e245-8cdb-41df-827a-e1d6426b440b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:26 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-46dfd5ea-7bca-4508-b12b-8a16d24cadf4 tempest-ProjectReaderTests-1311473623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26a28447-02ce-458a-bd1f-339699a60e29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:26 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-46dfd5ea-7bca-4508-b12b-8a16d24cadf4 tempest-ProjectReaderTests-1311473623 None] Volume 15110985-eee0-465e-a43d-8dda4fc2c289: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-15110985-eee0-465e-a43d-8dda4fc2c289', 'volume_size': 1} Nov 01 12:40:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-46dfd5ea-7bca-4508-b12b-8a16d24cadf4 tempest-ProjectReaderTests-1311473623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-46dfd5ea-7bca-4508-b12b-8a16d24cadf4 tempest-ProjectReaderTests-1311473623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:26 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-46dfd5ea-7bca-4508-b12b-8a16d24cadf4 tempest-ProjectReaderTests-1311473623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:26Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-2074051199',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=15110985-eee0-465e-a43d-8dda4fc2c289,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31d77c039a7849d8b52a85779a7d3b86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:26Z,use_quota=True,user_id='15b8984bf1b64e6caf3a68207f50476b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:40:26 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-46dfd5ea-7bca-4508-b12b-8a16d24cadf4 tempest-ProjectReaderTests-1311473623 None] Creating volume 15110985-eee0-465e-a43d-8dda4fc2c289 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:40:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-46dfd5ea-7bca-4508-b12b-8a16d24cadf4 tempest-ProjectReaderTests-1311473623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-46dfd5ea-7bca-4508-b12b-8a16d24cadf4 tempest-ProjectReaderTests-1311473623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:26 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-46dfd5ea-7bca-4508-b12b-8a16d24cadf4 tempest-ProjectReaderTests-1311473623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:26 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-46dfd5ea-7bca-4508-b12b-8a16d24cadf4 tempest-ProjectReaderTests-1311473623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-46dfd5ea-7bca-4508-b12b-8a16d24cadf4 tempest-ProjectReaderTests-1311473623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:26 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-46dfd5ea-7bca-4508-b12b-8a16d24cadf4 tempest-ProjectReaderTests-1311473623 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:40:26 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-46dfd5ea-7bca-4508-b12b-8a16d24cadf4 tempest-ProjectReaderTests-1311473623 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:40:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-46dfd5ea-7bca-4508-b12b-8a16d24cadf4 tempest-ProjectReaderTests-1311473623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-15110985-eee0-465e-a43d-8dda4fc2c289 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:26 devstack sudo[107189]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-15110985-eee0-465e-a43d-8dda4fc2c289 1073741824 Nov 01 12:40:26 devstack sudo[107189]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:26 devstack sudo[107189]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-46dfd5ea-7bca-4508-b12b-8a16d24cadf4 tempest-ProjectReaderTests-1311473623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-15110985-eee0-465e-a43d-8dda4fc2c289 1073741824" returned: 0 in 0.504s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:26 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-46dfd5ea-7bca-4508-b12b-8a16d24cadf4 tempest-ProjectReaderTests-1311473623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-15110985-eee0-465e-a43d-8dda4fc2c289 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:26 devstack sudo[107194]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-15110985-eee0-465e-a43d-8dda4fc2c289 Nov 01 12:40:26 devstack sudo[107194]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:27 devstack sudo[107194]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-46dfd5ea-7bca-4508-b12b-8a16d24cadf4 tempest-ProjectReaderTests-1311473623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-15110985-eee0-465e-a43d-8dda4fc2c289" returned: 0 in 0.293s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:27 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-46dfd5ea-7bca-4508-b12b-8a16d24cadf4 tempest-ProjectReaderTests-1311473623 None] <== create_volume: return (848ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:40:27 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-46dfd5ea-7bca-4508-b12b-8a16d24cadf4 tempest-ProjectReaderTests-1311473623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.851s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-46dfd5ea-7bca-4508-b12b-8a16d24cadf4 tempest-ProjectReaderTests-1311473623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (26a28447-02ce-458a-bd1f-339699a60e29) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-15110985-eee0-465e-a43d-8dda4fc2c289', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-46dfd5ea-7bca-4508-b12b-8a16d24cadf4 tempest-ProjectReaderTests-1311473623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (236451f8-64db-4c4c-a28f-433960097a9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:27 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-46dfd5ea-7bca-4508-b12b-8a16d24cadf4 tempest-ProjectReaderTests-1311473623 None] Volume volume-15110985-eee0-465e-a43d-8dda4fc2c289 (15110985-eee0-465e-a43d-8dda4fc2c289): created successfully Nov 01 12:40:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-46dfd5ea-7bca-4508-b12b-8a16d24cadf4 tempest-ProjectReaderTests-1311473623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (236451f8-64db-4c4c-a28f-433960097a9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:27 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-46dfd5ea-7bca-4508-b12b-8a16d24cadf4 tempest-ProjectReaderTests-1311473623 None] Flow 'volume_create_manager' (1aece4d7-5a9a-41ac-b167-122edf5161f6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:27 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-46dfd5ea-7bca-4508-b12b-8a16d24cadf4 tempest-ProjectReaderTests-1311473623 None] Created volume successfully. Nov 01 12:40:28 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-9151a5c9-9b0d-4898-a57e-356040b0018b tempest-ProjectReaderTests-1311473623 None] Acquiring lock "cinder-15110985-eee0-465e-a43d-8dda4fc2c289-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:28 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-9151a5c9-9b0d-4898-a57e-356040b0018b tempest-ProjectReaderTests-1311473623 None] Lock "cinder-15110985-eee0-465e-a43d-8dda4fc2c289-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:28 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-9151a5c9-9b0d-4898-a57e-356040b0018b tempest-ProjectReaderTests-1311473623 None] Acquiring lock "cinder-quobyte-15110985-eee0-465e-a43d-8dda4fc2c289" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:28 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-9151a5c9-9b0d-4898-a57e-356040b0018b tempest-ProjectReaderTests-1311473623 None] Lock "cinder-quobyte-15110985-eee0-465e-a43d-8dda4fc2c289" acquired by "delete_volume" :: waited 0.023s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:28 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[6beba823-527a-454f-9156-48f97fb74259]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:28 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9151a5c9-9b0d-4898-a57e-356040b0018b tempest-ProjectReaderTests-1311473623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-15110985-eee0-465e-a43d-8dda4fc2c289 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:28 devstack sudo[107198]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-15110985-eee0-465e-a43d-8dda4fc2c289 Nov 01 12:40:28 devstack sudo[107198]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:29 devstack sudo[107198]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9151a5c9-9b0d-4898-a57e-356040b0018b tempest-ProjectReaderTests-1311473623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-15110985-eee0-465e-a43d-8dda4fc2c289" returned: 0 in 0.368s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9151a5c9-9b0d-4898-a57e-356040b0018b tempest-ProjectReaderTests-1311473623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-15110985-eee0-465e-a43d-8dda4fc2c289 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:29 devstack sudo[107203]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-15110985-eee0-465e-a43d-8dda4fc2c289 Nov 01 12:40:29 devstack sudo[107203]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:29 devstack sudo[107203]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9151a5c9-9b0d-4898-a57e-356040b0018b tempest-ProjectReaderTests-1311473623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-15110985-eee0-465e-a43d-8dda4fc2c289" returned: 0 in 0.262s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:29 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-9151a5c9-9b0d-4898-a57e-356040b0018b tempest-ProjectReaderTests-1311473623 None] Lock "cinder-quobyte-15110985-eee0-465e-a43d-8dda4fc2c289" released by "delete_volume" :: held 0.681s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:29 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-9151a5c9-9b0d-4898-a57e-356040b0018b tempest-ProjectReaderTests-1311473623 None] Created reservations ['2f7d2a54-f22a-4e84-a788-ab7232d72c89', '3b966068-cdbc-43c8-89c0-b2e0439745db', '35a97956-ede4-48a5-a540-43d0220bd843', '5e44cf1b-f1d5-474c-8e54-997c88ad426f'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:40:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-9151a5c9-9b0d-4898-a57e-356040b0018b tempest-ProjectReaderTests-1311473623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-9151a5c9-9b0d-4898-a57e-356040b0018b tempest-ProjectReaderTests-1311473623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:29 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-9151a5c9-9b0d-4898-a57e-356040b0018b tempest-ProjectReaderTests-1311473623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:29 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-9151a5c9-9b0d-4898-a57e-356040b0018b tempest-ProjectReaderTests-1311473623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-9151a5c9-9b0d-4898-a57e-356040b0018b tempest-ProjectReaderTests-1311473623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9151a5c9-9b0d-4898-a57e-356040b0018b tempest-ProjectReaderTests-1311473623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:29 devstack sudo[107206]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:40:29 devstack sudo[107206]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:29 devstack sudo[107206]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:29 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-9151a5c9-9b0d-4898-a57e-356040b0018b tempest-ProjectReaderTests-1311473623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.286s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:29 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-9151a5c9-9b0d-4898-a57e-356040b0018b tempest-ProjectReaderTests-1311473623 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:40:29 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-9151a5c9-9b0d-4898-a57e-356040b0018b tempest-ProjectReaderTests-1311473623 None] Deleted volume successfully. Nov 01 12:40:29 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-9151a5c9-9b0d-4898-a57e-356040b0018b tempest-ProjectReaderTests-1311473623 None] Lock "cinder-15110985-eee0-465e-a43d-8dda4fc2c289-delete_volume" released by "delete_volume" :: held 1.245s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:30 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-000d48dc-33ea-419a-a9e8-c28bbf10e676 tempest-ProjectReaderTests-1311473623 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:40:30 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-000d48dc-33ea-419a-a9e8-c28bbf10e676 tempest-ProjectReaderTests-1311473623 None] Flow 'volume_create_manager' (d4631712-d4ea-4482-aeac-eb69d8013aef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:30 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-000d48dc-33ea-419a-a9e8-c28bbf10e676 tempest-ProjectReaderTests-1311473623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f07110eb-d148-46d7-b713-e2c16d489515) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:30 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-000d48dc-33ea-419a-a9e8-c28bbf10e676 tempest-ProjectReaderTests-1311473623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f07110eb-d148-46d7-b713-e2c16d489515) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-931778331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47880a86-0209-4802-b5fc-158125218d4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31d77c039a7849d8b52a85779a7d3b86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:30Z,use_quota=True,user_id='15b8984bf1b64e6caf3a68207f50476b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:30 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-000d48dc-33ea-419a-a9e8-c28bbf10e676 tempest-ProjectReaderTests-1311473623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc3bd13b-ce65-49de-98e9-faf30b6b44f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:30 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-000d48dc-33ea-419a-a9e8-c28bbf10e676 tempest-ProjectReaderTests-1311473623 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bc3bd13b-ce65-49de-98e9-faf30b6b44f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:30 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-000d48dc-33ea-419a-a9e8-c28bbf10e676 tempest-ProjectReaderTests-1311473623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4206265c-4574-4761-9587-3a603b1bba62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:30 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-000d48dc-33ea-419a-a9e8-c28bbf10e676 tempest-ProjectReaderTests-1311473623 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4206265c-4574-4761-9587-3a603b1bba62) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47880a86-0209-4802-b5fc-158125218d4a', 'volume_name': 'volume-47880a86-0209-4802-b5fc-158125218d4a', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:30 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-000d48dc-33ea-419a-a9e8-c28bbf10e676 tempest-ProjectReaderTests-1311473623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ac0b2ce-5663-4bb9-aa8c-4079f7963689) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:30 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-000d48dc-33ea-419a-a9e8-c28bbf10e676 tempest-ProjectReaderTests-1311473623 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4ac0b2ce-5663-4bb9-aa8c-4079f7963689) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:30 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-000d48dc-33ea-419a-a9e8-c28bbf10e676 tempest-ProjectReaderTests-1311473623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f86c639-ea21-4ddf-a312-feed85311688) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:30 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-000d48dc-33ea-419a-a9e8-c28bbf10e676 tempest-ProjectReaderTests-1311473623 None] Volume 47880a86-0209-4802-b5fc-158125218d4a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47880a86-0209-4802-b5fc-158125218d4a', 'volume_size': 1} Nov 01 12:40:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-000d48dc-33ea-419a-a9e8-c28bbf10e676 tempest-ProjectReaderTests-1311473623 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-000d48dc-33ea-419a-a9e8-c28bbf10e676 tempest-ProjectReaderTests-1311473623 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:30 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-000d48dc-33ea-419a-a9e8-c28bbf10e676 tempest-ProjectReaderTests-1311473623 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeV3RbacBaseTests-Volume-931778331',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47880a86-0209-4802-b5fc-158125218d4a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='31d77c039a7849d8b52a85779a7d3b86',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:30Z,use_quota=True,user_id='15b8984bf1b64e6caf3a68207f50476b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:40:30 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-000d48dc-33ea-419a-a9e8-c28bbf10e676 tempest-ProjectReaderTests-1311473623 None] Creating volume 47880a86-0209-4802-b5fc-158125218d4a {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:40:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-000d48dc-33ea-419a-a9e8-c28bbf10e676 tempest-ProjectReaderTests-1311473623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-000d48dc-33ea-419a-a9e8-c28bbf10e676 tempest-ProjectReaderTests-1311473623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:30 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-000d48dc-33ea-419a-a9e8-c28bbf10e676 tempest-ProjectReaderTests-1311473623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:30 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-000d48dc-33ea-419a-a9e8-c28bbf10e676 tempest-ProjectReaderTests-1311473623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-000d48dc-33ea-419a-a9e8-c28bbf10e676 tempest-ProjectReaderTests-1311473623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:30 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-000d48dc-33ea-419a-a9e8-c28bbf10e676 tempest-ProjectReaderTests-1311473623 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:40:30 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-000d48dc-33ea-419a-a9e8-c28bbf10e676 tempest-ProjectReaderTests-1311473623 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:40:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-000d48dc-33ea-419a-a9e8-c28bbf10e676 tempest-ProjectReaderTests-1311473623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-47880a86-0209-4802-b5fc-158125218d4a 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:30 devstack sudo[107209]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-47880a86-0209-4802-b5fc-158125218d4a 1073741824 Nov 01 12:40:30 devstack sudo[107209]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:30 devstack sudo[107209]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-000d48dc-33ea-419a-a9e8-c28bbf10e676 tempest-ProjectReaderTests-1311473623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-47880a86-0209-4802-b5fc-158125218d4a 1073741824" returned: 0 in 0.504s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:30 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-000d48dc-33ea-419a-a9e8-c28bbf10e676 tempest-ProjectReaderTests-1311473623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-47880a86-0209-4802-b5fc-158125218d4a {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:30 devstack sudo[107215]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-47880a86-0209-4802-b5fc-158125218d4a Nov 01 12:40:30 devstack sudo[107215]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:31 devstack sudo[107215]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-000d48dc-33ea-419a-a9e8-c28bbf10e676 tempest-ProjectReaderTests-1311473623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-47880a86-0209-4802-b5fc-158125218d4a" returned: 0 in 0.269s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:31 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-000d48dc-33ea-419a-a9e8-c28bbf10e676 tempest-ProjectReaderTests-1311473623 None] <== create_volume: return (818ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:40:31 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-000d48dc-33ea-419a-a9e8-c28bbf10e676 tempest-ProjectReaderTests-1311473623 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.820s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:31 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-000d48dc-33ea-419a-a9e8-c28bbf10e676 tempest-ProjectReaderTests-1311473623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f86c639-ea21-4ddf-a312-feed85311688) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47880a86-0209-4802-b5fc-158125218d4a', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:31 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-000d48dc-33ea-419a-a9e8-c28bbf10e676 tempest-ProjectReaderTests-1311473623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b8cfbb5-9642-4e48-97aa-de513affd067) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:31 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-000d48dc-33ea-419a-a9e8-c28bbf10e676 tempest-ProjectReaderTests-1311473623 None] Volume volume-47880a86-0209-4802-b5fc-158125218d4a (47880a86-0209-4802-b5fc-158125218d4a): created successfully Nov 01 12:40:31 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-000d48dc-33ea-419a-a9e8-c28bbf10e676 tempest-ProjectReaderTests-1311473623 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6b8cfbb5-9642-4e48-97aa-de513affd067) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:31 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-000d48dc-33ea-419a-a9e8-c28bbf10e676 tempest-ProjectReaderTests-1311473623 None] Flow 'volume_create_manager' (d4631712-d4ea-4482-aeac-eb69d8013aef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:31 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-000d48dc-33ea-419a-a9e8-c28bbf10e676 tempest-ProjectReaderTests-1311473623 None] Created volume successfully. Nov 01 12:40:32 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-3541f2bd-a396-4efd-b38c-5a633fe5a8d5 tempest-ProjectReaderTests-1311473623 None] Acquiring lock "cinder-47880a86-0209-4802-b5fc-158125218d4a-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:32 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-3541f2bd-a396-4efd-b38c-5a633fe5a8d5 tempest-ProjectReaderTests-1311473623 None] Lock "cinder-47880a86-0209-4802-b5fc-158125218d4a-delete_volume" acquired by "delete_volume" :: waited 0.018s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:32 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-3541f2bd-a396-4efd-b38c-5a633fe5a8d5 tempest-ProjectReaderTests-1311473623 None] Acquiring lock "cinder-quobyte-47880a86-0209-4802-b5fc-158125218d4a" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:32 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-3541f2bd-a396-4efd-b38c-5a633fe5a8d5 tempest-ProjectReaderTests-1311473623 None] Lock "cinder-quobyte-47880a86-0209-4802-b5fc-158125218d4a" acquired by "delete_volume" :: waited 0.020s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:32 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba8637e7-d20b-447f-8c2e-655ad4c1921a]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3541f2bd-a396-4efd-b38c-5a633fe5a8d5 tempest-ProjectReaderTests-1311473623 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-47880a86-0209-4802-b5fc-158125218d4a {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:32 devstack sudo[107219]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-47880a86-0209-4802-b5fc-158125218d4a Nov 01 12:40:32 devstack sudo[107219]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:32 devstack sudo[107219]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3541f2bd-a396-4efd-b38c-5a633fe5a8d5 tempest-ProjectReaderTests-1311473623 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-47880a86-0209-4802-b5fc-158125218d4a" returned: 0 in 0.403s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:32 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3541f2bd-a396-4efd-b38c-5a633fe5a8d5 tempest-ProjectReaderTests-1311473623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-47880a86-0209-4802-b5fc-158125218d4a {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:32 devstack sudo[107224]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-47880a86-0209-4802-b5fc-158125218d4a Nov 01 12:40:32 devstack sudo[107224]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:33 devstack sudo[107224]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3541f2bd-a396-4efd-b38c-5a633fe5a8d5 tempest-ProjectReaderTests-1311473623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-47880a86-0209-4802-b5fc-158125218d4a" returned: 0 in 0.254s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:33 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-3541f2bd-a396-4efd-b38c-5a633fe5a8d5 tempest-ProjectReaderTests-1311473623 None] Lock "cinder-quobyte-47880a86-0209-4802-b5fc-158125218d4a" released by "delete_volume" :: held 0.711s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:33 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-3541f2bd-a396-4efd-b38c-5a633fe5a8d5 tempest-ProjectReaderTests-1311473623 None] Created reservations ['7b1b6d0b-5dbe-4223-8539-a01ffe311828', '87227ce7-2e34-49d8-a716-9dc0ed47ee0f', 'a1bf2ce4-ccf8-4324-ba6b-f88bdb150228', '0b08b433-df73-40df-9550-ec0769a3c623'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:40:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-3541f2bd-a396-4efd-b38c-5a633fe5a8d5 tempest-ProjectReaderTests-1311473623 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-3541f2bd-a396-4efd-b38c-5a633fe5a8d5 tempest-ProjectReaderTests-1311473623 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:33 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-3541f2bd-a396-4efd-b38c-5a633fe5a8d5 tempest-ProjectReaderTests-1311473623 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:33 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-3541f2bd-a396-4efd-b38c-5a633fe5a8d5 tempest-ProjectReaderTests-1311473623 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-3541f2bd-a396-4efd-b38c-5a633fe5a8d5 tempest-ProjectReaderTests-1311473623 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3541f2bd-a396-4efd-b38c-5a633fe5a8d5 tempest-ProjectReaderTests-1311473623 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:33 devstack sudo[107227]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:40:33 devstack sudo[107227]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:33 devstack sudo[107227]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:33 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-3541f2bd-a396-4efd-b38c-5a633fe5a8d5 tempest-ProjectReaderTests-1311473623 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.262s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:33 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-3541f2bd-a396-4efd-b38c-5a633fe5a8d5 tempest-ProjectReaderTests-1311473623 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:40:33 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-3541f2bd-a396-4efd-b38c-5a633fe5a8d5 tempest-ProjectReaderTests-1311473623 None] Deleted volume successfully. Nov 01 12:40:33 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-3541f2bd-a396-4efd-b38c-5a633fe5a8d5 tempest-ProjectReaderTests-1311473623 None] Lock "cinder-47880a86-0209-4802-b5fc-158125218d4a-delete_volume" released by "delete_volume" :: held 1.199s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:39 devstack cinder-volume[86574]: DEBUG oslo_service.periodic_task [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=86574) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:40:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:39 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:39 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:39 devstack sudo[107231]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:40:39 devstack sudo[107231]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:40 devstack sudo[107231]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.273s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:40 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:40:40 devstack cinder-volume[86574]: DEBUG oslo_service.periodic_task [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] Running periodic task VolumeManager._thread_info {{(pid=86574) run_periodic_tasks /opt/stack/data/venv/lib/python3.12/site-packages/oslo_service/periodic_task.py:254}} Nov 01 12:40:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] thread count: 28 {{(pid=86574) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5472}} Nov 01 12:40:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-dbd39e93-32e5-4b50-9f8f-79c553e5d6bc None None] thread info: [<_MainThread(MainThread, started 131331184930944)>, , , , , , , , , , , , , , , , , , , , , , , , , , , ] {{(pid=86574) _thread_info /opt/stack/cinder/cinder/volume/manager.py:5473}} Nov 01 12:40:40 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-82baafae-7868-4bc2-a207-a678e641eb44 tempest-SnapshotDependencyTests-152679747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:40:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-82baafae-7868-4bc2-a207-a678e641eb44 tempest-SnapshotDependencyTests-152679747 None] Flow 'volume_create_manager' (550bae29-5a75-4bcb-851b-b8e8eab7dfef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-82baafae-7868-4bc2-a207-a678e641eb44 tempest-SnapshotDependencyTests-152679747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdb329f5-525b-4b65-8ff1-d116118f3416) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-82baafae-7868-4bc2-a207-a678e641eb44 tempest-SnapshotDependencyTests-152679747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fdb329f5-525b-4b65-8ff1-d116118f3416) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2028148721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6036ce36-4cd0-4bd9-bbb7-a10e99167267,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eb38d6956b5405b9f6f73f3c8583fc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:40Z,use_quota=True,user_id='acd55d3462ee46c0969d7ed05c030f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-82baafae-7868-4bc2-a207-a678e641eb44 tempest-SnapshotDependencyTests-152679747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5541ff06-d7a8-42c8-a38b-c6930c1c5c12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-82baafae-7868-4bc2-a207-a678e641eb44 tempest-SnapshotDependencyTests-152679747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5541ff06-d7a8-42c8-a38b-c6930c1c5c12) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-82baafae-7868-4bc2-a207-a678e641eb44 tempest-SnapshotDependencyTests-152679747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63b25c7a-0b32-488d-a883-6097cacb8dd0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-82baafae-7868-4bc2-a207-a678e641eb44 tempest-SnapshotDependencyTests-152679747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (63b25c7a-0b32-488d-a883-6097cacb8dd0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6036ce36-4cd0-4bd9-bbb7-a10e99167267', 'volume_name': 'volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-82baafae-7868-4bc2-a207-a678e641eb44 tempest-SnapshotDependencyTests-152679747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (690709a6-8cab-4730-91cb-6f8e03550bbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-82baafae-7868-4bc2-a207-a678e641eb44 tempest-SnapshotDependencyTests-152679747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (690709a6-8cab-4730-91cb-6f8e03550bbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:40 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-82baafae-7868-4bc2-a207-a678e641eb44 tempest-SnapshotDependencyTests-152679747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e594c305-5dbf-40cd-8281-c34fb658d37e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:40 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-82baafae-7868-4bc2-a207-a678e641eb44 tempest-SnapshotDependencyTests-152679747 None] Volume 6036ce36-4cd0-4bd9-bbb7-a10e99167267: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267', 'volume_size': 1} Nov 01 12:40:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-82baafae-7868-4bc2-a207-a678e641eb44 tempest-SnapshotDependencyTests-152679747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-82baafae-7868-4bc2-a207-a678e641eb44 tempest-SnapshotDependencyTests-152679747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:40 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-82baafae-7868-4bc2-a207-a678e641eb44 tempest-SnapshotDependencyTests-152679747 None] ==> create_volume: call "{'self': , 'volume': Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-2028148721',ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6036ce36-4cd0-4bd9-bbb7-a10e99167267,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eb38d6956b5405b9f6f73f3c8583fc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:40Z,use_quota=True,user_id='acd55d3462ee46c0969d7ed05c030f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)}" {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1499}} Nov 01 12:40:40 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-82baafae-7868-4bc2-a207-a678e641eb44 tempest-SnapshotDependencyTests-152679747 None] Creating volume 6036ce36-4cd0-4bd9-bbb7-a10e99167267 {{(pid=86574) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:292}} Nov 01 12:40:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-82baafae-7868-4bc2-a207-a678e641eb44 tempest-SnapshotDependencyTests-152679747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-82baafae-7868-4bc2-a207-a678e641eb44 tempest-SnapshotDependencyTests-152679747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:40 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-82baafae-7868-4bc2-a207-a678e641eb44 tempest-SnapshotDependencyTests-152679747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:40 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-82baafae-7868-4bc2-a207-a678e641eb44 tempest-SnapshotDependencyTests-152679747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-82baafae-7868-4bc2-a207-a678e641eb44 tempest-SnapshotDependencyTests-152679747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:40 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-82baafae-7868-4bc2-a207-a678e641eb44 tempest-SnapshotDependencyTests-152679747 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:40:40 devstack cinder-volume[86574]: INFO cinder.volume.drivers.remotefs [None req-82baafae-7868-4bc2-a207-a678e641eb44 tempest-SnapshotDependencyTests-152679747 None] casted to osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb Nov 01 12:40:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-82baafae-7868-4bc2-a207-a678e641eb44 tempest-SnapshotDependencyTests-152679747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267 1073741824 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:40 devstack sudo[107234]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267 1073741824 Nov 01 12:40:40 devstack sudo[107234]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:40 devstack sudo[107234]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-82baafae-7868-4bc2-a207-a678e641eb44 tempest-SnapshotDependencyTests-152679747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267 1073741824" returned: 0 in 0.428s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:40 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-82baafae-7868-4bc2-a207-a678e641eb44 tempest-SnapshotDependencyTests-152679747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:40 devstack sudo[107245]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267 Nov 01 12:40:40 devstack sudo[107245]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:41 devstack sudo[107245]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-82baafae-7868-4bc2-a207-a678e641eb44 tempest-SnapshotDependencyTests-152679747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267" returned: 0 in 0.254s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:41 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-82baafae-7868-4bc2-a207-a678e641eb44 tempest-SnapshotDependencyTests-152679747 None] <== create_volume: return (731ms) {'provider_location': 'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'} {{(pid=86574) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1524}} Nov 01 12:40:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-82baafae-7868-4bc2-a207-a678e641eb44 tempest-SnapshotDependencyTests-152679747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.734s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-82baafae-7868-4bc2-a207-a678e641eb44 tempest-SnapshotDependencyTests-152679747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e594c305-5dbf-40cd-8281-c34fb658d37e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267', 'volume_size': 1}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-82baafae-7868-4bc2-a207-a678e641eb44 tempest-SnapshotDependencyTests-152679747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a81ebfd8-5cd3-4858-be8c-d45213abfebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:41 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-82baafae-7868-4bc2-a207-a678e641eb44 tempest-SnapshotDependencyTests-152679747 None] Volume volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267 (6036ce36-4cd0-4bd9-bbb7-a10e99167267): created successfully Nov 01 12:40:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-82baafae-7868-4bc2-a207-a678e641eb44 tempest-SnapshotDependencyTests-152679747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a81ebfd8-5cd3-4858-be8c-d45213abfebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:41 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-82baafae-7868-4bc2-a207-a678e641eb44 tempest-SnapshotDependencyTests-152679747 None] Flow 'volume_create_manager' (550bae29-5a75-4bcb-851b-b8e8eab7dfef) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:41 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-82baafae-7868-4bc2-a207-a678e641eb44 tempest-SnapshotDependencyTests-152679747 None] Created volume successfully. Nov 01 12:40:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d366a472-4456-4201-b0d3-741efdee67c2 tempest-SnapshotDependencyTests-152679747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d366a472-4456-4201-b0d3-741efdee67c2 tempest-SnapshotDependencyTests-152679747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:41 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-d366a472-4456-4201-b0d3-741efdee67c2 tempest-SnapshotDependencyTests-152679747 None] Creating offline snapshot 297c5096-2010-48e9-a1d1-79950be662e4 of volume 6036ce36-4cd0-4bd9-bbb7-a10e99167267 {{(pid=86574) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1816}} Nov 01 12:40:41 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[6188887d-674d-40c4-a5a9-355533ee9b9e]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d366a472-4456-4201-b0d3-741efdee67c2 tempest-SnapshotDependencyTests-152679747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:41 devstack sudo[107248]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267 Nov 01 12:40:41 devstack sudo[107248]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:41 devstack sudo[107248]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d366a472-4456-4201-b0d3-741efdee67c2 tempest-SnapshotDependencyTests-152679747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267" returned: 0 in 0.365s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:41 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d366a472-4456-4201-b0d3-741efdee67c2 tempest-SnapshotDependencyTests-152679747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267.297c5096-2010-48e9-a1d1-79950be662e4 1G {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:42 devstack sudo[107253]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267.297c5096-2010-48e9-a1d1-79950be662e4 1G Nov 01 12:40:42 devstack sudo[107253]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:42 devstack sudo[107253]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d366a472-4456-4201-b0d3-741efdee67c2 tempest-SnapshotDependencyTests-152679747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267.297c5096-2010-48e9-a1d1-79950be662e4 1G" returned: 0 in 0.400s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d366a472-4456-4201-b0d3-741efdee67c2 tempest-SnapshotDependencyTests-152679747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267.297c5096-2010-48e9-a1d1-79950be662e4 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:42 devstack sudo[107258]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267.297c5096-2010-48e9-a1d1-79950be662e4 Nov 01 12:40:42 devstack sudo[107258]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:42 devstack sudo[107258]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d366a472-4456-4201-b0d3-741efdee67c2 tempest-SnapshotDependencyTests-152679747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img rebase -u -b volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267 -F qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267.297c5096-2010-48e9-a1d1-79950be662e4" returned: 0 in 0.290s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:42 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-d366a472-4456-4201-b0d3-741efdee67c2 tempest-SnapshotDependencyTests-152679747 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267.297c5096-2010-48e9-a1d1-79950be662e4 is being set with open permissions: ugo+rw Nov 01 12:40:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d366a472-4456-4201-b0d3-741efdee67c2 tempest-SnapshotDependencyTests-152679747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267.297c5096-2010-48e9-a1d1-79950be662e4 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:42 devstack sudo[107263]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267.297c5096-2010-48e9-a1d1-79950be662e4 Nov 01 12:40:42 devstack sudo[107263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:42 devstack sudo[107263]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d366a472-4456-4201-b0d3-741efdee67c2 tempest-SnapshotDependencyTests-152679747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267.297c5096-2010-48e9-a1d1-79950be662e4" returned: 0 in 0.239s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:42 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d366a472-4456-4201-b0d3-741efdee67c2 tempest-SnapshotDependencyTests-152679747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:42 devstack sudo[107266]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267.info Nov 01 12:40:42 devstack sudo[107266]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:43 devstack sudo[107266]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d366a472-4456-4201-b0d3-741efdee67c2 tempest-SnapshotDependencyTests-152679747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf truncate -s0 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267.info" returned: 0 in 0.244s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:43 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-d366a472-4456-4201-b0d3-741efdee67c2 tempest-SnapshotDependencyTests-152679747 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267.info is being set with open permissions: ugo+rw Nov 01 12:40:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d366a472-4456-4201-b0d3-741efdee67c2 tempest-SnapshotDependencyTests-152679747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267.info {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:43 devstack sudo[107269]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267.info Nov 01 12:40:43 devstack sudo[107269]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:43 devstack sudo[107269]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d366a472-4456-4201-b0d3-741efdee67c2 tempest-SnapshotDependencyTests-152679747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267.info" returned: 0 in 0.239s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:43 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d366a472-4456-4201-b0d3-741efdee67c2 tempest-SnapshotDependencyTests-152679747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.862s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:43 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-d366a472-4456-4201-b0d3-741efdee67c2 tempest-SnapshotDependencyTests-152679747 None] Create snapshot completed successfully Nov 01 12:40:44 devstack cinder-volume[86574]: DEBUG cinder.volume.flows.manager.create_volume [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=86574) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1397}} Nov 01 12:40:44 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] Flow 'volume_create_manager' (3388a59e-f44e-4305-9a27-6b77a7df422c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:44 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c50c4f36-420e-4e06-940c-017ff6788030) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:44 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c50c4f36-420e-4e06-940c-017ff6788030) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=,attach_status='detached',availability_zone='nova',bootable=False,cluster=,cluster_name=None,consistencygroup=,consistencygroup_id=None,created_at=2026-11-01T11:40:44Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=,group=,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=314348ec-dca1-475f-9b56-1878edc8294d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1eb38d6956b5405b9f6f73f3c8583fc6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2026-11-01T11:40:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=297c5096-2010-48e9-a1d1-79950be662e4,snapshots=,source_volid=None,status='creating',terminated_at=None,updated_at=2026-11-01T11:40:44Z,use_quota=True,user_id='acd55d3462ee46c0969d7ed05c030f56',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(45a70e1e-2b1b-4448-8568-99c25cb642b9),volume_type_id=45a70e1e-2b1b-4448-8568-99c25cb642b9)' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:44 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3add7663-dee1-43f6-893f-e2ca9626b30d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:44 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3add7663-dee1-43f6-893f-e2ca9626b30d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:44 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f492d283-2227-4d83-8c0e-2c9ac47c33ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:44 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f492d283-2227-4d83-8c0e-2c9ac47c33ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '314348ec-dca1-475f-9b56-1878edc8294d', 'volume_name': 'volume-314348ec-dca1-475f-9b56-1878edc8294d', 'volume_size': 1, 'snapshot_id': '297c5096-2010-48e9-a1d1-79950be662e4'}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:44 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cc74cf8-d1a2-4c9c-9190-9b3b067be727) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:44 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1cc74cf8-d1a2-4c9c-9190-9b3b067be727) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:44 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54473d96-5802-4953-9202-a1e75a816ff8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:44 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] Volume 314348ec-dca1-475f-9b56-1878edc8294d: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-314348ec-dca1-475f-9b56-1878edc8294d', 'volume_size': 1, 'snapshot_id': '297c5096-2010-48e9-a1d1-79950be662e4'} Nov 01 12:40:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:44 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] Acquiring lock "cinder-quobyte-297c5096-2010-48e9-a1d1-79950be662e4-314348ec-dca1-475f-9b56-1878edc8294d" by "_create_volume_from_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:44 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] Lock "cinder-quobyte-297c5096-2010-48e9-a1d1-79950be662e4-314348ec-dca1-475f-9b56-1878edc8294d" acquired by "_create_volume_from_snapshot" :: waited 0.013s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:44 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] Creating volume 314348ec-dca1-475f-9b56-1878edc8294d from snapshot 297c5096-2010-48e9-a1d1-79950be662e4 {{(pid=86574) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:355}} Nov 01 12:40:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:44 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:44 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:44 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] Selected osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb as target Quobyte volume. {{(pid=86574) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:713}} Nov 01 12:40:44 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] Acquiring lock "cinder-quobyte-314348ec-dca1-475f-9b56-1878edc8294d" by "_copy_volume_from_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:44 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] Lock "cinder-quobyte-314348ec-dca1-475f-9b56-1878edc8294d" acquired by "_copy_volume_from_snapshot" :: waited 0.019s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:44 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] snapshot: 297c5096-2010-48e9-a1d1-79950be662e4, volume: 314348ec-dca1-475f-9b56-1878edc8294d, {{(pid=86574) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:402}} Nov 01 12:40:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:44 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:44 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:44 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[5fc7d353-e50e-40ce-a8a0-22f432cec490]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267.297c5096-2010-48e9-a1d1-79950be662e4 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:44 devstack sudo[107272]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267.297c5096-2010-48e9-a1d1-79950be662e4 Nov 01 12:40:44 devstack sudo[107272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:44 devstack sudo[107272]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267.297c5096-2010-48e9-a1d1-79950be662e4" returned: 0 in 0.358s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:44 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:40:44 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[41e25c0f-9dd6-4f67-b3b4-f9d4fb129145]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:44 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:44 devstack sudo[107277]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267 Nov 01 12:40:44 devstack sudo[107277]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:45 devstack sudo[107277]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267" returned: 0 in 0.363s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:45 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] will copy from snapshot at /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267 {{(pid=86574) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:423}} Nov 01 12:40:45 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] Creating direct copy from snapshot {{(pid=86574) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:431}} Nov 01 12:40:45 devstack cinder-volume[86574]: DEBUG cinder.utils [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] Path /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-314348ec-dca1-475f-9b56-1878edc8294d not found in is_blk_device check {{(pid=86574) is_blk_device /opt/stack/cinder/cinder/utils.py:627}} Nov 01 12:40:45 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-314348ec-dca1-475f-9b56-1878edc8294d {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:45 devstack sudo[107282]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-314348ec-dca1-475f-9b56-1878edc8294d Nov 01 12:40:45 devstack sudo[107282]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:51 devstack sudo[107282]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-314348ec-dca1-475f-9b56-1878edc8294d" returned: 0 in 5.840s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:51 devstack cinder-volume[86574]: DEBUG cinder.image.image_utils [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] Image conversion details: src /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267, size 1024.00 MB, duration 5.84 sec, destination /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-314348ec-dca1-475f-9b56-1878edc8294d {{(pid=86574) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:558}} Nov 01 12:40:51 devstack cinder-volume[86574]: INFO cinder.image.image_utils [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] Converted 1024.00 MB image at 175.30 MB/s Nov 01 12:40:51 devstack cinder-volume[86574]: WARNING cinder.volume.drivers.remotefs [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-314348ec-dca1-475f-9b56-1878edc8294d is being set with open permissions: ugo+rw Nov 01 12:40:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-314348ec-dca1-475f-9b56-1878edc8294d {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:51 devstack sudo[107332]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-314348ec-dca1-475f-9b56-1878edc8294d Nov 01 12:40:51 devstack sudo[107332]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:51 devstack sudo[107332]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf chmod ugo+rw /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-314348ec-dca1-475f-9b56-1878edc8294d" returned: 0 in 0.242s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:51 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] Lock "cinder-quobyte-314348ec-dca1-475f-9b56-1878edc8294d" released by "_copy_volume_from_snapshot" :: held 6.894s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:51 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] Lock "cinder-quobyte-297c5096-2010-48e9-a1d1-79950be662e4-314348ec-dca1-475f-9b56-1878edc8294d" released by "_create_volume_from_snapshot" :: held 6.961s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 6.975s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:51 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (54473d96-5802-4953-9202-a1e75a816ff8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-314348ec-dca1-475f-9b56-1878edc8294d', 'volume_size': 1, 'snapshot_id': '297c5096-2010-48e9-a1d1-79950be662e4'}' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:51 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a86899e-54eb-410c-8df9-d9d38f3e1543) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:242}} Nov 01 12:40:51 devstack cinder-volume[86574]: INFO cinder.volume.flows.manager.create_volume [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] Volume volume-314348ec-dca1-475f-9b56-1878edc8294d (314348ec-dca1-475f-9b56-1878edc8294d): created successfully Nov 01 12:40:51 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7a86899e-54eb-410c-8df9-d9d38f3e1543) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=86574) _task_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:218}} Nov 01 12:40:51 devstack cinder-volume[86574]: DEBUG cinder.volume.manager [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] Flow 'volume_create_manager' (3388a59e-f44e-4305-9a27-6b77a7df422c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=86574) _flow_receiver /opt/stack/data/venv/lib/python3.12/site-packages/taskflow/listeners/logging.py:160}} Nov 01 12:40:51 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-d09a6a5b-a886-454d-9ec7-9af0476c9a7c tempest-SnapshotDependencyTests-152679747 None] Created volume successfully. Nov 01 12:40:51 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-08c11e73-8f40-4cc5-ae4e-95998cb4a57c tempest-SnapshotDependencyTests-152679747 None] Acquiring lock "cinder-297c5096-2010-48e9-a1d1-79950be662e4-delete_snapshot" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:51 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-08c11e73-8f40-4cc5-ae4e-95998cb4a57c tempest-SnapshotDependencyTests-152679747 None] Lock "cinder-297c5096-2010-48e9-a1d1-79950be662e4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:51 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-08c11e73-8f40-4cc5-ae4e-95998cb4a57c tempest-SnapshotDependencyTests-152679747 None] Acquiring lock "cinder-quobyte-6036ce36-4cd0-4bd9-bbb7-a10e99167267" by "delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:51 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-08c11e73-8f40-4cc5-ae4e-95998cb4a57c tempest-SnapshotDependencyTests-152679747 None] Lock "cinder-quobyte-6036ce36-4cd0-4bd9-bbb7-a10e99167267" acquired by "delete_snapshot" :: waited 0.016s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:51 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-08c11e73-8f40-4cc5-ae4e-95998cb4a57c tempest-SnapshotDependencyTests-152679747 None] Acquiring lock "cinder-quobyte-297c5096-2010-48e9-a1d1-79950be662e4" by "_delete_snapshot" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:51 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-08c11e73-8f40-4cc5-ae4e-95998cb4a57c tempest-SnapshotDependencyTests-152679747 None] Lock "cinder-quobyte-297c5096-2010-48e9-a1d1-79950be662e4" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:51 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-08c11e73-8f40-4cc5-ae4e-95998cb4a57c tempest-SnapshotDependencyTests-152679747 None] Deleting offline snapshot 297c5096-2010-48e9-a1d1-79950be662e4 of volume 6036ce36-4cd0-4bd9-bbb7-a10e99167267 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1288}} Nov 01 12:40:51 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-08c11e73-8f40-4cc5-ae4e-95998cb4a57c tempest-SnapshotDependencyTests-152679747 None] snapshot_file for this snap is: volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267.297c5096-2010-48e9-a1d1-79950be662e4 {{(pid=86574) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1317}} Nov 01 12:40:51 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[1455a089-c4ea-44f8-a9bc-6abd60f22b3c]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:51 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-08c11e73-8f40-4cc5-ae4e-95998cb4a57c tempest-SnapshotDependencyTests-152679747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267.297c5096-2010-48e9-a1d1-79950be662e4 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:52 devstack sudo[107335]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267.297c5096-2010-48e9-a1d1-79950be662e4 Nov 01 12:40:52 devstack sudo[107335]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:52 devstack sudo[107335]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-08c11e73-8f40-4cc5-ae4e-95998cb4a57c tempest-SnapshotDependencyTests-152679747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267.297c5096-2010-48e9-a1d1-79950be662e4" returned: 0 in 0.360s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:52 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.remotefs [None req-08c11e73-8f40-4cc5-ae4e-95998cb4a57c tempest-SnapshotDependencyTests-152679747 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=86574) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:896}} Nov 01 12:40:52 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[d6fac223-43b6-44ea-a72f-273585920fe4]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-08c11e73-8f40-4cc5-ae4e-95998cb4a57c tempest-SnapshotDependencyTests-152679747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:52 devstack sudo[107341]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267 Nov 01 12:40:52 devstack sudo[107341]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:52 devstack sudo[107341]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-08c11e73-8f40-4cc5-ae4e-95998cb4a57c tempest-SnapshotDependencyTests-152679747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267" returned: 0 in 0.514s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:52 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-08c11e73-8f40-4cc5-ae4e-95998cb4a57c tempest-SnapshotDependencyTests-152679747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267.297c5096-2010-48e9-a1d1-79950be662e4 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:52 devstack sudo[107346]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267.297c5096-2010-48e9-a1d1-79950be662e4 Nov 01 12:40:52 devstack sudo[107346]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:53 devstack sudo[107346]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-08c11e73-8f40-4cc5-ae4e-95998cb4a57c tempest-SnapshotDependencyTests-152679747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf qemu-img commit -d /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267.297c5096-2010-48e9-a1d1-79950be662e4" returned: 0 in 0.314s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-08c11e73-8f40-4cc5-ae4e-95998cb4a57c tempest-SnapshotDependencyTests-152679747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267.297c5096-2010-48e9-a1d1-79950be662e4 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:53 devstack sudo[107351]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267.297c5096-2010-48e9-a1d1-79950be662e4 Nov 01 12:40:53 devstack sudo[107351]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:53 devstack sudo[107351]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:53 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-08c11e73-8f40-4cc5-ae4e-95998cb4a57c tempest-SnapshotDependencyTests-152679747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267.297c5096-2010-48e9-a1d1-79950be662e4" returned: 0 in 0.241s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:53 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-08c11e73-8f40-4cc5-ae4e-95998cb4a57c tempest-SnapshotDependencyTests-152679747 None] Lock "cinder-quobyte-297c5096-2010-48e9-a1d1-79950be662e4" released by "_delete_snapshot" :: held 1.524s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:53 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-08c11e73-8f40-4cc5-ae4e-95998cb4a57c tempest-SnapshotDependencyTests-152679747 None] Lock "cinder-quobyte-6036ce36-4cd0-4bd9-bbb7-a10e99167267" released by "delete_snapshot" :: held 1.544s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:53 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-08c11e73-8f40-4cc5-ae4e-95998cb4a57c tempest-SnapshotDependencyTests-152679747 None] Created reservations ['781c88aa-364e-48ac-aacb-5a033270746d', 'd30f7a29-0305-47f6-8a89-c2a1c12f3950', '2774a49a-1933-484b-ac0c-ecc7dc92898e', 'd3ec21e5-cf7e-4369-ade7-a6351ee489c1'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:40:53 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-08c11e73-8f40-4cc5-ae4e-95998cb4a57c tempest-SnapshotDependencyTests-152679747 None] Delete snapshot completed successfully. Nov 01 12:40:53 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-08c11e73-8f40-4cc5-ae4e-95998cb4a57c tempest-SnapshotDependencyTests-152679747 None] Lock "cinder-297c5096-2010-48e9-a1d1-79950be662e4-delete_snapshot" released by "delete_snapshot" :: held 1.669s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:54 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e977e504-4699-402e-a0f1-afc6e08161c3 tempest-SnapshotDependencyTests-152679747 None] Acquiring lock "cinder-6036ce36-4cd0-4bd9-bbb7-a10e99167267-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:54 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e977e504-4699-402e-a0f1-afc6e08161c3 tempest-SnapshotDependencyTests-152679747 None] Lock "cinder-6036ce36-4cd0-4bd9-bbb7-a10e99167267-delete_volume" acquired by "delete_volume" :: waited 0.015s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:54 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e977e504-4699-402e-a0f1-afc6e08161c3 tempest-SnapshotDependencyTests-152679747 None] Acquiring lock "cinder-quobyte-6036ce36-4cd0-4bd9-bbb7-a10e99167267" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:54 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e977e504-4699-402e-a0f1-afc6e08161c3 tempest-SnapshotDependencyTests-152679747 None] Lock "cinder-quobyte-6036ce36-4cd0-4bd9-bbb7-a10e99167267" acquired by "delete_volume" :: waited 0.014s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:54 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddca6f31-ed63-4f1a-9191-518ae80bbacd]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e977e504-4699-402e-a0f1-afc6e08161c3 tempest-SnapshotDependencyTests-152679747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:54 devstack sudo[107354]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267 Nov 01 12:40:54 devstack sudo[107354]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:54 devstack sudo[107354]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e977e504-4699-402e-a0f1-afc6e08161c3 tempest-SnapshotDependencyTests-152679747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267" returned: 0 in 0.356s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e977e504-4699-402e-a0f1-afc6e08161c3 tempest-SnapshotDependencyTests-152679747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267 {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:54 devstack sudo[107359]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267 Nov 01 12:40:54 devstack sudo[107359]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:54 devstack sudo[107359]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e977e504-4699-402e-a0f1-afc6e08161c3 tempest-SnapshotDependencyTests-152679747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-6036ce36-4cd0-4bd9-bbb7-a10e99167267" returned: 0 in 0.241s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:54 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e977e504-4699-402e-a0f1-afc6e08161c3 tempest-SnapshotDependencyTests-152679747 None] Lock "cinder-quobyte-6036ce36-4cd0-4bd9-bbb7-a10e99167267" released by "delete_volume" :: held 0.660s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:54 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-e977e504-4699-402e-a0f1-afc6e08161c3 tempest-SnapshotDependencyTests-152679747 None] Created reservations ['0b210a89-ffa9-4af4-bfaa-09afa83a16fb', '84f12dec-7950-4355-901a-e68fff5372c6', '37ba2d45-3be1-4e31-b286-858d0b5b45f9', 'ca0db1a0-8b6f-4fd9-ac4b-2539d0fd6e3b'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:40:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e977e504-4699-402e-a0f1-afc6e08161c3 tempest-SnapshotDependencyTests-152679747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e977e504-4699-402e-a0f1-afc6e08161c3 tempest-SnapshotDependencyTests-152679747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:54 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e977e504-4699-402e-a0f1-afc6e08161c3 tempest-SnapshotDependencyTests-152679747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:54 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-e977e504-4699-402e-a0f1-afc6e08161c3 tempest-SnapshotDependencyTests-152679747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-e977e504-4699-402e-a0f1-afc6e08161c3 tempest-SnapshotDependencyTests-152679747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:54 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e977e504-4699-402e-a0f1-afc6e08161c3 tempest-SnapshotDependencyTests-152679747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:54 devstack sudo[107362]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:40:54 devstack sudo[107362]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:55 devstack sudo[107362]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-e977e504-4699-402e-a0f1-afc6e08161c3 tempest-SnapshotDependencyTests-152679747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.244s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:55 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-e977e504-4699-402e-a0f1-afc6e08161c3 tempest-SnapshotDependencyTests-152679747 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:40:55 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-e977e504-4699-402e-a0f1-afc6e08161c3 tempest-SnapshotDependencyTests-152679747 None] Deleted volume successfully. Nov 01 12:40:55 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-e977e504-4699-402e-a0f1-afc6e08161c3 tempest-SnapshotDependencyTests-152679747 None] Lock "cinder-6036ce36-4cd0-4bd9-bbb7-a10e99167267-delete_volume" released by "delete_volume" :: held 1.091s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:55 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-8091eeb6-8660-4758-afbc-689545538939 tempest-SnapshotDependencyTests-152679747 None] Acquiring lock "cinder-314348ec-dca1-475f-9b56-1878edc8294d-delete_volume" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:55 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-8091eeb6-8660-4758-afbc-689545538939 tempest-SnapshotDependencyTests-152679747 None] Lock "cinder-314348ec-dca1-475f-9b56-1878edc8294d-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:55 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-8091eeb6-8660-4758-afbc-689545538939 tempest-SnapshotDependencyTests-152679747 None] Acquiring lock "cinder-quobyte-314348ec-dca1-475f-9b56-1878edc8294d" by "delete_volume" {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:138}} Nov 01 12:40:55 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-8091eeb6-8660-4758-afbc-689545538939 tempest-SnapshotDependencyTests-152679747 None] Lock "cinder-quobyte-314348ec-dca1-475f-9b56-1878edc8294d" acquired by "delete_volume" :: waited 0.014s {{(pid=86574) __acquire /opt/stack/cinder/cinder/coordination.py:141}} Nov 01 12:40:55 devstack cinder-volume[86574]: DEBUG oslo.privsep.daemon [-] privsep: reply[9a5c30d6-975b-434b-acbf-1038296b5c7c]: (4, 'qcow2') {{(pid=87870) _call_back /opt/stack/data/venv/lib/python3.12/site-packages/oslo_privsep/daemon.py:580}} Nov 01 12:40:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8091eeb6-8660-4758-afbc-689545538939 tempest-SnapshotDependencyTests-152679747 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-314348ec-dca1-475f-9b56-1878edc8294d {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:55 devstack sudo[107365]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-314348ec-dca1-475f-9b56-1878edc8294d Nov 01 12:40:55 devstack sudo[107365]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:55 devstack sudo[107365]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8091eeb6-8660-4758-afbc-689545538939 tempest-SnapshotDependencyTests-152679747 None] CMD "/opt/stack/data/venv/bin/python3.12 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-314348ec-dca1-475f-9b56-1878edc8294d" returned: 0 in 0.353s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8091eeb6-8660-4758-afbc-689545538939 tempest-SnapshotDependencyTests-152679747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-314348ec-dca1-475f-9b56-1878edc8294d {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:55 devstack sudo[107370]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-314348ec-dca1-475f-9b56-1878edc8294d Nov 01 12:40:55 devstack sudo[107370]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:55 devstack sudo[107370]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8091eeb6-8660-4758-afbc-689545538939 tempest-SnapshotDependencyTests-152679747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf rm -f /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa/volume-314348ec-dca1-475f-9b56-1878edc8294d" returned: 0 in 0.241s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:55 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-8091eeb6-8660-4758-afbc-689545538939 tempest-SnapshotDependencyTests-152679747 None] Lock "cinder-quobyte-314348ec-dca1-475f-9b56-1878edc8294d" released by "delete_volume" :: held 0.634s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:40:55 devstack cinder-volume[86574]: DEBUG cinder.quota [None req-8091eeb6-8660-4758-afbc-689545538939 tempest-SnapshotDependencyTests-152679747 None] Created reservations ['cd7e037d-5531-4073-b5b6-4d3fc9bb9b00', '5b6a0ade-d7d3-4f6b-a890-4aabb7c54efa', 'b5f7a1db-4263-4dc9-822b-840849294100', '0c06b74c-ab95-475d-badb-e3b7a9965770'] {{(pid=86574) reserve /opt/stack/cinder/cinder/quota.py:752}} Nov 01 12:40:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8091eeb6-8660-4758-afbc-689545538939 tempest-SnapshotDependencyTests-152679747 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:512}} Nov 01 12:40:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8091eeb6-8660-4758-afbc-689545538939 tempest-SnapshotDependencyTests-152679747 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:525}} Nov 01 12:40:55 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-8091eeb6-8660-4758-afbc-689545538939 tempest-SnapshotDependencyTests-152679747 None] Quobyte Volume URL set to: {'osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb': None} {{(pid=86574) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:662}} Nov 01 12:40:55 devstack cinder-volume[86574]: DEBUG cinder.volume.drivers.quobyte [None req-8091eeb6-8660-4758-afbc-689545538939 tempest-SnapshotDependencyTests-152679747 None] Available shares ['osci02.corp.quobyte.com/cinder-vol-697c44c2-bd81-4722-9529-9f279d7a60bb'] {{(pid=86574) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:692}} Nov 01 12:40:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.lockutils [None req-8091eeb6-8660-4758-afbc-689545538939 tempest-SnapshotDependencyTests-152679747 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.007s {{(pid=86574) inner /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/lockutils.py:544}} Nov 01 12:40:55 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8091eeb6-8660-4758-afbc-689545538939 tempest-SnapshotDependencyTests-152679747 None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:440}} Nov 01 12:40:56 devstack sudo[107373]: quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa Nov 01 12:40:56 devstack sudo[107373]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000) Nov 01 12:40:56 devstack sudo[107373]: pam_unix(sudo:session): session closed for user root Nov 01 12:40:56 devstack cinder-volume[86574]: DEBUG oslo_concurrency.processutils [None req-8091eeb6-8660-4758-afbc-689545538939 tempest-SnapshotDependencyTests-152679747 None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf df --portability --block-size 1 /opt/stack/data/cinder/mnt/7beb4183c6d114f51eb871bb60f3b7aa" returned: 0 in 0.250s {{(pid=86574) execute /opt/stack/data/venv/lib/python3.12/site-packages/oslo_concurrency/processutils.py:468}} Nov 01 12:40:56 devstack cinder-volume[86574]: DEBUG cinder.manager [None req-8091eeb6-8660-4758-afbc-689545538939 tempest-SnapshotDependencyTests-152679747 None] Notifying Schedulers of capabilities ... {{(pid=86574) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:219}} Nov 01 12:40:56 devstack cinder-volume[86574]: INFO cinder.volume.manager [None req-8091eeb6-8660-4758-afbc-689545538939 tempest-SnapshotDependencyTests-152679747 None] Deleted volume successfully. Nov 01 12:40:56 devstack cinder-volume[86574]: DEBUG cinder.coordination [None req-8091eeb6-8660-4758-afbc-689545538939 tempest-SnapshotDependencyTests-152679747 None] Lock "cinder-314348ec-dca1-475f-9b56-1878edc8294d-delete_volume" released by "delete_volume" :: held 1.075s {{(pid=86574) __release /opt/stack/cinder/cinder/coordination.py:152}} Nov 01 12:41:05 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:UPDATE=50,cinder:SELECT=38,cinder:DELETE=3,cinder:INSERT=14 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:41:06 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:SELECT=38,cinder:INSERT=11,cinder:UPDATE=51,cinder:DELETE=6 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}} Nov 01 12:41:18 devstack cinder-volume[86574]: DEBUG dbcounter [-] [86574] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=86574) stat_writer /opt/stack/data/venv/lib/python3.12/site-packages/dbcounter.py:115}}